Validity and Reliability of Qualitative Data Analysis: Interobserver Agreement in Reconstructing Interpretative Frames

Moret, Margriet, Reuzel, Rob, Van Der Wilt, Gert J. & Grin, John (2007), Field Methods, 19(1): 24-39 Description: Many authors have discussed criteria for assessing the quality of qualitative studies. However, relatively few have presented the results of using criteria for validity of qualitative studies. We investigated the quality of reconstructing interpretative frames, a method for analyzing interview transcripts. The aim of this method is to describe a person's perspective, distinguishing between perceived problem definitions, proposed solutions, empirical background theories, and normative preferences. Based on this description, one should be able to estimate this person's cooperation on implementing specific changes in his or her practice. In this article, we assessed the interobserver reliability of this analytical method as an indicator of its rigor. Six analysts reconstructed interpretative frames on the basis of verbatim transcripts of three interviews. The analysts agreed only moderately about the issues identified and which problems should be prioritized. However, they showed remarkable unanimity as to the estimates of the respondents' cooperation on proposed solutions. Sage Publications