Resources - Reliability

The meaning of Kappa: Probabilistic Concepts of Reliability and Validity Revisited

Description: Discusses issues and calculations for inter-rater reliability and its use in coding validity.

Making Sense of Qualitative Data: Complementary Research Strategies

Description: Describes and illustrates a number of key, complementary approaches to qualitative data and offers practical advice on the many ways to analyze data.

Concordance Between Ethnographer and Folk Perspectives: Observed Performance and - Self-Ascription of Sibling Caretaking Roles

Description: Compares observer to cultural member view of roles in care-taking

Developing Data Analysis

Description: Provides a step-by-step guide to all the questions students ask when beginning their first research project.

Validity and Reliability of Qualitative Data Analysis: Interobserver Agreement in Reconstructing Interpretative Frames

Description: Assessed interobserver reliability in the use of reconstructing interpretative frames techniques as an indicator of its rigor.

Measures of Interobserver Agreement: Calculation Formulas and Distribution Effects

Description: Discusses issues, types, and calculations for inter-rater reliability

Interobserver Agreement, Reliability, and Generalizability of Data Collected in Observational Studies

Description: Discusses reliability and generalizability in terms of coefficients that reflect the "quality" of data, what defines quality data, and how reports of agreement are insufficient.

Techniques to Identify Themes

Description: Wonderful guide to describing and identifying themes in qualitative research.

A Systems Approach to Qualitative Data Management and Analysis

Description: Introduces and illustrates a systematic approach to qualitative data management from a database architecture perspective.