Ir directamente a la navegación principal Ir directamente a la búsqueda Ir directamente al contenido principal

Leveraging Data Sampling and Practical Knowledge: Field Instructors’ Perceptions About Inter-Rater Reliability Data

  • University of Delaware

Producción científica › revisión exhaustiva

2 Citas (Scopus)

Resumen

For accreditation and programmatic decision making, education school administrators use inter-rater reliability analyses to judge credibility of student–teacher assessments. Although weak levels of agreement between university-appointed supervisors and cooperating teachers are usually interpreted to indicate that the process is not being implemented with fidelity, it is unclear which part of the process contributes to weak agreements. Quantitative analysis of data (N = 230) from four semesters, and matched-pair sampling (n = 14), countered weaknesses found in usual analysis methods. Using “data-driven decision making,” “personal practical knowledge” and “evidence-based practice” as theoretical frameworks, university-based field instructors’ discussions about what accounted for varying correlations were analyzed. Qualitative data analysis (focus group/questionnaires) found that field instructors (n = 7) assumed divergent scores indicate weakness in evaluation processes and posited conflicting root causes. Inter-rater reliability analyses should include pair-wise sampling, so that weak and strong rates of agreement are unmasked and opportunities for meaningful data conversations are possible.

Idioma originalEnglish
Páginas (desde-hasta)20-44
Número de páginas25
PublicaciónAction in Teacher Education
Volumen36
N.º1
DOI
EstadoPublished - 2 ene 2014
Publicado de forma externaSí

Huella

Profundice en los temas de investigación de 'Leveraging Data Sampling and Practical Knowledge: Field Instructors’ Perceptions About Inter-Rater Reliability Data'. En conjunto forman una huella única.

Citar esto