SMABS 2004 Jena University
SMABS 2004 Home Organization About Jena Sponsors Links Imprint / Contact SMABS Home

European Association of Methodology

Department of methodology and evaluation research

Jena University

Contributions: Abstract

A comparison between four rater agreement measures

Manuel Ato Juanjo Lpez Ana Benavente
Universidad de Murcia

The behavior of four indices of rater agreement, PI (Scott, 1954), KAPPA (Cohen, 1960), AC1 (Gwet, 2001) and m (Schuster, 2002) is analyzed by Monte Carlo Simulation, using trait prevalence, sensitivity and specificity and marginal homogeneity as criteria.