SMABS 2004 Jena University
SMABS 2004 Home Organization About Jena Sponsors Links Contact SMABS Home

European Association of Methodology

Department of methodology and evaluation research

Jena University


© Webmaster

Contributions: Abstract

A comparison between four rater agreement measures

Manuel Ato Juanjo Lpez Ana Benavente
Universidad de Murcia
Spain

The behavior of four indices of rater agreement, PI (Scott, 1954), KAPPA (Cohen, 1960), AC1 (Gwet, 2001) and m (Schuster, 2002) is analyzed by Monte Carlo Simulation, using trait prevalence, sensitivity and specificity and marginal homogeneity as criteria.