|
UCD selected by reviewer
Diagnosis X
All other
UCD selected by original coders
Diagnosis X All other
a c
b d
Agreement rate = (a+d)/(a+b+c+d)
False positive rate = b/(a+b)
False negative rate = c/(c+d)
Kappa value = (Po – Pe)/(1 – Pe)
Po = (a+d)/(a+b+c+d)
Pe = ([a+c]/[a+b+c+d]) * ([a+b]/[a+b+c+d])+([b+d]/[a+b+c+d) * ([c+d]/[a+b+c+d])
|