Home|Journals Follow on Twitter| Subscribe to List

Directory for Medical Articles
 

Open Access

Original Research

Ann Med Res. 2012; 19(4): 220-227


Comparison of Agreement Statistics in Case of Multiple-Raters and Diagnostic Test Being Categorical: A Simulation Study

E. Arzu Kanık1, Gülhan Örekici Temel1, Semra Erdoğan1, İrem Ersöz Kaya2

.

Abstract

Aim: When the number of raters and the number of categories of diagnostic tests are two or more, put forward agreement statistics’ conditions of being affected by the sample size, the number of raters and the number of categories of scale used. Material and Methods: AC1 statistic, Fleiss Kappa and Krippendorff’s Alpha values belonging to state where there was no agreement between raters and states where agreement was 0.90 for those combinations were recorded for 1000 simulation study. Results: The expected agreement between raters is 0.90, AC1 statistic and Fleiss Kappa coefficient offer similar results and take equivalent values, to the expected value of agreement in all combinations. When Krippendorff’s Alpha coefficient examined, it is not affected by sample size but affected by the number of raters and the number of categories pertaining to diagnostic test. Conclusion: If prevalence value is known and a bear significant for study, use of AC1 statistic is recommended among agreement statistics, if the existence of missing data is the case in study, Krippendorff’s Alpha coefficient is the most appropriate agreement statistic, except these cases mentioned, use of Fleiss Kappa coefficient is recommended. Key Words: Fleiss Kappa; Gwet’s AC1 Statistics; Krippendorff Alpha; Agreement between Raters.



Share this Article


Advertisement
Oxidants and Antioxidants in Medical Science

SUBMIT YOUR ARTICLE NOW


ScopeMed.com
ScopeMed Home
Follow ScopeMed on Twitter
BiblioCAM
Author Tools
eJPort Journal Hosting
About ScopeMed
License Information
Terms & Conditions
Privacy Policy
Contact Us

The articles in Scopemed are open access articles licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (https://creativecommons.org/licenses/by-nc-sa/4.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.
ScopeMed is a Database Service for Scientific Publications. Copyright © ScopeMed® Information Services.
Scopemed Buttons