BioMed Central Women's Health
Diagnostic test sets are a valuable research tool that contributes importantly to the validity and reliability of studies that assess agreement in breast pathology. In order to fully understand the strengths and weaknesses of any agreement and reliability study, however, the methods should be fully reported. In this paper we provide a step-by-step description of the methods used to create four complex test sets for a study of diagnostic agreement among pathologists interpreting breast biopsy specimens. We use the newly developed Guidelines for Reporting Reliability and Agreement Studies (GRRAS) as a basis to report these methods.
Oster, Natalia V.; Carney, Patricia A.; Allison, Kimberly H.; Weaver, Donald L.; Reisch, Lisa; Longton, Gary; and Onega, Tracy, "Development of a Diagnostic Test Set to Assess Agreement in Breast Pathology: Practical Application of the Guidelines for Reporting Reliability and Agreement Studies (GRRAS)" (2013). Open Dartmouth: Faculty Open Access Articles. 1269.