Back
Assessing inter-rater reliability when the raters are fixed: Two concepts and two estimates.
Journal article

Assessing inter-rater reliability when the raters are fixed: Two concepts and two estimates.

  • Rousson V Statistical Unit, Institute for Social and Preventive Medicine, University Hospital Center Lausanne, Route de la Corniche 2, CH-1066 Epalinges, Switzerland. valentin.rousson@chuv.ch.
  • 2011-03-23
Published in:
  • Biometrical journal. Biometrische Zeitschrift. - 2011
Biometry
Computer Simulation
Confidence Intervals
Humans
Models, Statistical
Reproducibility of Results
English Intraclass correlation (ICC) is an established tool to assess inter-rater reliability. In a seminal paper published in 1979, Shrout and Fleiss considered three statistical models for inter-rater reliability data with a balanced design. In their first two models, an infinite population of raters was considered, whereas in their third model, the raters in the sample were considered to be the whole population of raters. In the present paper, we show that the two distinct estimates of ICC developed for the first two models can both be applied to the third model and we discuss their different interpretations in this context.
Language
  • English
Open access status
closed
Identifiers
Persistent URL
https://susi.usi.ch/global/documents/147847
Statistics
Document views: 9 File downloads: