A reliability-generalization study of journal peer reviews: a multilevel meta-analysis of inter-rater reliability and its determinants

This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined as the extent to which two or more independent reviews of the same scientific document agree. Altogether, 70 reliability coefficients (Cohen's Kappa, intra-class correlation...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Veröffentlicht in:	PloS one 2010-12, Vol.5 (12), p.e14331-e14331
Hauptverfasser:	Bornmann, Lutz, Mutz, Rüdiger, Daniel, Hans-Dieter
Format:	Artikel
Sprache:	eng
Schlagworte:	Accountability Bayes Theorem Bias Coefficient of variation Correlation Correlation analysis Higher education Homogeneity Humans Information systems Knowledge Literature reviews Low level Mathematical analysis Mathematics/Statistics Medical ethics Meta-analysis Models, Statistical Multilevel Observer Variation Peer Review Peers Periodicals as Topic Plagiarism Regression Analysis Reliability analysis Reproducibility of Results Research Design Reviews Science Policy Science Policy/Education Social psychology Statistical analysis Studies
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Schreiben Sie den ersten Kommentar!