Reliability Generalization of the Neo Personality Scales

A reliability generalization of 51 samples employing one of the NEO personality scales was conducted. Reliability generalization is a meta-analytic method for examining the variability in the reliability of scores by determining which sample characteristics are related to differences in score reliability. It was found that there was a large amount of variability in the reliability of NEO scores, both between and within personality domains. The sample characteristics that are related to score reliability were dependent on NEO domain. Agreeableness scores appear to be the weakest of the domains assessed by the NEO scales in terms of reliability, particularly in clinical samples, for male-only samples, and when temporal consistency was the criterion for reliability. The reliability of Openness to Experience scores was low when the NEO-Five Factor Inventory was used. The advantages of conceptualizing reliability as a property of scores, and not tests, are discussed.