Reliability of competency-based, multi-dimensional, multiple-rater performance ratings

The purpose of this study was to test the assumption that the utilisation of competency-based, multi-dimensional, multiple-rater performance ratings would result in reliable and useful measurements of the performance of managers (N=200) in a specific South African organisation. Reliability coefficients were computed and factor analyses were undertaken to determine the reliability of the ratings. The results indicated high inter-method reliability and low inter-rater reliability. Although the competency-based, multi-dimensional, multiple-rater approach appeared to have facilitated valuable input towards the assessment process a greater degree of reliability, validity and usefulness was not necessarily achieved. Implications of these findings are discussed. Die doel van die studie was om die aanname dat die gebruik van bevoegdheidsgebaseerde, multi-dimensionele, meervoudige-beoordelaar prestasiebeoordeling tot betroubare en bruikbare metings van die prestasie van bestuurders (N=200) in 'n spesifieke Suid-Afrikaanse organisasie sou lei, te toets. Betroubaarheidskoëffisiënte is bereken en faktorontledings is uitgevoer om die betroubaarhede te bepaal. Die resultate het hoë inter-metodiese en lae inter-beoordelaarbetroubaarhede aangedui. Hoewel dit wou voorkom of die bevoegdheidsgebaseerde, multidimensionele, meervoudige-beoordelaarbenadering tot prestasiebeoordeling nuttige inligting aan die prestasiebeoordelingsproses verskaf, is 'n verhoogde mate van betroubaarheid, geldigheid en bruikbaarheid nie noodwendig verkry nie. Implikasies van die bevindinge word bespreek.