Item-level Frame-of-reference Effects in Personality Testing: An investigation of incremental validity in an organizational setting

A recent line of research has investigated the frame‐of‐reference effect on personality scale scores, in which self‐report personality items are contextualized to the specific performance setting (e.g., work, school) within which the performance criterion is gathered. Contextualization has been shown to increase both the reliability and the criterion‐related validity of the personality scale scores by facilitating the self‐presentation of respondents, and by more closely measuring the personality construct relevant to the performance domain. The current research extends this area of personality research in two ways. First, this study tests the generalizability of the effectiveness of item‐level contextualization within an organizational setting. Second, this study also provides the necessary test of the incremental validity of this contextualized approach to personality measurement above and beyond the traditional, noncontextualized approach. The results confirm that a work‐specific personality measure, contextualized at the item level, adds to the prediction of job performance above and beyond that obtained by a noncontextual measure of the same personality traits. Practical and theoretical implications are discussed.