A Computer Adaptive Test (CAT) for Knowledge of Parent Management Skills: Prototype Development and Preliminary Psychometrics

The Knowledge of Effective Parenting Test (KEPT) is a measure of parent management skills that was developed as an outcome measure for clinical trials of psychosocial treatments for disruptive behavior disorders. In the current study, we developed a computer adaptive test (CAT; KEPT-CAT) prototype and compared it to the full item bank (21 items; KEPT-Full) and to a brief static version (10 items; KEPT-Brief) using simulations from a large (N = 1,570) nationally representative dataset. Results showed that the KEPT-CAT prototype (median = 8 items) was slightly more efficient than the KEPT-Brief and had a significantly higher (p < .001) correlation with scores from the full item bank (r = .97) than the KEPT-Brief (r = .94). The KEPT-CAT prototype has additional advantages over the static KEPT-Brief, including the potential selection of different items from one administration to the next. This flexibility can reduce practice effects that might result from repeated administration of the same fixed items.