Number-Right, Item-Response, and Finite-State Scoring: Robustness with Respect to Lack of Equally Classifiable Options and Item Option Independence

The robustness of number-right; one-, two-, and three-parameter item-response; finite-state; and partial-credit scoring was examined with respect to the violation of the equally classifiable options and option independence made in finite-state scoring. All other assumptions underlying the use of these scoring models were met for each of four sub-tests that varied in terms of the violations. Analysis of the responses of 1,232 high school seniors on the subtests revealed that the number-right and one-, two-, and three-parameter scoring methods were equally sensitive to the presence of best answers (lack of option independence) and that the number-right and one- and two-parameter methods were equally sensitive to the presence of absurd option and stem-option connections (unequal classification of options) and pairs of similar or opposite options (lack of option independence, unequal classification of options). The three-parameter model and the finite-state scoring models were adversely sensitive to the presence of testwiseness.