Computing Scores for Incomplete GRE General Computer Adaptive Tests

The General Computer Adaptive Test (CAT) of the Graduate Record Examinations (GRE) includes three operational sections that are separately timed and scored. A "no score" is reported if the examinee answers fewer than 80% of the items or if the examinee does not answer all of the items and leaves the section before time expires. The 80% threshold was adopted to set a minimum threshold to result in psychometrically acceptable scores without penalizing slow test takers. A study was conducted to examine the impact of possible CAT test-taking (and test completion) strategies and scoring options with regard to incomplete tests and to consider the impact of working to the 80% level or beyond it. Actual data for different completion points were selected from 70,000 GRE CAT examinees. CAT simulations were also conducted to assess the impact of different test taking strategies and different ways of scoring tests when not all items were answered. Data did not indicate that there is widespread use of the 80% rule as a strategy for deciding how much of the GRE CAT to complete. Serious psychometric and equity issues would be raised if examinees began to employ this strategy, so monitoring of examinee strategies is important. (Contains three figures and eight tables.) (SLD)