Judgment Analysis vs. Paired Comparison as a Statistical Procedure for Capturing Policy Models in Readability Prediction

Judgment Analysis (JAN) and JAN-paired comparison (JAN-PC) were compared as a statistical policy-capturing strategy for evaluating the readability of selected passages. Fifteen reading passages were selected from common textbooks used in the first six grades. Five reading experts rank ordered the passages, which were described on five linguistic variables. More consistent results for each judge and fewer policies were obtained with JAN-PC as compared with the JAN procedure.