Setting Local Cut Scores on the Sat Reasoning Test™ Writing Section: For Use in College Placement and Admissions Decisions

The introduction of the SAT Reasoning Test™ with a writing section in March 2005 and the concomitant elimination of the SAT® Subject Test in Writing after January 2005 have led many colleges and institutions to ask for guidance in using the new SAT Reasoning Test writing section scores for college placement and admissions. Standard-setting methodologies provide one possible set of processes that can be used to identify point(s) on a score scale to divide a group of examinees into categories. Many standard-setting methods have been developed, but only one, the Angoff Method (1971) with Mean Estimation for Essays (Loomis and Bourque 2001), is presented in this document. This document presents many of the decisions needed to conduct a standard-setting session and then provides step-by-step directions to enable colleges or institutions to conduct their own local Angoff-based standard setting for the SAT writing section. Many examples of the data collection documents and supplementary preparation and training materials useful during the standard-setting process, including test items for the March 2005 SAT writing section, are provided. Colleges and institutions are strongly encouraged to use the free Admitted Class Evaluation Service™ (ACES™) offered by the College Board for users of College Board tests to collect information regarding the validity of using specific cut scores on the SAT Reasoning Test writing section for placement or admissions for their institutions' applicants and students. The following are appended: (1) Information on the SAT Reasoning Test™ Writing Section; (2) A Sample Schedule for a Standard Setting Using Angoff with Mean Estimation to Set One Cut Score; (3) A Sample Schedule for a Standard Setting Using Angoff with Mean Estimation to Set Two Cut Scores; (4) SAT Essay Prompt and Multiple-Choice Items for Writing--March 2005; (5) Scoring Guide for the SAT® Essay; (6) Answer Key for the SAT Reasoning Test Writing Section; (7) Training Essay Prompt and Multiple-Choice Items for Writing Section; (8) Angoff with Mean Estimation of Essay Ratings Training Record; (9) Training Evaluation Form; (10) Angoff with Mean Estimation of Essay Ratings Record; (11) SAT Writing Composite Score Conversion Table; (12) Final Evaluation Form for the SAT Reasoning Test Writing Section; and (13) Dictionary of Terms.