Alignment and Implications for Test Takers

The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Educational measurement, issues and practice issues and practice, 2020-06, Vol.39 (2), p.8-17
Hauptverfasser: Welch, Catherine J., Dunbar, Stephen B.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 17
container_issue 2
container_start_page 8
container_title Educational measurement, issues and practice
container_volume 39
creator Welch, Catherine J.
Dunbar, Stephen B.
description The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).
doi_str_mv 10.1111/emip.12332
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2410161435</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1256031</ericid><sourcerecordid>2410161435</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</originalsourceid><addsrcrecordid>eNp9kM1LAzEUxIMoWKsX78KCt8LWvLzdTXMspWqlood6DtlsVlL3y2SL9L8364pH32XgzY8ZGEKugc4h3J2pbTcHhshOyAR4ksYoBDslE8oR4uFxTi6831MKaSb4hMyWlX1vatP0kWqKaFN3ldWqt23jo7J10c74PtqpD-P8JTkrVeXN1a9Oydv9erd6jLcvD5vVchtrZMhiUDTBXOQJzYRAVkKhtVgATQTNtdELgRA8wQsNBhRXFDVloAXnBecpapyS2zG3c-3nIfTLfXtwTaiULAEKGSSYBmo2Utq13jtTys7ZWrmjBCqHLeSwhfzZIsA3I2yc1X_g-glYmlGE4MPof9nKHP9JkuvnzeuY-Q2JLGfz</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2410161435</pqid></control><display><type>article</type><title>Alignment and Implications for Test Takers</title><source>Access via Wiley Online Library</source><source>EBSCOhost Education Source</source><creator>Welch, Catherine J. ; Dunbar, Stephen B.</creator><creatorcontrib>Welch, Catherine J. ; Dunbar, Stephen B.</creatorcontrib><description>The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).</description><identifier>ISSN: 0731-1745</identifier><identifier>EISSN: 1745-3992</identifier><identifier>DOI: 10.1111/emip.12332</identifier><language>eng</language><publisher>Washington: Wiley-Blackwell</publisher><subject>Academic Ability ; Accountability ; Achievement Tests ; alignment ; Alignment (Education) ; Classification ; Content Validity ; Decision Making ; Educational evaluation ; Educational Legislation ; Educational Policy ; Educational tests &amp; measurements ; Elementary Secondary Education ; Federal Legislation ; Inferences ; State Standards ; Student Certification ; Test Construction ; Test Content ; Test Use ; Validity</subject><ispartof>Educational measurement, issues and practice, 2020-06, Vol.39 (2), p.8-17</ispartof><rights>2020 by the National Council on Measurement in Education</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</citedby><cites>FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Femip.12332$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Femip.12332$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,45574,45575</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1256031$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Welch, Catherine J.</creatorcontrib><creatorcontrib>Dunbar, Stephen B.</creatorcontrib><title>Alignment and Implications for Test Takers</title><title>Educational measurement, issues and practice</title><description>The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).</description><subject>Academic Ability</subject><subject>Accountability</subject><subject>Achievement Tests</subject><subject>alignment</subject><subject>Alignment (Education)</subject><subject>Classification</subject><subject>Content Validity</subject><subject>Decision Making</subject><subject>Educational evaluation</subject><subject>Educational Legislation</subject><subject>Educational Policy</subject><subject>Educational tests &amp; measurements</subject><subject>Elementary Secondary Education</subject><subject>Federal Legislation</subject><subject>Inferences</subject><subject>State Standards</subject><subject>Student Certification</subject><subject>Test Construction</subject><subject>Test Content</subject><subject>Test Use</subject><subject>Validity</subject><issn>0731-1745</issn><issn>1745-3992</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9kM1LAzEUxIMoWKsX78KCt8LWvLzdTXMspWqlood6DtlsVlL3y2SL9L8364pH32XgzY8ZGEKugc4h3J2pbTcHhshOyAR4ksYoBDslE8oR4uFxTi6831MKaSb4hMyWlX1vatP0kWqKaFN3ldWqt23jo7J10c74PtqpD-P8JTkrVeXN1a9Oydv9erd6jLcvD5vVchtrZMhiUDTBXOQJzYRAVkKhtVgATQTNtdELgRA8wQsNBhRXFDVloAXnBecpapyS2zG3c-3nIfTLfXtwTaiULAEKGSSYBmo2Utq13jtTys7ZWrmjBCqHLeSwhfzZIsA3I2yc1X_g-glYmlGE4MPof9nKHP9JkuvnzeuY-Q2JLGfz</recordid><startdate>20200601</startdate><enddate>20200601</enddate><creator>Welch, Catherine J.</creator><creator>Dunbar, Stephen B.</creator><general>Wiley-Blackwell</general><general>Wiley Subscription Services, Inc</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20200601</creationdate><title>Alignment and Implications for Test Takers</title><author>Welch, Catherine J. ; Dunbar, Stephen B.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Academic Ability</topic><topic>Accountability</topic><topic>Achievement Tests</topic><topic>alignment</topic><topic>Alignment (Education)</topic><topic>Classification</topic><topic>Content Validity</topic><topic>Decision Making</topic><topic>Educational evaluation</topic><topic>Educational Legislation</topic><topic>Educational Policy</topic><topic>Educational tests &amp; measurements</topic><topic>Elementary Secondary Education</topic><topic>Federal Legislation</topic><topic>Inferences</topic><topic>State Standards</topic><topic>Student Certification</topic><topic>Test Construction</topic><topic>Test Content</topic><topic>Test Use</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Welch, Catherine J.</creatorcontrib><creatorcontrib>Dunbar, Stephen B.</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>Educational measurement, issues and practice</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Welch, Catherine J.</au><au>Dunbar, Stephen B.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1256031</ericid><atitle>Alignment and Implications for Test Takers</atitle><jtitle>Educational measurement, issues and practice</jtitle><date>2020-06-01</date><risdate>2020</risdate><volume>39</volume><issue>2</issue><spage>8</spage><epage>17</epage><pages>8-17</pages><issn>0731-1745</issn><eissn>1745-3992</eissn><abstract>The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).</abstract><cop>Washington</cop><pub>Wiley-Blackwell</pub><doi>10.1111/emip.12332</doi><tpages>10</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0731-1745
ispartof Educational measurement, issues and practice, 2020-06, Vol.39 (2), p.8-17
issn 0731-1745
1745-3992
language eng
recordid cdi_proquest_journals_2410161435
source Access via Wiley Online Library; EBSCOhost Education Source
subjects Academic Ability
Accountability
Achievement Tests
alignment
Alignment (Education)
Classification
Content Validity
Decision Making
Educational evaluation
Educational Legislation
Educational Policy
Educational tests & measurements
Elementary Secondary Education
Federal Legislation
Inferences
State Standards
Student Certification
Test Construction
Test Content
Test Use
Validity
title Alignment and Implications for Test Takers
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T22%3A39%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Alignment%20and%20Implications%20for%20Test%20Takers&rft.jtitle=Educational%20measurement,%20issues%20and%20practice&rft.au=Welch,%20Catherine%20J.&rft.date=2020-06-01&rft.volume=39&rft.issue=2&rft.spage=8&rft.epage=17&rft.pages=8-17&rft.issn=0731-1745&rft.eissn=1745-3992&rft_id=info:doi/10.1111/emip.12332&rft_dat=%3Cproquest_cross%3E2410161435%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2410161435&rft_id=info:pmid/&rft_ericid=EJ1256031&rfr_iscdi=true