Alignment and Implications for Test Takers
The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability...
Gespeichert in:
Veröffentlicht in: | Educational measurement, issues and practice issues and practice, 2020-06, Vol.39 (2), p.8-17 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 17 |
---|---|
container_issue | 2 |
container_start_page | 8 |
container_title | Educational measurement, issues and practice |
container_volume | 39 |
creator | Welch, Catherine J. Dunbar, Stephen B. |
description | The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order). |
doi_str_mv | 10.1111/emip.12332 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2410161435</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1256031</ericid><sourcerecordid>2410161435</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</originalsourceid><addsrcrecordid>eNp9kM1LAzEUxIMoWKsX78KCt8LWvLzdTXMspWqlood6DtlsVlL3y2SL9L8364pH32XgzY8ZGEKugc4h3J2pbTcHhshOyAR4ksYoBDslE8oR4uFxTi6831MKaSb4hMyWlX1vatP0kWqKaFN3ldWqt23jo7J10c74PtqpD-P8JTkrVeXN1a9Oydv9erd6jLcvD5vVchtrZMhiUDTBXOQJzYRAVkKhtVgATQTNtdELgRA8wQsNBhRXFDVloAXnBecpapyS2zG3c-3nIfTLfXtwTaiULAEKGSSYBmo2Utq13jtTys7ZWrmjBCqHLeSwhfzZIsA3I2yc1X_g-glYmlGE4MPof9nKHP9JkuvnzeuY-Q2JLGfz</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2410161435</pqid></control><display><type>article</type><title>Alignment and Implications for Test Takers</title><source>Access via Wiley Online Library</source><source>EBSCOhost Education Source</source><creator>Welch, Catherine J. ; Dunbar, Stephen B.</creator><creatorcontrib>Welch, Catherine J. ; Dunbar, Stephen B.</creatorcontrib><description>The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).</description><identifier>ISSN: 0731-1745</identifier><identifier>EISSN: 1745-3992</identifier><identifier>DOI: 10.1111/emip.12332</identifier><language>eng</language><publisher>Washington: Wiley-Blackwell</publisher><subject>Academic Ability ; Accountability ; Achievement Tests ; alignment ; Alignment (Education) ; Classification ; Content Validity ; Decision Making ; Educational evaluation ; Educational Legislation ; Educational Policy ; Educational tests & measurements ; Elementary Secondary Education ; Federal Legislation ; Inferences ; State Standards ; Student Certification ; Test Construction ; Test Content ; Test Use ; Validity</subject><ispartof>Educational measurement, issues and practice, 2020-06, Vol.39 (2), p.8-17</ispartof><rights>2020 by the National Council on Measurement in Education</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</citedby><cites>FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Femip.12332$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Femip.12332$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,45574,45575</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1256031$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Welch, Catherine J.</creatorcontrib><creatorcontrib>Dunbar, Stephen B.</creatorcontrib><title>Alignment and Implications for Test Takers</title><title>Educational measurement, issues and practice</title><description>The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).</description><subject>Academic Ability</subject><subject>Accountability</subject><subject>Achievement Tests</subject><subject>alignment</subject><subject>Alignment (Education)</subject><subject>Classification</subject><subject>Content Validity</subject><subject>Decision Making</subject><subject>Educational evaluation</subject><subject>Educational Legislation</subject><subject>Educational Policy</subject><subject>Educational tests & measurements</subject><subject>Elementary Secondary Education</subject><subject>Federal Legislation</subject><subject>Inferences</subject><subject>State Standards</subject><subject>Student Certification</subject><subject>Test Construction</subject><subject>Test Content</subject><subject>Test Use</subject><subject>Validity</subject><issn>0731-1745</issn><issn>1745-3992</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9kM1LAzEUxIMoWKsX78KCt8LWvLzdTXMspWqlood6DtlsVlL3y2SL9L8364pH32XgzY8ZGEKugc4h3J2pbTcHhshOyAR4ksYoBDslE8oR4uFxTi6831MKaSb4hMyWlX1vatP0kWqKaFN3ldWqt23jo7J10c74PtqpD-P8JTkrVeXN1a9Oydv9erd6jLcvD5vVchtrZMhiUDTBXOQJzYRAVkKhtVgATQTNtdELgRA8wQsNBhRXFDVloAXnBecpapyS2zG3c-3nIfTLfXtwTaiULAEKGSSYBmo2Utq13jtTys7ZWrmjBCqHLeSwhfzZIsA3I2yc1X_g-glYmlGE4MPof9nKHP9JkuvnzeuY-Q2JLGfz</recordid><startdate>20200601</startdate><enddate>20200601</enddate><creator>Welch, Catherine J.</creator><creator>Dunbar, Stephen B.</creator><general>Wiley-Blackwell</general><general>Wiley Subscription Services, Inc</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20200601</creationdate><title>Alignment and Implications for Test Takers</title><author>Welch, Catherine J. ; Dunbar, Stephen B.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3232-1a043b9b4069932f1dcc9810490bcec8931b4097dc1e1a7a03c021c977d7753c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Academic Ability</topic><topic>Accountability</topic><topic>Achievement Tests</topic><topic>alignment</topic><topic>Alignment (Education)</topic><topic>Classification</topic><topic>Content Validity</topic><topic>Decision Making</topic><topic>Educational evaluation</topic><topic>Educational Legislation</topic><topic>Educational Policy</topic><topic>Educational tests & measurements</topic><topic>Elementary Secondary Education</topic><topic>Federal Legislation</topic><topic>Inferences</topic><topic>State Standards</topic><topic>Student Certification</topic><topic>Test Construction</topic><topic>Test Content</topic><topic>Test Use</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Welch, Catherine J.</creatorcontrib><creatorcontrib>Dunbar, Stephen B.</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>Educational measurement, issues and practice</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Welch, Catherine J.</au><au>Dunbar, Stephen B.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1256031</ericid><atitle>Alignment and Implications for Test Takers</atitle><jtitle>Educational measurement, issues and practice</jtitle><date>2020-06-01</date><risdate>2020</risdate><volume>39</volume><issue>2</issue><spage>8</spage><epage>17</epage><pages>8-17</pages><issn>0731-1745</issn><eissn>1745-3992</eissn><abstract>The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices, the content validity arguments supporting accountability have relied almost exclusively on the alignment of statewide assessments to state standards. It is assumed that if alignment does not hold, the scores will not provide valid inferences regarding the degree to which test takers have performed. Although alignment results are commonly used as evidence of test appropriateness, Polikoff (this issue) would argue that given the importance of alignment in policy decisions, research related to alignment is surprisingly limited. Few studies have addressed the adequacy of alignment methodologies and results as support for the inferences to be made (i.e., proficient on state standards). This paper uses an example of test taker performance (and common performance indicators) to investigate to what extent the degree of alignment impacts inferences made about performance (i.e., classification into performance levels, estimates of student ability, and student rank order).</abstract><cop>Washington</cop><pub>Wiley-Blackwell</pub><doi>10.1111/emip.12332</doi><tpages>10</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0731-1745 |
ispartof | Educational measurement, issues and practice, 2020-06, Vol.39 (2), p.8-17 |
issn | 0731-1745 1745-3992 |
language | eng |
recordid | cdi_proquest_journals_2410161435 |
source | Access via Wiley Online Library; EBSCOhost Education Source |
subjects | Academic Ability Accountability Achievement Tests alignment Alignment (Education) Classification Content Validity Decision Making Educational evaluation Educational Legislation Educational Policy Educational tests & measurements Elementary Secondary Education Federal Legislation Inferences State Standards Student Certification Test Construction Test Content Test Use Validity |
title | Alignment and Implications for Test Takers |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T22%3A39%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Alignment%20and%20Implications%20for%20Test%20Takers&rft.jtitle=Educational%20measurement,%20issues%20and%20practice&rft.au=Welch,%20Catherine%20J.&rft.date=2020-06-01&rft.volume=39&rft.issue=2&rft.spage=8&rft.epage=17&rft.pages=8-17&rft.issn=0731-1745&rft.eissn=1745-3992&rft_id=info:doi/10.1111/emip.12332&rft_dat=%3Cproquest_cross%3E2410161435%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2410161435&rft_id=info:pmid/&rft_ericid=EJ1256031&rfr_iscdi=true |