Instructional Sensitivity as a Psychometric Property of Assessments
Standards‐based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments—their instructional sensitivity—is rarely, if ever, investigated by test developers,...
Gespeichert in:
| Veröffentlicht in: | Educational measurement, issues and practice issues and practice, 2010-12, Vol.29 (4), p.3-14 |
|---|---|
| 1. Verfasser: | |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 14 |
|---|---|
| container_issue | 4 |
| container_start_page | 3 |
| container_title | Educational measurement, issues and practice |
| container_volume | 29 |
| creator | Polikoff, Morgan S. |
| description | Standards‐based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments—their instructional sensitivity—is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the literature on the psychometric property of instructional sensitivity is reviewed. Three categories of instructional sensitivity measures are identified—those relying on item or test scores only, those relying on item or test scores and teacher reports of instruction, and strictly judgmental methods. Each method identified in the literature is discussed alongside the evidence for its utility. Finally, recommendations are made as to the proper role of instructional sensitivity in the evaluation of assessments used under standards‐based reform. |
| doi_str_mv | 10.1111/j.1745-3992.2010.00189.x |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_818666555</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ974594</ericid><sourcerecordid>2217303371</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3149-b34087bc72680befb03e44cd5a591dbb6e961824496f9ab06e6c6e076119b5ca3</originalsourceid><addsrcrecordid>eNqNkM1OwzAQhC0EEqXwBhwi7il2_JP4wAFVJRS1UIkCR8txHZHQJsWbQvP2OAT1jC9r7cy32h2EAoJHxL_rckRixkMqZTSKsO9iTBI52h-hwUE4RgMcUxJ2jVN0BlB6ExcyHqDxtILG7UxT1JVeB8-2gqIpvoqmDTQEOlhAa97rjW1cYYKFq7fWeanOg1sAC7CxVQPn6CTXa7AXf3WIXu4my_F9OHtKp-PbWWgoYTLMKMNJnJk4EgnObJ5hahkzK665JKssE1YKkkSMSZFLnWFhhREWx4IQmXGj6RBd9XO3rv7cWWhUWe-cXxtUQhIhBOfcm5LeZFwN4Gyutq7YaNcqglWXmCpVl4PqglFdYuo3MbX36GWPWn_sAZs8SG-XzMs3vfxdrG3777FqMp8u_M_zYc8X0Nj9gdfuQ4mYxly9PaZKLpPXVEapmtMf1iKKRw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>818666555</pqid></control><display><type>article</type><title>Instructional Sensitivity as a Psychometric Property of Assessments</title><source>Access via Wiley Online Library</source><source>Education Source</source><creator>Polikoff, Morgan S.</creator><creatorcontrib>Polikoff, Morgan S.</creatorcontrib><description>Standards‐based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments—their instructional sensitivity—is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the literature on the psychometric property of instructional sensitivity is reviewed. Three categories of instructional sensitivity measures are identified—those relying on item or test scores only, those relying on item or test scores and teacher reports of instruction, and strictly judgmental methods. Each method identified in the literature is discussed alongside the evidence for its utility. Finally, recommendations are made as to the proper role of instructional sensitivity in the evaluation of assessments used under standards‐based reform.</description><identifier>ISSN: 0731-1745</identifier><identifier>EISSN: 1745-3992</identifier><identifier>DOI: 10.1111/j.1745-3992.2010.00189.x</identifier><language>eng</language><publisher>Malden, USA: Blackwell Publishing Inc</publisher><subject>Accountability ; Alignment (Education) ; assessment ; Criterion Referenced Tests ; Education reform ; Educational Assessment ; Educational Change ; Educational evaluation ; Educational Quality ; Expertise ; Federal Legislation ; instruction ; Instructional design ; Item Analysis ; NCLB ; No Child Left Behind Act 2001 ; No Child Left Behind Act 2001-US ; Norm Referenced Tests ; Pretests Posttests ; Psychometrics ; Quantitative psychology ; Scores ; Sensitivity ; Teaching Methods ; Test Items ; Validity</subject><ispartof>Educational measurement, issues and practice, 2010-12, Vol.29 (4), p.3-14</ispartof><rights>2010 by the National Council on Measurement in Education</rights><rights>Copyright National Council on Measurement in Education Winter 2010</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3149-b34087bc72680befb03e44cd5a591dbb6e961824496f9ab06e6c6e076119b5ca3</citedby><cites>FETCH-LOGICAL-c3149-b34087bc72680befb03e44cd5a591dbb6e961824496f9ab06e6c6e076119b5ca3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Fj.1745-3992.2010.00189.x$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Fj.1745-3992.2010.00189.x$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>315,781,785,1418,27929,27930,45579,45580</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ974594$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Polikoff, Morgan S.</creatorcontrib><title>Instructional Sensitivity as a Psychometric Property of Assessments</title><title>Educational measurement, issues and practice</title><description>Standards‐based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments—their instructional sensitivity—is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the literature on the psychometric property of instructional sensitivity is reviewed. Three categories of instructional sensitivity measures are identified—those relying on item or test scores only, those relying on item or test scores and teacher reports of instruction, and strictly judgmental methods. Each method identified in the literature is discussed alongside the evidence for its utility. Finally, recommendations are made as to the proper role of instructional sensitivity in the evaluation of assessments used under standards‐based reform.</description><subject>Accountability</subject><subject>Alignment (Education)</subject><subject>assessment</subject><subject>Criterion Referenced Tests</subject><subject>Education reform</subject><subject>Educational Assessment</subject><subject>Educational Change</subject><subject>Educational evaluation</subject><subject>Educational Quality</subject><subject>Expertise</subject><subject>Federal Legislation</subject><subject>instruction</subject><subject>Instructional design</subject><subject>Item Analysis</subject><subject>NCLB</subject><subject>No Child Left Behind Act 2001</subject><subject>No Child Left Behind Act 2001-US</subject><subject>Norm Referenced Tests</subject><subject>Pretests Posttests</subject><subject>Psychometrics</subject><subject>Quantitative psychology</subject><subject>Scores</subject><subject>Sensitivity</subject><subject>Teaching Methods</subject><subject>Test Items</subject><subject>Validity</subject><issn>0731-1745</issn><issn>1745-3992</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2010</creationdate><recordtype>article</recordtype><recordid>eNqNkM1OwzAQhC0EEqXwBhwi7il2_JP4wAFVJRS1UIkCR8txHZHQJsWbQvP2OAT1jC9r7cy32h2EAoJHxL_rckRixkMqZTSKsO9iTBI52h-hwUE4RgMcUxJ2jVN0BlB6ExcyHqDxtILG7UxT1JVeB8-2gqIpvoqmDTQEOlhAa97rjW1cYYKFq7fWeanOg1sAC7CxVQPn6CTXa7AXf3WIXu4my_F9OHtKp-PbWWgoYTLMKMNJnJk4EgnObJ5hahkzK665JKssE1YKkkSMSZFLnWFhhREWx4IQmXGj6RBd9XO3rv7cWWhUWe-cXxtUQhIhBOfcm5LeZFwN4Gyutq7YaNcqglWXmCpVl4PqglFdYuo3MbX36GWPWn_sAZs8SG-XzMs3vfxdrG3777FqMp8u_M_zYc8X0Nj9gdfuQ4mYxly9PaZKLpPXVEapmtMf1iKKRw</recordid><startdate>201012</startdate><enddate>201012</enddate><creator>Polikoff, Morgan S.</creator><general>Blackwell Publishing Inc</general><general>Wiley-Blackwell</general><general>Wiley Subscription Services, Inc</general><scope>BSCLL</scope><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>201012</creationdate><title>Instructional Sensitivity as a Psychometric Property of Assessments</title><author>Polikoff, Morgan S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3149-b34087bc72680befb03e44cd5a591dbb6e961824496f9ab06e6c6e076119b5ca3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2010</creationdate><topic>Accountability</topic><topic>Alignment (Education)</topic><topic>assessment</topic><topic>Criterion Referenced Tests</topic><topic>Education reform</topic><topic>Educational Assessment</topic><topic>Educational Change</topic><topic>Educational evaluation</topic><topic>Educational Quality</topic><topic>Expertise</topic><topic>Federal Legislation</topic><topic>instruction</topic><topic>Instructional design</topic><topic>Item Analysis</topic><topic>NCLB</topic><topic>No Child Left Behind Act 2001</topic><topic>No Child Left Behind Act 2001-US</topic><topic>Norm Referenced Tests</topic><topic>Pretests Posttests</topic><topic>Psychometrics</topic><topic>Quantitative psychology</topic><topic>Scores</topic><topic>Sensitivity</topic><topic>Teaching Methods</topic><topic>Test Items</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Polikoff, Morgan S.</creatorcontrib><collection>Istex</collection><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>Educational measurement, issues and practice</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Polikoff, Morgan S.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ974594</ericid><atitle>Instructional Sensitivity as a Psychometric Property of Assessments</atitle><jtitle>Educational measurement, issues and practice</jtitle><date>2010-12</date><risdate>2010</risdate><volume>29</volume><issue>4</issue><spage>3</spage><epage>14</epage><pages>3-14</pages><issn>0731-1745</issn><eissn>1745-3992</eissn><abstract>Standards‐based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments—their instructional sensitivity—is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the literature on the psychometric property of instructional sensitivity is reviewed. Three categories of instructional sensitivity measures are identified—those relying on item or test scores only, those relying on item or test scores and teacher reports of instruction, and strictly judgmental methods. Each method identified in the literature is discussed alongside the evidence for its utility. Finally, recommendations are made as to the proper role of instructional sensitivity in the evaluation of assessments used under standards‐based reform.</abstract><cop>Malden, USA</cop><pub>Blackwell Publishing Inc</pub><doi>10.1111/j.1745-3992.2010.00189.x</doi><tpages>12</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0731-1745 |
| ispartof | Educational measurement, issues and practice, 2010-12, Vol.29 (4), p.3-14 |
| issn | 0731-1745 1745-3992 |
| language | eng |
| recordid | cdi_proquest_journals_818666555 |
| source | Access via Wiley Online Library; Education Source |
| subjects | Accountability Alignment (Education) assessment Criterion Referenced Tests Education reform Educational Assessment Educational Change Educational evaluation Educational Quality Expertise Federal Legislation instruction Instructional design Item Analysis NCLB No Child Left Behind Act 2001 No Child Left Behind Act 2001-US Norm Referenced Tests Pretests Posttests Psychometrics Quantitative psychology Scores Sensitivity Teaching Methods Test Items Validity |
| title | Instructional Sensitivity as a Psychometric Property of Assessments |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-12T05%3A18%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Instructional%20Sensitivity%20as%20a%20Psychometric%20Property%20of%20Assessments&rft.jtitle=Educational%20measurement,%20issues%20and%20practice&rft.au=Polikoff,%20Morgan%20S.&rft.date=2010-12&rft.volume=29&rft.issue=4&rft.spage=3&rft.epage=14&rft.pages=3-14&rft.issn=0731-1745&rft.eissn=1745-3992&rft_id=info:doi/10.1111/j.1745-3992.2010.00189.x&rft_dat=%3Cproquest_cross%3E2217303371%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=818666555&rft_id=info:pmid/&rft_ericid=EJ974594&rfr_iscdi=true |