Integrating Validation Arguments With the Assessment Triangle: A Framework for Operationalizing and Instantiating Validation

Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the As...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Applied measurement in education 2019-01, Vol.32 (1), p.60-76
Hauptverfasser: Ketterlin-Geller, Leanne R., Perry, Lindsey, Adams, Elizabeth
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 76
container_issue 1
container_start_page 60
container_title Applied measurement in education
container_volume 32
creator Ketterlin-Geller, Leanne R.
Perry, Lindsey
Adams, Elizabeth
description Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching framework for operationalizing and instantiating the argument-based approach to validation. Integrating these frameworks can streamline the validation process by providing a conceptual lens for identifying, collecting, and evaluating relevant sources of evidence throughout the testing process. To fully examine this proposed conceptualization, we apply the integrated framework to an example case of a universal screener for middle-school mathematics. We articulate an interpretation and use argument for the universal screener, and then present relevant sources of evidence to evaluate the plausibility of the inferences and warrants underlying test score use. Based on this applied example, the strengths and limitations of the integrated framework are considered, and recommendations are made for future instantiations.
doi_str_mv 10.1080/08957347.2018.1544136
format Article
fullrecord <record><control><sourceid>proquest_eric_</sourceid><recordid>TN_cdi_eric_primary_EJ1204704</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1204704</ericid><sourcerecordid>2175234530</sourcerecordid><originalsourceid>FETCH-LOGICAL-c360t-ee2663f7406e1fa0d563520b0f632433e47d901bff28d1338932d2b50dad41543</originalsourceid><addsrcrecordid>eNp9kMtKAzEUhoMoWC-PIARcTz25zcWVpVStCN1UXYa0SWrqNFOTFFF8eGdsdeHC1Qkn_-XwIXRGoE-ghAsoK1EwXvQpkLJPBOeE5XuoRwSjGS9JuY96nSbrRIfoKMYlAPCqEj30OfbJLIJKzi_wo6qdbp-Nx4Ow2KyMTxE_ufSM07PBgxhNjN0ST4NTflGbSzzA10GtzFsTXrBtAp6sTfhOaKM-ukzlNR77mJRP7m_LCTqwqo7mdDeP0cP1aDq8ze4nN-Ph4D6bsxxSZgzNc2YLDrkhVoEWORMUZmBzRjljhhe6AjKzlpaaMFZWjGo6E6CV5i0OdozOt7nr0LxuTExy2WxCe2KUlBSCMi4YtCqxVc1DE2MwVq6DW6nwLgnIDrT8AS070HIHuvWdbX0muPmvZ3RHKPACuvar7b_zLaGValnVWib1XjfBBuXnLkr2f8UXLq2PSw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2175234530</pqid></control><display><type>article</type><title>Integrating Validation Arguments With the Assessment Triangle: A Framework for Operationalizing and Instantiating Validation</title><source>EBSCOhost Education Source</source><creator>Ketterlin-Geller, Leanne R. ; Perry, Lindsey ; Adams, Elizabeth</creator><creatorcontrib>Ketterlin-Geller, Leanne R. ; Perry, Lindsey ; Adams, Elizabeth</creatorcontrib><description>Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching framework for operationalizing and instantiating the argument-based approach to validation. Integrating these frameworks can streamline the validation process by providing a conceptual lens for identifying, collecting, and evaluating relevant sources of evidence throughout the testing process. To fully examine this proposed conceptualization, we apply the integrated framework to an example case of a universal screener for middle-school mathematics. We articulate an interpretation and use argument for the universal screener, and then present relevant sources of evidence to evaluate the plausibility of the inferences and warrants underlying test score use. Based on this applied example, the strengths and limitations of the integrated framework are considered, and recommendations are made for future instantiations.</description><identifier>ISSN: 0895-7347</identifier><identifier>EISSN: 1532-4818</identifier><identifier>DOI: 10.1080/08957347.2018.1544136</identifier><language>eng</language><publisher>Philadelphia: Routledge</publisher><subject>Educational Assessment ; Educational tests &amp; measurements ; Generalization ; Inferences ; Mathematics education ; Mathematics Tests ; Middle School Mathematics ; Middle School Students ; Scoring ; Screening Tests ; Test Interpretation ; Test Use ; Validity</subject><ispartof>Applied measurement in education, 2019-01, Vol.32 (1), p.60-76</ispartof><rights>2018 Taylor &amp; Francis Group, LLC 2018</rights><rights>2018 Taylor &amp; Francis Group, LLC</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c360t-ee2663f7406e1fa0d563520b0f632433e47d901bff28d1338932d2b50dad41543</citedby><cites>FETCH-LOGICAL-c360t-ee2663f7406e1fa0d563520b0f632433e47d901bff28d1338932d2b50dad41543</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1204704$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Ketterlin-Geller, Leanne R.</creatorcontrib><creatorcontrib>Perry, Lindsey</creatorcontrib><creatorcontrib>Adams, Elizabeth</creatorcontrib><title>Integrating Validation Arguments With the Assessment Triangle: A Framework for Operationalizing and Instantiating Validation</title><title>Applied measurement in education</title><description>Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching framework for operationalizing and instantiating the argument-based approach to validation. Integrating these frameworks can streamline the validation process by providing a conceptual lens for identifying, collecting, and evaluating relevant sources of evidence throughout the testing process. To fully examine this proposed conceptualization, we apply the integrated framework to an example case of a universal screener for middle-school mathematics. We articulate an interpretation and use argument for the universal screener, and then present relevant sources of evidence to evaluate the plausibility of the inferences and warrants underlying test score use. Based on this applied example, the strengths and limitations of the integrated framework are considered, and recommendations are made for future instantiations.</description><subject>Educational Assessment</subject><subject>Educational tests &amp; measurements</subject><subject>Generalization</subject><subject>Inferences</subject><subject>Mathematics education</subject><subject>Mathematics Tests</subject><subject>Middle School Mathematics</subject><subject>Middle School Students</subject><subject>Scoring</subject><subject>Screening Tests</subject><subject>Test Interpretation</subject><subject>Test Use</subject><subject>Validity</subject><issn>0895-7347</issn><issn>1532-4818</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNp9kMtKAzEUhoMoWC-PIARcTz25zcWVpVStCN1UXYa0SWrqNFOTFFF8eGdsdeHC1Qkn_-XwIXRGoE-ghAsoK1EwXvQpkLJPBOeE5XuoRwSjGS9JuY96nSbrRIfoKMYlAPCqEj30OfbJLIJKzi_wo6qdbp-Nx4Ow2KyMTxE_ufSM07PBgxhNjN0ST4NTflGbSzzA10GtzFsTXrBtAp6sTfhOaKM-ukzlNR77mJRP7m_LCTqwqo7mdDeP0cP1aDq8ze4nN-Ph4D6bsxxSZgzNc2YLDrkhVoEWORMUZmBzRjljhhe6AjKzlpaaMFZWjGo6E6CV5i0OdozOt7nr0LxuTExy2WxCe2KUlBSCMi4YtCqxVc1DE2MwVq6DW6nwLgnIDrT8AS070HIHuvWdbX0muPmvZ3RHKPACuvar7b_zLaGValnVWib1XjfBBuXnLkr2f8UXLq2PSw</recordid><startdate>20190102</startdate><enddate>20190102</enddate><creator>Ketterlin-Geller, Leanne R.</creator><creator>Perry, Lindsey</creator><creator>Adams, Elizabeth</creator><general>Routledge</general><general>Taylor &amp; Francis Ltd</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20190102</creationdate><title>Integrating Validation Arguments With the Assessment Triangle: A Framework for Operationalizing and Instantiating Validation</title><author>Ketterlin-Geller, Leanne R. ; Perry, Lindsey ; Adams, Elizabeth</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c360t-ee2663f7406e1fa0d563520b0f632433e47d901bff28d1338932d2b50dad41543</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Educational Assessment</topic><topic>Educational tests &amp; measurements</topic><topic>Generalization</topic><topic>Inferences</topic><topic>Mathematics education</topic><topic>Mathematics Tests</topic><topic>Middle School Mathematics</topic><topic>Middle School Students</topic><topic>Scoring</topic><topic>Screening Tests</topic><topic>Test Interpretation</topic><topic>Test Use</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ketterlin-Geller, Leanne R.</creatorcontrib><creatorcontrib>Perry, Lindsey</creatorcontrib><creatorcontrib>Adams, Elizabeth</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>Applied measurement in education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ketterlin-Geller, Leanne R.</au><au>Perry, Lindsey</au><au>Adams, Elizabeth</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1204704</ericid><atitle>Integrating Validation Arguments With the Assessment Triangle: A Framework for Operationalizing and Instantiating Validation</atitle><jtitle>Applied measurement in education</jtitle><date>2019-01-02</date><risdate>2019</risdate><volume>32</volume><issue>1</issue><spage>60</spage><epage>76</epage><pages>60-76</pages><issn>0895-7347</issn><eissn>1532-4818</eissn><abstract>Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching framework for operationalizing and instantiating the argument-based approach to validation. Integrating these frameworks can streamline the validation process by providing a conceptual lens for identifying, collecting, and evaluating relevant sources of evidence throughout the testing process. To fully examine this proposed conceptualization, we apply the integrated framework to an example case of a universal screener for middle-school mathematics. We articulate an interpretation and use argument for the universal screener, and then present relevant sources of evidence to evaluate the plausibility of the inferences and warrants underlying test score use. Based on this applied example, the strengths and limitations of the integrated framework are considered, and recommendations are made for future instantiations.</abstract><cop>Philadelphia</cop><pub>Routledge</pub><doi>10.1080/08957347.2018.1544136</doi><tpages>17</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0895-7347
ispartof Applied measurement in education, 2019-01, Vol.32 (1), p.60-76
issn 0895-7347
1532-4818
language eng
recordid cdi_eric_primary_EJ1204704
source EBSCOhost Education Source
subjects Educational Assessment
Educational tests & measurements
Generalization
Inferences
Mathematics education
Mathematics Tests
Middle School Mathematics
Middle School Students
Scoring
Screening Tests
Test Interpretation
Test Use
Validity
title Integrating Validation Arguments With the Assessment Triangle: A Framework for Operationalizing and Instantiating Validation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T07%3A19%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_eric_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Integrating%20Validation%20Arguments%20With%20the%20Assessment%20Triangle:%20A%20Framework%20for%20Operationalizing%20and%20Instantiating%20Validation&rft.jtitle=Applied%20measurement%20in%20education&rft.au=Ketterlin-Geller,%20Leanne%20R.&rft.date=2019-01-02&rft.volume=32&rft.issue=1&rft.spage=60&rft.epage=76&rft.pages=60-76&rft.issn=0895-7347&rft.eissn=1532-4818&rft_id=info:doi/10.1080/08957347.2018.1544136&rft_dat=%3Cproquest_eric_%3E2175234530%3C/proquest_eric_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2175234530&rft_id=info:pmid/&rft_ericid=EJ1204704&rfr_iscdi=true