Grounding the argument-based framework for validating score interpretations and uses1
Kane’s argument-based framework is summarized and examined. He implicitly appeals to the backgrounded concepts of fairness and justice. From there it is a short distance to grounding the whole system in the mundane notion of truth. In fact, valid argument systems must depend on representations that...
Gespeichert in:
Veröffentlicht in: | Language testing 2012-01, Vol.29 (1), p.29-36 |
---|---|
1. Verfasser: | |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 36 |
---|---|
container_issue | 1 |
container_start_page | 29 |
container_title | Language testing |
container_volume | 29 |
creator | Oller, John W. |
description | Kane’s argument-based framework is summarized and examined. He implicitly appeals to the backgrounded concepts of fairness and justice. From there it is a short distance to grounding the whole system in the mundane notion of truth. In fact, valid argument systems must depend on representations that are ‘true’ by virtue of agreement with purported facts. As a friendly amendment, therefore, I argue that (provided the ceteris paribus, all else being equal, requirement is met) agreement with known facts in testing, experimental research, and scientific measurement counts for a great deal more than disagreement. It follows by Peircean ‘exact logic’ that higher test scores (if the tests have any validity at all) are invariably more informative (interpretable in general) and thus more useful than lower scores. Why? Because higher scores show more agreement between the test-makers and the higher scoring test-takers about whatever facts (or performances) may be at issue. Exceptions are cases where the ceteris paribus requirement is not met. Necessary (but testable) inferences follow for interpretations and uses of ‘cutscores.’ |
doi_str_mv | 10.1177/0265532211417212 |
format | Article |
fullrecord | <record><control><sourceid>proquest_sage_</sourceid><recordid>TN_cdi_proquest_journals_917946961</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1177_0265532211417212</sage_id><sourcerecordid>2571006341</sourcerecordid><originalsourceid>FETCH-LOGICAL-p652-cfb5c92a91b8154dd551d98eee0778ac6e31daa84bcf4e7e96ffeefccf5480e53</originalsourceid><addsrcrecordid>eNpdkM1LAzEUxIMoWKt3j8F7NC-bj81Ril9Q8FLPSzZ5qa3tpia7-u-7SwXB04OZHzO8IeQa-C2AMXdcaKUqIQAkGAHihMxAGsO4lfqUzCabTf45uShlyzm3UOkZeXvKaejCplvT_h2py-thj13PWlcw0JjdHr9T_qAxZfrldpvg-oktPmWkm67HfMjYj2LqCnVdoEPBApfkLLpdwavfOyerx4fV4pktX59eFvdLdtBKMB9b5a1wFtoalAxBKQi2RkRuTO28xgqCc7VsfZRo0OoYEaP3Ucmao6rm5OYYe8jpc8DSN9s05G5sbCyY8XGrYYTYESpujX8A8Gbarfm_W_UDy0Fhfw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>917946961</pqid></control><display><type>article</type><title>Grounding the argument-based framework for validating score interpretations and uses1</title><source>SAGE Complete A-Z List</source><creator>Oller, John W.</creator><creatorcontrib>Oller, John W.</creatorcontrib><description>Kane’s argument-based framework is summarized and examined. He implicitly appeals to the backgrounded concepts of fairness and justice. From there it is a short distance to grounding the whole system in the mundane notion of truth. In fact, valid argument systems must depend on representations that are ‘true’ by virtue of agreement with purported facts. As a friendly amendment, therefore, I argue that (provided the ceteris paribus, all else being equal, requirement is met) agreement with known facts in testing, experimental research, and scientific measurement counts for a great deal more than disagreement. It follows by Peircean ‘exact logic’ that higher test scores (if the tests have any validity at all) are invariably more informative (interpretable in general) and thus more useful than lower scores. Why? Because higher scores show more agreement between the test-makers and the higher scoring test-takers about whatever facts (or performances) may be at issue. Exceptions are cases where the ceteris paribus requirement is not met. Necessary (but testable) inferences follow for interpretations and uses of ‘cutscores.’</description><identifier>ISSN: 0265-5322</identifier><identifier>EISSN: 1477-0946</identifier><identifier>DOI: 10.1177/0265532211417212</identifier><language>eng</language><publisher>London, England: SAGE Publications</publisher><subject>Hypotheses ; Inferences ; Language ; Language Tests ; Linguistics ; Logic ; SAT assessment ; Test validity and reliability ; Theory ; Truth ; Validity</subject><ispartof>Language testing, 2012-01, Vol.29 (1), p.29-36</ispartof><rights>SAGE Publications 2011</rights><rights>SAGE Publications © Jan 2012</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.1177/0265532211417212$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.1177/0265532211417212$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>314,780,784,21819,27924,27925,43621,43622</link.rule.ids></links><search><creatorcontrib>Oller, John W.</creatorcontrib><title>Grounding the argument-based framework for validating score interpretations and uses1</title><title>Language testing</title><description>Kane’s argument-based framework is summarized and examined. He implicitly appeals to the backgrounded concepts of fairness and justice. From there it is a short distance to grounding the whole system in the mundane notion of truth. In fact, valid argument systems must depend on representations that are ‘true’ by virtue of agreement with purported facts. As a friendly amendment, therefore, I argue that (provided the ceteris paribus, all else being equal, requirement is met) agreement with known facts in testing, experimental research, and scientific measurement counts for a great deal more than disagreement. It follows by Peircean ‘exact logic’ that higher test scores (if the tests have any validity at all) are invariably more informative (interpretable in general) and thus more useful than lower scores. Why? Because higher scores show more agreement between the test-makers and the higher scoring test-takers about whatever facts (or performances) may be at issue. Exceptions are cases where the ceteris paribus requirement is not met. Necessary (but testable) inferences follow for interpretations and uses of ‘cutscores.’</description><subject>Hypotheses</subject><subject>Inferences</subject><subject>Language</subject><subject>Language Tests</subject><subject>Linguistics</subject><subject>Logic</subject><subject>SAT assessment</subject><subject>Test validity and reliability</subject><subject>Theory</subject><subject>Truth</subject><subject>Validity</subject><issn>0265-5322</issn><issn>1477-0946</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AIMQZ</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNpdkM1LAzEUxIMoWKt3j8F7NC-bj81Ril9Q8FLPSzZ5qa3tpia7-u-7SwXB04OZHzO8IeQa-C2AMXdcaKUqIQAkGAHihMxAGsO4lfqUzCabTf45uShlyzm3UOkZeXvKaejCplvT_h2py-thj13PWlcw0JjdHr9T_qAxZfrldpvg-oktPmWkm67HfMjYj2LqCnVdoEPBApfkLLpdwavfOyerx4fV4pktX59eFvdLdtBKMB9b5a1wFtoalAxBKQi2RkRuTO28xgqCc7VsfZRo0OoYEaP3Ucmao6rm5OYYe8jpc8DSN9s05G5sbCyY8XGrYYTYESpujX8A8Gbarfm_W_UDy0Fhfw</recordid><startdate>201201</startdate><enddate>201201</enddate><creator>Oller, John W.</creator><general>SAGE Publications</general><general>Sage Publications Ltd</general><scope>0-V</scope><scope>3V.</scope><scope>7T9</scope><scope>7XB</scope><scope>88B</scope><scope>88G</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AIMQZ</scope><scope>ALSLI</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>CPGLG</scope><scope>CRLPW</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>LIQON</scope><scope>M0P</scope><scope>M2M</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope></search><sort><creationdate>201201</creationdate><title>Grounding the argument-based framework for validating score interpretations and uses1</title><author>Oller, John W.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p652-cfb5c92a91b8154dd551d98eee0778ac6e31daa84bcf4e7e96ffeefccf5480e53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Hypotheses</topic><topic>Inferences</topic><topic>Language</topic><topic>Language Tests</topic><topic>Linguistics</topic><topic>Logic</topic><topic>SAT assessment</topic><topic>Test validity and reliability</topic><topic>Theory</topic><topic>Truth</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Oller, John W.</creatorcontrib><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest One Literature</collection><collection>Social Science Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>Linguistics Collection</collection><collection>Linguistics Database</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>ProQuest One Literature - U.S. Customers Only</collection><collection>Education Database</collection><collection>Psychology Database</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><jtitle>Language testing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Oller, John W.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Grounding the argument-based framework for validating score interpretations and uses1</atitle><jtitle>Language testing</jtitle><date>2012-01</date><risdate>2012</risdate><volume>29</volume><issue>1</issue><spage>29</spage><epage>36</epage><pages>29-36</pages><issn>0265-5322</issn><eissn>1477-0946</eissn><abstract>Kane’s argument-based framework is summarized and examined. He implicitly appeals to the backgrounded concepts of fairness and justice. From there it is a short distance to grounding the whole system in the mundane notion of truth. In fact, valid argument systems must depend on representations that are ‘true’ by virtue of agreement with purported facts. As a friendly amendment, therefore, I argue that (provided the ceteris paribus, all else being equal, requirement is met) agreement with known facts in testing, experimental research, and scientific measurement counts for a great deal more than disagreement. It follows by Peircean ‘exact logic’ that higher test scores (if the tests have any validity at all) are invariably more informative (interpretable in general) and thus more useful than lower scores. Why? Because higher scores show more agreement between the test-makers and the higher scoring test-takers about whatever facts (or performances) may be at issue. Exceptions are cases where the ceteris paribus requirement is not met. Necessary (but testable) inferences follow for interpretations and uses of ‘cutscores.’</abstract><cop>London, England</cop><pub>SAGE Publications</pub><doi>10.1177/0265532211417212</doi><tpages>8</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0265-5322 |
ispartof | Language testing, 2012-01, Vol.29 (1), p.29-36 |
issn | 0265-5322 1477-0946 |
language | eng |
recordid | cdi_proquest_journals_917946961 |
source | SAGE Complete A-Z List |
subjects | Hypotheses Inferences Language Language Tests Linguistics Logic SAT assessment Test validity and reliability Theory Truth Validity |
title | Grounding the argument-based framework for validating score interpretations and uses1 |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T14%3A23%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_sage_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Grounding%20the%20argument-based%20framework%20for%20validating%20score%20interpretations%20and%20uses1&rft.jtitle=Language%20testing&rft.au=Oller,%20John%20W.&rft.date=2012-01&rft.volume=29&rft.issue=1&rft.spage=29&rft.epage=36&rft.pages=29-36&rft.issn=0265-5322&rft.eissn=1477-0946&rft_id=info:doi/10.1177/0265532211417212&rft_dat=%3Cproquest_sage_%3E2571006341%3C/proquest_sage_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=917946961&rft_id=info:pmid/&rft_sage_id=10.1177_0265532211417212&rfr_iscdi=true |