Random Guessing, Correction for Guessing, and Reliability of Multiple-Choice Test Scores
Guessing on a multiple-choice test item may be categorized as random (among all choices) or informed (some wrong choices eliminated). An expression is derived which permits determination of reliability change when random guessing is curtailed and informed guessing retained. Application of the derive...
Gespeichert in:
| Veröffentlicht in: | The Journal of experimental education 1977-10, Vol.46 (1), p.11-15 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 15 |
|---|---|
| container_issue | 1 |
| container_start_page | 11 |
| container_title | The Journal of experimental education |
| container_volume | 46 |
| creator | Frary, Robert B. Cross, Lawrence H. Lowry, Stephen R. |
| description | Guessing on a multiple-choice test item may be categorized as random (among all choices) or informed (some wrong choices eliminated). An expression is derived which permits determination of reliability change when random guessing is curtailed and informed guessing retained. Application of the derived expression to hypothetical and real data shows that small improvements in reliability will occur in this case except under highly implausible circumstances. Discussion follows on use of correction-for-guessing instructions to curtail random guessing. Possible reasons are given for frequently observed decreases in reliability when correction-for-guessing instructions are applied. |
| doi_str_mv | 10.1080/00220973.1977.11011603 |
| format | Article |
| fullrecord | <record><control><sourceid>jstor_cross</sourceid><recordid>TN_cdi_jstor_primary_20151180</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><jstor_id>20151180</jstor_id><sourcerecordid>20151180</sourcerecordid><originalsourceid>FETCH-LOGICAL-c363t-99d1d81163df9b9b443afa261580c64556c1911608b18d1aa29620b7b5f079803</originalsourceid><addsrcrecordid>eNqFkE9LAzEQxYMoWKsfQQl4devMZv8kRylahYpQK3gL2d2spmw3Ndki_fZmXSvenMsc5r15Mz9CLhAmCByuAeIYRM4mKPJ8ggiIGbADMkKRQAQZZ4dk1IuiXnVMTrxfQSjGYUReF6qt7JrOttp7075d0al1TpedsS2trfszCEK60I1RhWlMt6O2po_bpjObRkfTd2tKTZfad_S5tE77U3JUq8brs58-Ji93t8vpfTR_mj1Mb-ZRyTLWRUJUWPFwMatqUYgiSZiqVZxhyqHMkjTNShT9Q7xAXqFSschiKPIirSEXHNiYXA57N85-hFs7ubJb14ZIibEIlQNPgyobVKWz3jtdy40za-V2EkH2FOWeouwpyj3FYDwfjCvfWffrigFTxO_4m2Fu2kBrrT6tayrZqV1jXe1UWxov2T8ZX1f1gNg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1299997085</pqid></control><display><type>article</type><title>Random Guessing, Correction for Guessing, and Reliability of Multiple-Choice Test Scores</title><source>Jstor Complete Legacy</source><source>Alma/SFX Local Collection</source><source>Periodicals Index Online</source><creator>Frary, Robert B. ; Cross, Lawrence H. ; Lowry, Stephen R.</creator><creatorcontrib>Frary, Robert B. ; Cross, Lawrence H. ; Lowry, Stephen R.</creatorcontrib><description>Guessing on a multiple-choice test item may be categorized as random (among all choices) or informed (some wrong choices eliminated). An expression is derived which permits determination of reliability change when random guessing is curtailed and informed guessing retained. Application of the derived expression to hypothetical and real data shows that small improvements in reliability will occur in this case except under highly implausible circumstances. Discussion follows on use of correction-for-guessing instructions to curtail random guessing. Possible reasons are given for frequently observed decreases in reliability when correction-for-guessing instructions are applied.</description><identifier>ISSN: 0022-0973</identifier><identifier>EISSN: 1940-0683</identifier><identifier>DOI: 10.1080/00220973.1977.11011603</identifier><language>eng</language><publisher>Washington D.C., Wash: Routledge</publisher><subject>Absolute value ; Estimate reliability ; Misinformation ; Preliminary estimates ; Statistical discrepancies ; Test scores</subject><ispartof>The Journal of experimental education, 1977-10, Vol.46 (1), p.11-15</ispartof><rights>Copyright Taylor & Francis</rights><rights>Copyright 1977 Helen Dwight Reid Educational Foundation</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c363t-99d1d81163df9b9b443afa261580c64556c1911608b18d1aa29620b7b5f079803</citedby><cites>FETCH-LOGICAL-c363t-99d1d81163df9b9b443afa261580c64556c1911608b18d1aa29620b7b5f079803</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.jstor.org/stable/pdf/20151180$$EPDF$$P50$$Gjstor$$H</linktopdf><linktohtml>$$Uhttps://www.jstor.org/stable/20151180$$EHTML$$P50$$Gjstor$$H</linktohtml><link.rule.ids>314,776,780,799,27846,27901,27902,57992,58225</link.rule.ids></links><search><creatorcontrib>Frary, Robert B.</creatorcontrib><creatorcontrib>Cross, Lawrence H.</creatorcontrib><creatorcontrib>Lowry, Stephen R.</creatorcontrib><title>Random Guessing, Correction for Guessing, and Reliability of Multiple-Choice Test Scores</title><title>The Journal of experimental education</title><description>Guessing on a multiple-choice test item may be categorized as random (among all choices) or informed (some wrong choices eliminated). An expression is derived which permits determination of reliability change when random guessing is curtailed and informed guessing retained. Application of the derived expression to hypothetical and real data shows that small improvements in reliability will occur in this case except under highly implausible circumstances. Discussion follows on use of correction-for-guessing instructions to curtail random guessing. Possible reasons are given for frequently observed decreases in reliability when correction-for-guessing instructions are applied.</description><subject>Absolute value</subject><subject>Estimate reliability</subject><subject>Misinformation</subject><subject>Preliminary estimates</subject><subject>Statistical discrepancies</subject><subject>Test scores</subject><issn>0022-0973</issn><issn>1940-0683</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>1977</creationdate><recordtype>article</recordtype><sourceid>HYQOX</sourceid><sourceid>K30</sourceid><sourceid>~OU</sourceid><sourceid>~OW</sourceid><sourceid>~PQ</sourceid><recordid>eNqFkE9LAzEQxYMoWKsfQQl4devMZv8kRylahYpQK3gL2d2spmw3Ndki_fZmXSvenMsc5r15Mz9CLhAmCByuAeIYRM4mKPJ8ggiIGbADMkKRQAQZZ4dk1IuiXnVMTrxfQSjGYUReF6qt7JrOttp7075d0al1TpedsS2trfszCEK60I1RhWlMt6O2po_bpjObRkfTd2tKTZfad_S5tE77U3JUq8brs58-Ji93t8vpfTR_mj1Mb-ZRyTLWRUJUWPFwMatqUYgiSZiqVZxhyqHMkjTNShT9Q7xAXqFSschiKPIirSEXHNiYXA57N85-hFs7ubJb14ZIibEIlQNPgyobVKWz3jtdy40za-V2EkH2FOWeouwpyj3FYDwfjCvfWffrigFTxO_4m2Fu2kBrrT6tayrZqV1jXe1UWxov2T8ZX1f1gNg</recordid><startdate>19771001</startdate><enddate>19771001</enddate><creator>Frary, Robert B.</creator><creator>Cross, Lawrence H.</creator><creator>Lowry, Stephen R.</creator><general>Routledge</general><general>Heldref Publications</general><scope>AAYXX</scope><scope>CITATION</scope><scope>ABKTN</scope><scope>HFIND</scope><scope>HYQOX</scope><scope>HZAIM</scope><scope>JSICY</scope><scope>K30</scope><scope>PAAUG</scope><scope>PAWHS</scope><scope>PAWZZ</scope><scope>PAXOH</scope><scope>PBHAV</scope><scope>PBQSW</scope><scope>PBYQZ</scope><scope>PCIWU</scope><scope>PCMID</scope><scope>PCZJX</scope><scope>PDGRG</scope><scope>PDWWI</scope><scope>PETMR</scope><scope>PFVGT</scope><scope>PGXDX</scope><scope>PIHIL</scope><scope>PISVA</scope><scope>PJCTQ</scope><scope>PJTMS</scope><scope>PLCHJ</scope><scope>PMHAD</scope><scope>PNQDJ</scope><scope>POUND</scope><scope>PPLAD</scope><scope>PQAPC</scope><scope>PQCAN</scope><scope>PQCMW</scope><scope>PQEME</scope><scope>PQHKH</scope><scope>PQMID</scope><scope>PQNCT</scope><scope>PQNET</scope><scope>PQSCT</scope><scope>PQSET</scope><scope>PSVJG</scope><scope>PVMQY</scope><scope>PZGFC</scope><scope>~OT</scope><scope>~OU</scope><scope>~OV</scope><scope>~OW</scope><scope>~PM</scope><scope>~PQ</scope></search><sort><creationdate>19771001</creationdate><title>Random Guessing, Correction for Guessing, and Reliability of Multiple-Choice Test Scores</title><author>Frary, Robert B. ; Cross, Lawrence H. ; Lowry, Stephen R.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c363t-99d1d81163df9b9b443afa261580c64556c1911608b18d1aa29620b7b5f079803</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>1977</creationdate><topic>Absolute value</topic><topic>Estimate reliability</topic><topic>Misinformation</topic><topic>Preliminary estimates</topic><topic>Statistical discrepancies</topic><topic>Test scores</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Frary, Robert B.</creatorcontrib><creatorcontrib>Cross, Lawrence H.</creatorcontrib><creatorcontrib>Lowry, Stephen R.</creatorcontrib><collection>CrossRef</collection><collection>Periodicals Archive Online JSTOR Titles</collection><collection>Periodicals Index Online Segment 16</collection><collection>ProQuest Historical Periodicals</collection><collection>Periodicals Index Online Segment 26</collection><collection>Periodicals Index Online Segment 36</collection><collection>Periodicals Index Online</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - West</collection><collection>Primary Sources Access (Plan D) - International</collection><collection>Primary Sources Access & Build (Plan A) - MEA</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - Midwest</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - Northeast</collection><collection>Primary Sources Access (Plan D) - Southeast</collection><collection>Primary Sources Access (Plan D) - North Central</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - Southeast</collection><collection>Primary Sources Access (Plan D) - South Central</collection><collection>Primary Sources Access & Build (Plan A) - UK / I</collection><collection>Primary Sources Access (Plan D) - Canada</collection><collection>Primary Sources Access (Plan D) - EMEALA</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - North Central</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - South Central</collection><collection>Primary Sources Access & Build (Plan A) - International</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - International</collection><collection>Primary Sources Access (Plan D) - West</collection><collection>Periodicals Index Online Segments 1-50</collection><collection>Primary Sources Access (Plan D) - APAC</collection><collection>Primary Sources Access (Plan D) - Midwest</collection><collection>Primary Sources Access (Plan D) - MEA</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - Canada</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - UK / I</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - EMEALA</collection><collection>Primary Sources Access & Build (Plan A) - APAC</collection><collection>Primary Sources Access & Build (Plan A) - Canada</collection><collection>Primary Sources Access & Build (Plan A) - West</collection><collection>Primary Sources Access & Build (Plan A) - EMEALA</collection><collection>Primary Sources Access (Plan D) - Northeast</collection><collection>Primary Sources Access & Build (Plan A) - Midwest</collection><collection>Primary Sources Access & Build (Plan A) - North Central</collection><collection>Primary Sources Access & Build (Plan A) - Northeast</collection><collection>Primary Sources Access & Build (Plan A) - South Central</collection><collection>Primary Sources Access & Build (Plan A) - Southeast</collection><collection>Primary Sources Access (Plan D) - UK / I</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - APAC</collection><collection>Primary Sources Access—Foundation Edition (Plan E) - MEA</collection><collection>PAO Collection 2 (purchase pre Oct/2008)</collection><collection>Periodicals Archive Online Collection 2</collection><collection>PAO Collection 2</collection><collection>Periodicals Archive Online Collection 2.2</collection><collection>Periodicals Archive Online JISC Collection</collection><collection>Periodicals Archive Online Liberal Arts Collection 4</collection><jtitle>The Journal of experimental education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Frary, Robert B.</au><au>Cross, Lawrence H.</au><au>Lowry, Stephen R.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Random Guessing, Correction for Guessing, and Reliability of Multiple-Choice Test Scores</atitle><jtitle>The Journal of experimental education</jtitle><date>1977-10-01</date><risdate>1977</risdate><volume>46</volume><issue>1</issue><spage>11</spage><epage>15</epage><pages>11-15</pages><issn>0022-0973</issn><eissn>1940-0683</eissn><abstract>Guessing on a multiple-choice test item may be categorized as random (among all choices) or informed (some wrong choices eliminated). An expression is derived which permits determination of reliability change when random guessing is curtailed and informed guessing retained. Application of the derived expression to hypothetical and real data shows that small improvements in reliability will occur in this case except under highly implausible circumstances. Discussion follows on use of correction-for-guessing instructions to curtail random guessing. Possible reasons are given for frequently observed decreases in reliability when correction-for-guessing instructions are applied.</abstract><cop>Washington D.C., Wash</cop><pub>Routledge</pub><doi>10.1080/00220973.1977.11011603</doi><tpages>5</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0022-0973 |
| ispartof | The Journal of experimental education, 1977-10, Vol.46 (1), p.11-15 |
| issn | 0022-0973 1940-0683 |
| language | eng |
| recordid | cdi_jstor_primary_20151180 |
| source | Jstor Complete Legacy; Alma/SFX Local Collection; Periodicals Index Online |
| subjects | Absolute value Estimate reliability Misinformation Preliminary estimates Statistical discrepancies Test scores |
| title | Random Guessing, Correction for Guessing, and Reliability of Multiple-Choice Test Scores |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T02%3A50%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-jstor_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Random%20Guessing,%20Correction%20for%20Guessing,%20and%20Reliability%20of%20Multiple-Choice%20Test%20Scores&rft.jtitle=The%20Journal%20of%20experimental%20education&rft.au=Frary,%20Robert%20B.&rft.date=1977-10-01&rft.volume=46&rft.issue=1&rft.spage=11&rft.epage=15&rft.pages=11-15&rft.issn=0022-0973&rft.eissn=1940-0683&rft_id=info:doi/10.1080/00220973.1977.11011603&rft_dat=%3Cjstor_cross%3E20151180%3C/jstor_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1299997085&rft_id=info:pmid/&rft_jstor_id=20151180&rfr_iscdi=true |