You Can Play the Game Without Knowing the Rules - But You're Better Off Knowing Them: The Influence of Rule Knowledge on Figural Matrices Tests
Due to their high item difficulties and excellent psychometric properties, construction-based figural matrices tasks are of particular interest when it comes to high-stakes testing. An important prerequisite is that test preparation - which is likely to occur in this context - does not impair test f...
Gespeichert in:
| Veröffentlicht in: | European journal of psychological assessment : official organ of the European Association of Psychological Assessment 2022-01, Vol.38 (1), p.15-23 |
|---|---|
| Hauptverfasser: | , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 23 |
|---|---|
| container_issue | 1 |
| container_start_page | 15 |
| container_title | European journal of psychological assessment : official organ of the European Association of Psychological Assessment |
| container_volume | 38 |
| creator | Levacher, Julie Koch, Marco Hissbach, Johanna Spinath, Frank M. Becker, Nicolas |
| description | Due to their high item difficulties and excellent
psychometric properties, construction-based figural matrices tasks are of
particular interest when it comes to high-stakes testing. An important
prerequisite is that test preparation - which is likely to occur in this
context - does not impair test fairness or item properties. The goal of
this study was to provide initial evidence concerning the influence of test
preparation. We administered test items to a sample of
N = 882 participants divided into two groups, but
only one group was given information about the rules employed in the test items.
The probability of solving the items was significantly higher in the test
preparation group than in the control group
(M = 0.61,
SD = 0.19 vs.
M = 0.41,
SD = 0.25;
t(54) = 3.42, p = .001;
d = .92). Nevertheless, a multigroup
confirmatory factor analysis, as well as a differential item functioning
analysis, indicated no differences between the item properties in the two
groups. The results suggest that construction-based figural matrices are
suitable in the context of high-stakes testing when all participants are
provided with test preparation material so that test fairness is ensured. |
| doi_str_mv | 10.1027/1015-5759/a000637 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2500020108</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2500020108</sourcerecordid><originalsourceid>FETCH-LOGICAL-a260t-d7abae7ba9fb38fceae5667da17fa17397e41c6bea038e1aeda85ae0afe4f2f53</originalsourceid><addsrcrecordid>eNo9kEFLAzEQhYMoWKs_wFvAgyCsnWSbzfZoi1axUJGKeAqz24ltaXfXJIv035va0sMwMPPePOZj7FrAvQCpewKESpRWgx4CQJbqE9aRQolE9mV2yjrH_Tm78H4FIPI8gw6bfdUtH2HF39a45WFBfIwb4p_LsKjbwF-r-ndZff8v3ts1eZ7wYZxH160jPqQQyPGptUflbEGbS3Zmce3p6tC77OPpcTZ6TibT8cvoYZKgzCAkc40Fki5wYIs0tyUhqSzTcxTaxkoHmvqizApCSHMSSHPMFRKgpb6VVqVddrO_27j6pyUfzKpuXRUjjVQRgwQBeVSJvap0tfeOrGnccoNuawSYHTyzg2N2cMwBXvTc7T3YoGn8tkQXlmX8v2ydoyoGxXmaG2GESv8AKCpw1g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2500020108</pqid></control><display><type>article</type><title>You Can Play the Game Without Knowing the Rules - But You're Better Off Knowing Them: The Influence of Rule Knowledge on Figural Matrices Tests</title><source>PsyJOURNALS</source><source>EBSCOhost APA PsycARTICLES</source><creator>Levacher, Julie ; Koch, Marco ; Hissbach, Johanna ; Spinath, Frank M. ; Becker, Nicolas</creator><creatorcontrib>Levacher, Julie ; Koch, Marco ; Hissbach, Johanna ; Spinath, Frank M. ; Becker, Nicolas</creatorcontrib><description>Due to their high item difficulties and excellent
psychometric properties, construction-based figural matrices tasks are of
particular interest when it comes to high-stakes testing. An important
prerequisite is that test preparation - which is likely to occur in this
context - does not impair test fairness or item properties. The goal of
this study was to provide initial evidence concerning the influence of test
preparation. We administered test items to a sample of
N = 882 participants divided into two groups, but
only one group was given information about the rules employed in the test items.
The probability of solving the items was significantly higher in the test
preparation group than in the control group
(M = 0.61,
SD = 0.19 vs.
M = 0.41,
SD = 0.25;
t(54) = 3.42, p = .001;
d = .92). Nevertheless, a multigroup
confirmatory factor analysis, as well as a differential item functioning
analysis, indicated no differences between the item properties in the two
groups. The results suggest that construction-based figural matrices are
suitable in the context of high-stakes testing when all participants are
provided with test preparation material so that test fairness is ensured.</description><identifier>ISSN: 1015-5759</identifier><identifier>EISSN: 2151-2426</identifier><identifier>DOI: 10.1027/1015-5759/a000637</identifier><language>eng</language><publisher>Hogrefe Publishing</publisher><subject>Cognitive Ability ; Difficulty Level (Test) ; Fairness ; Female ; Games ; Human ; Intelligence Measures ; Male ; Probability ; Test Items ; Test Reliability ; Test Validity</subject><ispartof>European journal of psychological assessment : official organ of the European Association of Psychological Assessment, 2022-01, Vol.38 (1), p.15-23</ispartof><rights>2021 Hogrefe Publishing</rights><rights>2021, Hogrefe Publishing</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-a260t-d7abae7ba9fb38fceae5667da17fa17397e41c6bea038e1aeda85ae0afe4f2f53</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids></links><search><creatorcontrib>Levacher, Julie</creatorcontrib><creatorcontrib>Koch, Marco</creatorcontrib><creatorcontrib>Hissbach, Johanna</creatorcontrib><creatorcontrib>Spinath, Frank M.</creatorcontrib><creatorcontrib>Becker, Nicolas</creatorcontrib><title>You Can Play the Game Without Knowing the Rules - But You're Better Off Knowing Them: The Influence of Rule Knowledge on Figural Matrices Tests</title><title>European journal of psychological assessment : official organ of the European Association of Psychological Assessment</title><description>Due to their high item difficulties and excellent
psychometric properties, construction-based figural matrices tasks are of
particular interest when it comes to high-stakes testing. An important
prerequisite is that test preparation - which is likely to occur in this
context - does not impair test fairness or item properties. The goal of
this study was to provide initial evidence concerning the influence of test
preparation. We administered test items to a sample of
N = 882 participants divided into two groups, but
only one group was given information about the rules employed in the test items.
The probability of solving the items was significantly higher in the test
preparation group than in the control group
(M = 0.61,
SD = 0.19 vs.
M = 0.41,
SD = 0.25;
t(54) = 3.42, p = .001;
d = .92). Nevertheless, a multigroup
confirmatory factor analysis, as well as a differential item functioning
analysis, indicated no differences between the item properties in the two
groups. The results suggest that construction-based figural matrices are
suitable in the context of high-stakes testing when all participants are
provided with test preparation material so that test fairness is ensured.</description><subject>Cognitive Ability</subject><subject>Difficulty Level (Test)</subject><subject>Fairness</subject><subject>Female</subject><subject>Games</subject><subject>Human</subject><subject>Intelligence Measures</subject><subject>Male</subject><subject>Probability</subject><subject>Test Items</subject><subject>Test Reliability</subject><subject>Test Validity</subject><issn>1015-5759</issn><issn>2151-2426</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNo9kEFLAzEQhYMoWKs_wFvAgyCsnWSbzfZoi1axUJGKeAqz24ltaXfXJIv035va0sMwMPPePOZj7FrAvQCpewKESpRWgx4CQJbqE9aRQolE9mV2yjrH_Tm78H4FIPI8gw6bfdUtH2HF39a45WFBfIwb4p_LsKjbwF-r-ndZff8v3ts1eZ7wYZxH160jPqQQyPGptUflbEGbS3Zmce3p6tC77OPpcTZ6TibT8cvoYZKgzCAkc40Fki5wYIs0tyUhqSzTcxTaxkoHmvqizApCSHMSSHPMFRKgpb6VVqVddrO_27j6pyUfzKpuXRUjjVQRgwQBeVSJvap0tfeOrGnccoNuawSYHTyzg2N2cMwBXvTc7T3YoGn8tkQXlmX8v2ydoyoGxXmaG2GESv8AKCpw1g</recordid><startdate>20220101</startdate><enddate>20220101</enddate><creator>Levacher, Julie</creator><creator>Koch, Marco</creator><creator>Hissbach, Johanna</creator><creator>Spinath, Frank M.</creator><creator>Becker, Nicolas</creator><general>Hogrefe Publishing</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope></search><sort><creationdate>20220101</creationdate><title>You Can Play the Game Without Knowing the Rules - But You're Better Off Knowing Them</title><author>Levacher, Julie ; Koch, Marco ; Hissbach, Johanna ; Spinath, Frank M. ; Becker, Nicolas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a260t-d7abae7ba9fb38fceae5667da17fa17397e41c6bea038e1aeda85ae0afe4f2f53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Cognitive Ability</topic><topic>Difficulty Level (Test)</topic><topic>Fairness</topic><topic>Female</topic><topic>Games</topic><topic>Human</topic><topic>Intelligence Measures</topic><topic>Male</topic><topic>Probability</topic><topic>Test Items</topic><topic>Test Reliability</topic><topic>Test Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Levacher, Julie</creatorcontrib><creatorcontrib>Koch, Marco</creatorcontrib><creatorcontrib>Hissbach, Johanna</creatorcontrib><creatorcontrib>Spinath, Frank M.</creatorcontrib><creatorcontrib>Becker, Nicolas</creatorcontrib><collection>CrossRef</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><jtitle>European journal of psychological assessment : official organ of the European Association of Psychological Assessment</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Levacher, Julie</au><au>Koch, Marco</au><au>Hissbach, Johanna</au><au>Spinath, Frank M.</au><au>Becker, Nicolas</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>You Can Play the Game Without Knowing the Rules - But You're Better Off Knowing Them: The Influence of Rule Knowledge on Figural Matrices Tests</atitle><jtitle>European journal of psychological assessment : official organ of the European Association of Psychological Assessment</jtitle><date>2022-01-01</date><risdate>2022</risdate><volume>38</volume><issue>1</issue><spage>15</spage><epage>23</epage><pages>15-23</pages><issn>1015-5759</issn><eissn>2151-2426</eissn><abstract>Due to their high item difficulties and excellent
psychometric properties, construction-based figural matrices tasks are of
particular interest when it comes to high-stakes testing. An important
prerequisite is that test preparation - which is likely to occur in this
context - does not impair test fairness or item properties. The goal of
this study was to provide initial evidence concerning the influence of test
preparation. We administered test items to a sample of
N = 882 participants divided into two groups, but
only one group was given information about the rules employed in the test items.
The probability of solving the items was significantly higher in the test
preparation group than in the control group
(M = 0.61,
SD = 0.19 vs.
M = 0.41,
SD = 0.25;
t(54) = 3.42, p = .001;
d = .92). Nevertheless, a multigroup
confirmatory factor analysis, as well as a differential item functioning
analysis, indicated no differences between the item properties in the two
groups. The results suggest that construction-based figural matrices are
suitable in the context of high-stakes testing when all participants are
provided with test preparation material so that test fairness is ensured.</abstract><pub>Hogrefe Publishing</pub><doi>10.1027/1015-5759/a000637</doi><tpages>9</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1015-5759 |
| ispartof | European journal of psychological assessment : official organ of the European Association of Psychological Assessment, 2022-01, Vol.38 (1), p.15-23 |
| issn | 1015-5759 2151-2426 |
| language | eng |
| recordid | cdi_proquest_journals_2500020108 |
| source | PsyJOURNALS; EBSCOhost APA PsycARTICLES |
| subjects | Cognitive Ability Difficulty Level (Test) Fairness Female Games Human Intelligence Measures Male Probability Test Items Test Reliability Test Validity |
| title | You Can Play the Game Without Knowing the Rules - But You're Better Off Knowing Them: The Influence of Rule Knowledge on Figural Matrices Tests |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-30T23%3A46%3A37IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=You%20Can%20Play%20the%20Game%20Without%20Knowing%20the%20Rules%20-%20But%20You're%20Better%20Off%20Knowing%20Them:%20The%20Influence%20of%20Rule%20Knowledge%20on%20Figural%20Matrices%20Tests&rft.jtitle=European%20journal%20of%20psychological%20assessment%20:%20official%20organ%20of%20the%20European%20Association%20of%20Psychological%20Assessment&rft.au=Levacher,%20Julie&rft.date=2022-01-01&rft.volume=38&rft.issue=1&rft.spage=15&rft.epage=23&rft.pages=15-23&rft.issn=1015-5759&rft.eissn=2151-2426&rft_id=info:doi/10.1027/1015-5759/a000637&rft_dat=%3Cproquest_cross%3E2500020108%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2500020108&rft_id=info:pmid/&rfr_iscdi=true |