Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)
Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012) meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope...
Gespeichert in:
Veröffentlicht in: | Journal of applied psychology 2012-05, Vol.97 (3), p.531-536 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 536 |
---|---|
container_issue | 3 |
container_start_page | 531 |
container_title | Journal of applied psychology |
container_volume | 97 |
creator | Harris, William G Jones, John W Klion, Reid Arnold, David W Camara, Wayne Cunningham, Michael R |
description | Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012)
meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments. |
doi_str_mv | 10.1037/a0024767 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1027676733</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1023091851</sourcerecordid><originalsourceid>FETCH-LOGICAL-a470t-96d4c9ed2dcbf4a970749513aeb216ee64fa0eb91e37a72913994c0f7e6bbc1e3</originalsourceid><addsrcrecordid>eNqN0VtLwzAUAOAgiptT8BdIUUFBqrm12fFtiDdQ3IM-hzQ9xUrX1qQV9u_NnBcUQV8SOHycKyHbjB4zKtSJoZRLlaoVMmQgIGbjRK6SYYiyGCijA7Lh_ROlTAqg62TAeTLmiqshOb1H30XTPqtK_4jOH0TT8LZou_IFo6aOdid19NDmpsM8usXOxJPaVHNf-t1NslaYyuPW-z8iDxfn92dX8c3d5fXZ5CY2UtEuhjSXFjDnuc0KaUBRJSFhwmDGWYqYysJQzIChUEZxYAJAWlooTLPMhuiIHC7ztq557kO7elZ6i1Vlamx6rxnlYfRUCfEfKiiE7bB_0NAIZyyBQPd-0Kemd2ENb0oGMgb2hxKhagrpV1nrGu8dFrp15cy4eUB6cUv9cctAd94T9tkM80_4cbwAjpbAtEa3fm6N60pbobe9c1h32rSVBqWFTsSiv_3f9Xf2CgkNsDA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1013918696</pqid></control><display><type>article</type><title>Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)</title><source>MEDLINE</source><source>EBSCOhost APA PsycARTICLES</source><source>Applied Social Sciences Index & Abstracts (ASSIA)</source><creator>Harris, William G ; Jones, John W ; Klion, Reid ; Arnold, David W ; Camara, Wayne ; Cunningham, Michael R</creator><contributor>Kozlowski, Steve W. J</contributor><creatorcontrib>Harris, William G ; Jones, John W ; Klion, Reid ; Arnold, David W ; Camara, Wayne ; Cunningham, Michael R ; Kozlowski, Steve W. J</creatorcontrib><description>Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012)
meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.</description><identifier>ISSN: 0021-9010</identifier><identifier>EISSN: 1939-1854</identifier><identifier>DOI: 10.1037/a0024767</identifier><identifier>PMID: 22582727</identifier><identifier>CODEN: JAPGBP</identifier><language>eng</language><publisher>United States: American Psychological Association</publisher><subject>Counterproductive Work Behavior ; Employees ; Ethics ; Evaluation ; Faking ; Honesty ; Human ; Humans ; Iddekinge, Chad H. Van ; Integrity ; Job Applicant Screening ; Job Performance ; Laboratories ; Meta-analysis ; Methodology ; Odle-Dusseau, Heather N ; Organizational behavior ; Personality Assessment - standards ; Personnel Selection ; Personnel Selection - methods ; Preemployment screening ; Productivity ; Psychology, Industrial - instrumentation ; Psychometrics ; Psychometrics - standards ; Quantitative psychology ; Raymark, Patrick H ; Roth, Philip L ; Statistics ; Studies ; Systematic review ; Test Validity ; Turnover ; Validity ; Work behaviour ; Workplaces</subject><ispartof>Journal of applied psychology, 2012-05, Vol.97 (3), p.531-536</ispartof><rights>2012 American Psychological Association</rights><rights>(PsycINFO Database Record (c) 2012 APA, all rights reserved).</rights><rights>2012, American Psychological Association</rights><rights>Copyright American Psychological Association May 2012</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a470t-96d4c9ed2dcbf4a970749513aeb216ee64fa0eb91e37a72913994c0f7e6bbc1e3</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925,30999,31000</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/22582727$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Kozlowski, Steve W. J</contributor><creatorcontrib>Harris, William G</creatorcontrib><creatorcontrib>Jones, John W</creatorcontrib><creatorcontrib>Klion, Reid</creatorcontrib><creatorcontrib>Arnold, David W</creatorcontrib><creatorcontrib>Camara, Wayne</creatorcontrib><creatorcontrib>Cunningham, Michael R</creatorcontrib><title>Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)</title><title>Journal of applied psychology</title><addtitle>J Appl Psychol</addtitle><description>Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012)
meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.</description><subject>Counterproductive Work Behavior</subject><subject>Employees</subject><subject>Ethics</subject><subject>Evaluation</subject><subject>Faking</subject><subject>Honesty</subject><subject>Human</subject><subject>Humans</subject><subject>Iddekinge, Chad H. Van</subject><subject>Integrity</subject><subject>Job Applicant Screening</subject><subject>Job Performance</subject><subject>Laboratories</subject><subject>Meta-analysis</subject><subject>Methodology</subject><subject>Odle-Dusseau, Heather N</subject><subject>Organizational behavior</subject><subject>Personality Assessment - standards</subject><subject>Personnel Selection</subject><subject>Personnel Selection - methods</subject><subject>Preemployment screening</subject><subject>Productivity</subject><subject>Psychology, Industrial - instrumentation</subject><subject>Psychometrics</subject><subject>Psychometrics - standards</subject><subject>Quantitative psychology</subject><subject>Raymark, Patrick H</subject><subject>Roth, Philip L</subject><subject>Statistics</subject><subject>Studies</subject><subject>Systematic review</subject><subject>Test Validity</subject><subject>Turnover</subject><subject>Validity</subject><subject>Work behaviour</subject><subject>Workplaces</subject><issn>0021-9010</issn><issn>1939-1854</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>7QJ</sourceid><recordid>eNqN0VtLwzAUAOAgiptT8BdIUUFBqrm12fFtiDdQ3IM-hzQ9xUrX1qQV9u_NnBcUQV8SOHycKyHbjB4zKtSJoZRLlaoVMmQgIGbjRK6SYYiyGCijA7Lh_ROlTAqg62TAeTLmiqshOb1H30XTPqtK_4jOH0TT8LZou_IFo6aOdid19NDmpsM8usXOxJPaVHNf-t1NslaYyuPW-z8iDxfn92dX8c3d5fXZ5CY2UtEuhjSXFjDnuc0KaUBRJSFhwmDGWYqYysJQzIChUEZxYAJAWlooTLPMhuiIHC7ztq557kO7elZ6i1Vlamx6rxnlYfRUCfEfKiiE7bB_0NAIZyyBQPd-0Kemd2ENb0oGMgb2hxKhagrpV1nrGu8dFrp15cy4eUB6cUv9cctAd94T9tkM80_4cbwAjpbAtEa3fm6N60pbobe9c1h32rSVBqWFTsSiv_3f9Xf2CgkNsDA</recordid><startdate>20120501</startdate><enddate>20120501</enddate><creator>Harris, William G</creator><creator>Jones, John W</creator><creator>Klion, Reid</creator><creator>Arnold, David W</creator><creator>Camara, Wayne</creator><creator>Cunningham, Michael R</creator><general>American Psychological Association</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7QJ</scope><scope>8BJ</scope><scope>FQK</scope><scope>JBE</scope><scope>7X8</scope></search><sort><creationdate>20120501</creationdate><title>Test Publishers' Perspective on "An Updated Meta-Analysis"</title><author>Harris, William G ; Jones, John W ; Klion, Reid ; Arnold, David W ; Camara, Wayne ; Cunningham, Michael R</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a470t-96d4c9ed2dcbf4a970749513aeb216ee64fa0eb91e37a72913994c0f7e6bbc1e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Counterproductive Work Behavior</topic><topic>Employees</topic><topic>Ethics</topic><topic>Evaluation</topic><topic>Faking</topic><topic>Honesty</topic><topic>Human</topic><topic>Humans</topic><topic>Iddekinge, Chad H. Van</topic><topic>Integrity</topic><topic>Job Applicant Screening</topic><topic>Job Performance</topic><topic>Laboratories</topic><topic>Meta-analysis</topic><topic>Methodology</topic><topic>Odle-Dusseau, Heather N</topic><topic>Organizational behavior</topic><topic>Personality Assessment - standards</topic><topic>Personnel Selection</topic><topic>Personnel Selection - methods</topic><topic>Preemployment screening</topic><topic>Productivity</topic><topic>Psychology, Industrial - instrumentation</topic><topic>Psychometrics</topic><topic>Psychometrics - standards</topic><topic>Quantitative psychology</topic><topic>Raymark, Patrick H</topic><topic>Roth, Philip L</topic><topic>Statistics</topic><topic>Studies</topic><topic>Systematic review</topic><topic>Test Validity</topic><topic>Turnover</topic><topic>Validity</topic><topic>Work behaviour</topic><topic>Workplaces</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Harris, William G</creatorcontrib><creatorcontrib>Jones, John W</creatorcontrib><creatorcontrib>Klion, Reid</creatorcontrib><creatorcontrib>Arnold, David W</creatorcontrib><creatorcontrib>Camara, Wayne</creatorcontrib><creatorcontrib>Cunningham, Michael R</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><collection>Applied Social Sciences Index & Abstracts (ASSIA)</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Harris, William G</au><au>Jones, John W</au><au>Klion, Reid</au><au>Arnold, David W</au><au>Camara, Wayne</au><au>Cunningham, Michael R</au><au>Kozlowski, Steve W. J</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)</atitle><jtitle>Journal of applied psychology</jtitle><addtitle>J Appl Psychol</addtitle><date>2012-05-01</date><risdate>2012</risdate><volume>97</volume><issue>3</issue><spage>531</spage><epage>536</epage><pages>531-536</pages><issn>0021-9010</issn><eissn>1939-1854</eissn><coden>JAPGBP</coden><abstract>Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012)
meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.</abstract><cop>United States</cop><pub>American Psychological Association</pub><pmid>22582727</pmid><doi>10.1037/a0024767</doi><tpages>6</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0021-9010 |
ispartof | Journal of applied psychology, 2012-05, Vol.97 (3), p.531-536 |
issn | 0021-9010 1939-1854 |
language | eng |
recordid | cdi_proquest_miscellaneous_1027676733 |
source | MEDLINE; EBSCOhost APA PsycARTICLES; Applied Social Sciences Index & Abstracts (ASSIA) |
subjects | Counterproductive Work Behavior Employees Ethics Evaluation Faking Honesty Human Humans Iddekinge, Chad H. Van Integrity Job Applicant Screening Job Performance Laboratories Meta-analysis Methodology Odle-Dusseau, Heather N Organizational behavior Personality Assessment - standards Personnel Selection Personnel Selection - methods Preemployment screening Productivity Psychology, Industrial - instrumentation Psychometrics Psychometrics - standards Quantitative psychology Raymark, Patrick H Roth, Philip L Statistics Studies Systematic review Test Validity Turnover Validity Work behaviour Workplaces |
title | Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012) |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T03%3A44%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Test%20Publishers'%20Perspective%20on%20%22An%20Updated%20Meta-Analysis%22:%20Comment%20on%20Van%20Iddekinge,%20Roth,%20Raymark,%20and%20Odle-Dusseau%20(2012)&rft.jtitle=Journal%20of%20applied%20psychology&rft.au=Harris,%20William%20G&rft.date=2012-05-01&rft.volume=97&rft.issue=3&rft.spage=531&rft.epage=536&rft.pages=531-536&rft.issn=0021-9010&rft.eissn=1939-1854&rft.coden=JAPGBP&rft_id=info:doi/10.1037/a0024767&rft_dat=%3Cproquest_cross%3E1023091851%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1013918696&rft_id=info:pmid/22582727&rfr_iscdi=true |