Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)

Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012) meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of applied psychology 2012-05, Vol.97 (3), p.531-536
Hauptverfasser: Harris, William G, Jones, John W, Klion, Reid, Arnold, David W, Camara, Wayne, Cunningham, Michael R
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 536
container_issue 3
container_start_page 531
container_title Journal of applied psychology
container_volume 97
creator Harris, William G
Jones, John W
Klion, Reid
Arnold, David W
Camara, Wayne
Cunningham, Michael R
description Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012) meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.
doi_str_mv 10.1037/a0024767
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1027676733</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1023091851</sourcerecordid><originalsourceid>FETCH-LOGICAL-a470t-96d4c9ed2dcbf4a970749513aeb216ee64fa0eb91e37a72913994c0f7e6bbc1e3</originalsourceid><addsrcrecordid>eNqN0VtLwzAUAOAgiptT8BdIUUFBqrm12fFtiDdQ3IM-hzQ9xUrX1qQV9u_NnBcUQV8SOHycKyHbjB4zKtSJoZRLlaoVMmQgIGbjRK6SYYiyGCijA7Lh_ROlTAqg62TAeTLmiqshOb1H30XTPqtK_4jOH0TT8LZou_IFo6aOdid19NDmpsM8usXOxJPaVHNf-t1NslaYyuPW-z8iDxfn92dX8c3d5fXZ5CY2UtEuhjSXFjDnuc0KaUBRJSFhwmDGWYqYysJQzIChUEZxYAJAWlooTLPMhuiIHC7ztq557kO7elZ6i1Vlamx6rxnlYfRUCfEfKiiE7bB_0NAIZyyBQPd-0Kemd2ENb0oGMgb2hxKhagrpV1nrGu8dFrp15cy4eUB6cUv9cctAd94T9tkM80_4cbwAjpbAtEa3fm6N60pbobe9c1h32rSVBqWFTsSiv_3f9Xf2CgkNsDA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1013918696</pqid></control><display><type>article</type><title>Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)</title><source>MEDLINE</source><source>EBSCOhost APA PsycARTICLES</source><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><creator>Harris, William G ; Jones, John W ; Klion, Reid ; Arnold, David W ; Camara, Wayne ; Cunningham, Michael R</creator><contributor>Kozlowski, Steve W. J</contributor><creatorcontrib>Harris, William G ; Jones, John W ; Klion, Reid ; Arnold, David W ; Camara, Wayne ; Cunningham, Michael R ; Kozlowski, Steve W. J</creatorcontrib><description>Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012) meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.</description><identifier>ISSN: 0021-9010</identifier><identifier>EISSN: 1939-1854</identifier><identifier>DOI: 10.1037/a0024767</identifier><identifier>PMID: 22582727</identifier><identifier>CODEN: JAPGBP</identifier><language>eng</language><publisher>United States: American Psychological Association</publisher><subject>Counterproductive Work Behavior ; Employees ; Ethics ; Evaluation ; Faking ; Honesty ; Human ; Humans ; Iddekinge, Chad H. Van ; Integrity ; Job Applicant Screening ; Job Performance ; Laboratories ; Meta-analysis ; Methodology ; Odle-Dusseau, Heather N ; Organizational behavior ; Personality Assessment - standards ; Personnel Selection ; Personnel Selection - methods ; Preemployment screening ; Productivity ; Psychology, Industrial - instrumentation ; Psychometrics ; Psychometrics - standards ; Quantitative psychology ; Raymark, Patrick H ; Roth, Philip L ; Statistics ; Studies ; Systematic review ; Test Validity ; Turnover ; Validity ; Work behaviour ; Workplaces</subject><ispartof>Journal of applied psychology, 2012-05, Vol.97 (3), p.531-536</ispartof><rights>2012 American Psychological Association</rights><rights>(PsycINFO Database Record (c) 2012 APA, all rights reserved).</rights><rights>2012, American Psychological Association</rights><rights>Copyright American Psychological Association May 2012</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a470t-96d4c9ed2dcbf4a970749513aeb216ee64fa0eb91e37a72913994c0f7e6bbc1e3</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925,30999,31000</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/22582727$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Kozlowski, Steve W. J</contributor><creatorcontrib>Harris, William G</creatorcontrib><creatorcontrib>Jones, John W</creatorcontrib><creatorcontrib>Klion, Reid</creatorcontrib><creatorcontrib>Arnold, David W</creatorcontrib><creatorcontrib>Camara, Wayne</creatorcontrib><creatorcontrib>Cunningham, Michael R</creatorcontrib><title>Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)</title><title>Journal of applied psychology</title><addtitle>J Appl Psychol</addtitle><description>Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012) meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.</description><subject>Counterproductive Work Behavior</subject><subject>Employees</subject><subject>Ethics</subject><subject>Evaluation</subject><subject>Faking</subject><subject>Honesty</subject><subject>Human</subject><subject>Humans</subject><subject>Iddekinge, Chad H. Van</subject><subject>Integrity</subject><subject>Job Applicant Screening</subject><subject>Job Performance</subject><subject>Laboratories</subject><subject>Meta-analysis</subject><subject>Methodology</subject><subject>Odle-Dusseau, Heather N</subject><subject>Organizational behavior</subject><subject>Personality Assessment - standards</subject><subject>Personnel Selection</subject><subject>Personnel Selection - methods</subject><subject>Preemployment screening</subject><subject>Productivity</subject><subject>Psychology, Industrial - instrumentation</subject><subject>Psychometrics</subject><subject>Psychometrics - standards</subject><subject>Quantitative psychology</subject><subject>Raymark, Patrick H</subject><subject>Roth, Philip L</subject><subject>Statistics</subject><subject>Studies</subject><subject>Systematic review</subject><subject>Test Validity</subject><subject>Turnover</subject><subject>Validity</subject><subject>Work behaviour</subject><subject>Workplaces</subject><issn>0021-9010</issn><issn>1939-1854</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>7QJ</sourceid><recordid>eNqN0VtLwzAUAOAgiptT8BdIUUFBqrm12fFtiDdQ3IM-hzQ9xUrX1qQV9u_NnBcUQV8SOHycKyHbjB4zKtSJoZRLlaoVMmQgIGbjRK6SYYiyGCijA7Lh_ROlTAqg62TAeTLmiqshOb1H30XTPqtK_4jOH0TT8LZou_IFo6aOdid19NDmpsM8usXOxJPaVHNf-t1NslaYyuPW-z8iDxfn92dX8c3d5fXZ5CY2UtEuhjSXFjDnuc0KaUBRJSFhwmDGWYqYysJQzIChUEZxYAJAWlooTLPMhuiIHC7ztq557kO7elZ6i1Vlamx6rxnlYfRUCfEfKiiE7bB_0NAIZyyBQPd-0Kemd2ENb0oGMgb2hxKhagrpV1nrGu8dFrp15cy4eUB6cUv9cctAd94T9tkM80_4cbwAjpbAtEa3fm6N60pbobe9c1h32rSVBqWFTsSiv_3f9Xf2CgkNsDA</recordid><startdate>20120501</startdate><enddate>20120501</enddate><creator>Harris, William G</creator><creator>Jones, John W</creator><creator>Klion, Reid</creator><creator>Arnold, David W</creator><creator>Camara, Wayne</creator><creator>Cunningham, Michael R</creator><general>American Psychological Association</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7QJ</scope><scope>8BJ</scope><scope>FQK</scope><scope>JBE</scope><scope>7X8</scope></search><sort><creationdate>20120501</creationdate><title>Test Publishers' Perspective on "An Updated Meta-Analysis"</title><author>Harris, William G ; Jones, John W ; Klion, Reid ; Arnold, David W ; Camara, Wayne ; Cunningham, Michael R</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a470t-96d4c9ed2dcbf4a970749513aeb216ee64fa0eb91e37a72913994c0f7e6bbc1e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Counterproductive Work Behavior</topic><topic>Employees</topic><topic>Ethics</topic><topic>Evaluation</topic><topic>Faking</topic><topic>Honesty</topic><topic>Human</topic><topic>Humans</topic><topic>Iddekinge, Chad H. Van</topic><topic>Integrity</topic><topic>Job Applicant Screening</topic><topic>Job Performance</topic><topic>Laboratories</topic><topic>Meta-analysis</topic><topic>Methodology</topic><topic>Odle-Dusseau, Heather N</topic><topic>Organizational behavior</topic><topic>Personality Assessment - standards</topic><topic>Personnel Selection</topic><topic>Personnel Selection - methods</topic><topic>Preemployment screening</topic><topic>Productivity</topic><topic>Psychology, Industrial - instrumentation</topic><topic>Psychometrics</topic><topic>Psychometrics - standards</topic><topic>Quantitative psychology</topic><topic>Raymark, Patrick H</topic><topic>Roth, Philip L</topic><topic>Statistics</topic><topic>Studies</topic><topic>Systematic review</topic><topic>Test Validity</topic><topic>Turnover</topic><topic>Validity</topic><topic>Work behaviour</topic><topic>Workplaces</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Harris, William G</creatorcontrib><creatorcontrib>Jones, John W</creatorcontrib><creatorcontrib>Klion, Reid</creatorcontrib><creatorcontrib>Arnold, David W</creatorcontrib><creatorcontrib>Camara, Wayne</creatorcontrib><creatorcontrib>Cunningham, Michael R</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Harris, William G</au><au>Jones, John W</au><au>Klion, Reid</au><au>Arnold, David W</au><au>Camara, Wayne</au><au>Cunningham, Michael R</au><au>Kozlowski, Steve W. J</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)</atitle><jtitle>Journal of applied psychology</jtitle><addtitle>J Appl Psychol</addtitle><date>2012-05-01</date><risdate>2012</risdate><volume>97</volume><issue>3</issue><spage>531</spage><epage>536</epage><pages>531-536</pages><issn>0021-9010</issn><eissn>1939-1854</eissn><coden>JAPGBP</coden><abstract>Van Iddekinge, Roth, Raymark, and Odle-Dusseau's (2012) meta-analysis of pre-employment integrity test results confirmed that such tests are meaningfully related to counterproductive work behavior. The article also offered some cautionary conclusions, which appear to stem from the limited scope of the authors' focus and the specific research procedures used. Issues discussed in this commentary include the following: (a) test publishers' provision of studies for meta-analytic consideration; (b) errors and questions in the coding of statistics from past studies; (c) debatable corrections for unreliable criterion measures; (d) exclusion of laboratory, contrasted-groups, unit-level, and time-series studies of counterproductive behavior; (e) under-emphasis on the prediction of counterproductive workplace behaviors compared with job performance, training outcomes, and turnover; (f) overlooking the industry practice of deploying integrity scales with other valid predictors of employee outcomes; (g) implication that integrity test publishers produce biased research results; (h) incomplete presentation of integrity tests' resistance to faking; and (i) omission of data indicating applicants' favorable response to integrity tests, the tests' lack of adverse impact, and the positive business impact of integrity testing. This commentary, therefore, offers an alternate perspective, addresses omissions and apparent inaccuracies, and urges a return to the use of diverse methodologies to evaluate the validity of integrity tests and other psychometric instruments.</abstract><cop>United States</cop><pub>American Psychological Association</pub><pmid>22582727</pmid><doi>10.1037/a0024767</doi><tpages>6</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0021-9010
ispartof Journal of applied psychology, 2012-05, Vol.97 (3), p.531-536
issn 0021-9010
1939-1854
language eng
recordid cdi_proquest_miscellaneous_1027676733
source MEDLINE; EBSCOhost APA PsycARTICLES; Applied Social Sciences Index & Abstracts (ASSIA)
subjects Counterproductive Work Behavior
Employees
Ethics
Evaluation
Faking
Honesty
Human
Humans
Iddekinge, Chad H. Van
Integrity
Job Applicant Screening
Job Performance
Laboratories
Meta-analysis
Methodology
Odle-Dusseau, Heather N
Organizational behavior
Personality Assessment - standards
Personnel Selection
Personnel Selection - methods
Preemployment screening
Productivity
Psychology, Industrial - instrumentation
Psychometrics
Psychometrics - standards
Quantitative psychology
Raymark, Patrick H
Roth, Philip L
Statistics
Studies
Systematic review
Test Validity
Turnover
Validity
Work behaviour
Workplaces
title Test Publishers' Perspective on "An Updated Meta-Analysis": Comment on Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012)
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T03%3A44%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Test%20Publishers'%20Perspective%20on%20%22An%20Updated%20Meta-Analysis%22:%20Comment%20on%20Van%20Iddekinge,%20Roth,%20Raymark,%20and%20Odle-Dusseau%20(2012)&rft.jtitle=Journal%20of%20applied%20psychology&rft.au=Harris,%20William%20G&rft.date=2012-05-01&rft.volume=97&rft.issue=3&rft.spage=531&rft.epage=536&rft.pages=531-536&rft.issn=0021-9010&rft.eissn=1939-1854&rft.coden=JAPGBP&rft_id=info:doi/10.1037/a0024767&rft_dat=%3Cproquest_cross%3E1023091851%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1013918696&rft_id=info:pmid/22582727&rfr_iscdi=true