Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings

Range restriction in most data sets is indirect, but the meta-analysis methods used to date have applied the correction for direct range restriction to data in which range restriction is indirect. The authors show that this results in substantial undercorrections for the effects of range restriction...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of applied psychology 2006-05, Vol.91 (3), p.594-612
Hauptverfasser: Hunter, John E, Schmidt, Frank L, Le, Huy
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 612
container_issue 3
container_start_page 594
container_title Journal of applied psychology
container_volume 91
creator Hunter, John E
Schmidt, Frank L
Le, Huy
description Range restriction in most data sets is indirect, but the meta-analysis methods used to date have applied the correction for direct range restriction to data in which range restriction is indirect. The authors show that this results in substantial undercorrections for the effects of range restriction, and they present meta-analysis methods for making accurate corrections when range restriction is indirect. Applying these methods to a well-known large-sample empirical database, the authors estimate that previous meta-analyses have underestimated the correlation between general mental ability and job performance by about 25%, indicating that this is potentially an important methodological issue in meta-analysis in general.
doi_str_mv 10.1037/0021-9010.91.3.594
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_68028069</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>68028069</sourcerecordid><originalsourceid>FETCH-LOGICAL-a512t-9516437936dad6da8ae65301b3e57488975c5a72c6da21d6793420049eebb0823</originalsourceid><addsrcrecordid>eNqF0V1rFDEUBuBQlHat_QO9kEHUG5k13x-XpVpdaCkUvSuEs5lMTZnNjMnMxf57M-5itYi9COGQ5-SEvAidErwkmKkPGFNSG1xKQ5ZsKQw_QAtimKmJFvwZWvwGR-hFzvcYE84MPkRHRCqmmFALdLvaDF1wMIY-5qpvq48heTdWEJtqFZtdcQPxzlc3Po8puFlWbZ-qKz9CfRah2-aQ5-p73-RfjRehdMa7_BI9b6HL_mS_H6NvF5--nn-pL68_r87PLmsQhI61EURypgyTDTRlafBSMEzWzAvFtTZKOAGKunJGSSOL5BRjbrxfr7Gm7Bi92907pP7HVJ5pNyE733UQfT9lKzWmGkvzJBSKUsrp05ApJSTnusDXj-B9P6XyKWUq4Zwbodj_ECWsBIaJLIjukEt9zsm3dkhhA2lrCbZz3naO085xWkMssyXv0vRqf_O03vjmoWUfcAFv9wCyg65NEF3ID05pbiSdp7_fORjADnnrII3BdT67KSUfRwtD9-fYN__Wf7OfjfjLgA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>614449573</pqid></control><display><type>article</type><title>Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings</title><source>MEDLINE</source><source>EBSCOhost APA PsycARTICLES</source><source>EBSCOhost Business Source Complete</source><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><creator>Hunter, John E ; Schmidt, Frank L ; Le, Huy</creator><contributor>Zedeck, Sheldon</contributor><creatorcontrib>Hunter, John E ; Schmidt, Frank L ; Le, Huy ; Zedeck, Sheldon</creatorcontrib><description>Range restriction in most data sets is indirect, but the meta-analysis methods used to date have applied the correction for direct range restriction to data in which range restriction is indirect. The authors show that this results in substantial undercorrections for the effects of range restriction, and they present meta-analysis methods for making accurate corrections when range restriction is indirect. Applying these methods to a well-known large-sample empirical database, the authors estimate that previous meta-analyses have underestimated the correlation between general mental ability and job performance by about 25%, indicating that this is potentially an important methodological issue in meta-analysis in general.</description><identifier>ISSN: 0021-9010</identifier><identifier>EISSN: 1939-1854</identifier><identifier>DOI: 10.1037/0021-9010.91.3.594</identifier><identifier>PMID: 16737357</identifier><identifier>CODEN: JAPGBP</identifier><language>eng</language><publisher>Washington, DC: American Psychological Association</publisher><subject>Applied psychology ; Bias ; Biological and medical sciences ; Cognition ; Cognitive Ability ; Correlation analysis ; Data analysis ; Direct approach ; Employee Performance Appraisal ; Experimental Methods ; Forecasts ; Fundamental and applied biological sciences. Psychology ; Humans ; Indirect modes ; Intellectual ability ; Job Performance ; Meta Analysis ; Models, Psychological ; Personnel selection ; Psychology - methods ; Psychology - statistics &amp; numerical data ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychometrics. Statistics. Methodology ; Recruitment ; Restrictions ; Statistical Analysis ; Statistical Data ; Statistics. Mathematics ; Studies ; Systematic review</subject><ispartof>Journal of applied psychology, 2006-05, Vol.91 (3), p.594-612</ispartof><rights>2006 American Psychological Association</rights><rights>2006 INIST-CNRS</rights><rights>Copyright American Psychological Association May 2006</rights><rights>2006, American Psychological Association</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a512t-9516437936dad6da8ae65301b3e57488975c5a72c6da21d6793420049eebb0823</citedby><cites>FETCH-LOGICAL-a512t-9516437936dad6da8ae65301b3e57488975c5a72c6da21d6793420049eebb0823</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924,30998,30999</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=17849626$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/16737357$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Zedeck, Sheldon</contributor><creatorcontrib>Hunter, John E</creatorcontrib><creatorcontrib>Schmidt, Frank L</creatorcontrib><creatorcontrib>Le, Huy</creatorcontrib><title>Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings</title><title>Journal of applied psychology</title><addtitle>J Appl Psychol</addtitle><description>Range restriction in most data sets is indirect, but the meta-analysis methods used to date have applied the correction for direct range restriction to data in which range restriction is indirect. The authors show that this results in substantial undercorrections for the effects of range restriction, and they present meta-analysis methods for making accurate corrections when range restriction is indirect. Applying these methods to a well-known large-sample empirical database, the authors estimate that previous meta-analyses have underestimated the correlation between general mental ability and job performance by about 25%, indicating that this is potentially an important methodological issue in meta-analysis in general.</description><subject>Applied psychology</subject><subject>Bias</subject><subject>Biological and medical sciences</subject><subject>Cognition</subject><subject>Cognitive Ability</subject><subject>Correlation analysis</subject><subject>Data analysis</subject><subject>Direct approach</subject><subject>Employee Performance Appraisal</subject><subject>Experimental Methods</subject><subject>Forecasts</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Humans</subject><subject>Indirect modes</subject><subject>Intellectual ability</subject><subject>Job Performance</subject><subject>Meta Analysis</subject><subject>Models, Psychological</subject><subject>Personnel selection</subject><subject>Psychology - methods</subject><subject>Psychology - statistics &amp; numerical data</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychometrics. Statistics. Methodology</subject><subject>Recruitment</subject><subject>Restrictions</subject><subject>Statistical Analysis</subject><subject>Statistical Data</subject><subject>Statistics. Mathematics</subject><subject>Studies</subject><subject>Systematic review</subject><issn>0021-9010</issn><issn>1939-1854</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2006</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>7QJ</sourceid><recordid>eNqF0V1rFDEUBuBQlHat_QO9kEHUG5k13x-XpVpdaCkUvSuEs5lMTZnNjMnMxf57M-5itYi9COGQ5-SEvAidErwkmKkPGFNSG1xKQ5ZsKQw_QAtimKmJFvwZWvwGR-hFzvcYE84MPkRHRCqmmFALdLvaDF1wMIY-5qpvq48heTdWEJtqFZtdcQPxzlc3Po8puFlWbZ-qKz9CfRah2-aQ5-p73-RfjRehdMa7_BI9b6HL_mS_H6NvF5--nn-pL68_r87PLmsQhI61EURypgyTDTRlafBSMEzWzAvFtTZKOAGKunJGSSOL5BRjbrxfr7Gm7Bi92907pP7HVJ5pNyE733UQfT9lKzWmGkvzJBSKUsrp05ApJSTnusDXj-B9P6XyKWUq4Zwbodj_ECWsBIaJLIjukEt9zsm3dkhhA2lrCbZz3naO085xWkMssyXv0vRqf_O03vjmoWUfcAFv9wCyg65NEF3ID05pbiSdp7_fORjADnnrII3BdT67KSUfRwtD9-fYN__Wf7OfjfjLgA</recordid><startdate>20060501</startdate><enddate>20060501</enddate><creator>Hunter, John E</creator><creator>Schmidt, Frank L</creator><creator>Le, Huy</creator><general>American Psychological Association</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>8BJ</scope><scope>FQK</scope><scope>JBE</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7X8</scope></search><sort><creationdate>20060501</creationdate><title>Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings</title><author>Hunter, John E ; Schmidt, Frank L ; Le, Huy</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a512t-9516437936dad6da8ae65301b3e57488975c5a72c6da21d6793420049eebb0823</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2006</creationdate><topic>Applied psychology</topic><topic>Bias</topic><topic>Biological and medical sciences</topic><topic>Cognition</topic><topic>Cognitive Ability</topic><topic>Correlation analysis</topic><topic>Data analysis</topic><topic>Direct approach</topic><topic>Employee Performance Appraisal</topic><topic>Experimental Methods</topic><topic>Forecasts</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Humans</topic><topic>Indirect modes</topic><topic>Intellectual ability</topic><topic>Job Performance</topic><topic>Meta Analysis</topic><topic>Models, Psychological</topic><topic>Personnel selection</topic><topic>Psychology - methods</topic><topic>Psychology - statistics &amp; numerical data</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychometrics. Statistics. Methodology</topic><topic>Recruitment</topic><topic>Restrictions</topic><topic>Statistical Analysis</topic><topic>Statistical Data</topic><topic>Statistics. Mathematics</topic><topic>Studies</topic><topic>Systematic review</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hunter, John E</creatorcontrib><creatorcontrib>Schmidt, Frank L</creatorcontrib><creatorcontrib>Le, Huy</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hunter, John E</au><au>Schmidt, Frank L</au><au>Le, Huy</au><au>Zedeck, Sheldon</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings</atitle><jtitle>Journal of applied psychology</jtitle><addtitle>J Appl Psychol</addtitle><date>2006-05-01</date><risdate>2006</risdate><volume>91</volume><issue>3</issue><spage>594</spage><epage>612</epage><pages>594-612</pages><issn>0021-9010</issn><eissn>1939-1854</eissn><coden>JAPGBP</coden><abstract>Range restriction in most data sets is indirect, but the meta-analysis methods used to date have applied the correction for direct range restriction to data in which range restriction is indirect. The authors show that this results in substantial undercorrections for the effects of range restriction, and they present meta-analysis methods for making accurate corrections when range restriction is indirect. Applying these methods to a well-known large-sample empirical database, the authors estimate that previous meta-analyses have underestimated the correlation between general mental ability and job performance by about 25%, indicating that this is potentially an important methodological issue in meta-analysis in general.</abstract><cop>Washington, DC</cop><pub>American Psychological Association</pub><pmid>16737357</pmid><doi>10.1037/0021-9010.91.3.594</doi><tpages>19</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0021-9010
ispartof Journal of applied psychology, 2006-05, Vol.91 (3), p.594-612
issn 0021-9010
1939-1854
language eng
recordid cdi_proquest_miscellaneous_68028069
source MEDLINE; EBSCOhost APA PsycARTICLES; EBSCOhost Business Source Complete; Applied Social Sciences Index & Abstracts (ASSIA)
subjects Applied psychology
Bias
Biological and medical sciences
Cognition
Cognitive Ability
Correlation analysis
Data analysis
Direct approach
Employee Performance Appraisal
Experimental Methods
Forecasts
Fundamental and applied biological sciences. Psychology
Humans
Indirect modes
Intellectual ability
Job Performance
Meta Analysis
Models, Psychological
Personnel selection
Psychology - methods
Psychology - statistics & numerical data
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics. Statistics. Methodology
Recruitment
Restrictions
Statistical Analysis
Statistical Data
Statistics. Mathematics
Studies
Systematic review
title Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T22%3A49%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Implications%20of%20Direct%20and%20Indirect%20Range%20Restriction%20for%20Meta-Analysis%20Methods%20and%20Findings&rft.jtitle=Journal%20of%20applied%20psychology&rft.au=Hunter,%20John%20E&rft.date=2006-05-01&rft.volume=91&rft.issue=3&rft.spage=594&rft.epage=612&rft.pages=594-612&rft.issn=0021-9010&rft.eissn=1939-1854&rft.coden=JAPGBP&rft_id=info:doi/10.1037/0021-9010.91.3.594&rft_dat=%3Cproquest_cross%3E68028069%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=614449573&rft_id=info:pmid/16737357&rfr_iscdi=true