A peculiar prevalence of p values just below .05

In null hypothesis significance testing (NHST), p values are judged relative to an arbitrary threshold for significance (.05). The present work examined whether that standard influences the distribution of p values reported in the psychology literature. We examined a large subset of papers from thre...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Quarterly journal of experimental psychology (2006) 2012-11, Vol.65 (11), p.2271-2279
Hauptverfasser: Masicampo, E. J., Lalande, Daniel R.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2279
container_issue 11
container_start_page 2271
container_title Quarterly journal of experimental psychology (2006)
container_volume 65
creator Masicampo, E. J.
Lalande, Daniel R.
description In null hypothesis significance testing (NHST), p values are judged relative to an arbitrary threshold for significance (.05). The present work examined whether that standard influences the distribution of p values reported in the psychology literature. We examined a large subset of papers from three highly regarded journals. Distributions of p were found to be similar across the different journals. Moreover, p values were much more common immediately below .05 than would be expected based on the number of p values occurring in other ranges. This prevalence of p values just below the arbitrary criterion for significance was observed in all three journals. We discuss potential sources of this pattern, including publication bias and researcher degrees of freedom.
doi_str_mv 10.1080/17470218.2012.711335
format Article
fullrecord <record><control><sourceid>proquest_pasca</sourceid><recordid>TN_cdi_proquest_miscellaneous_1113981448</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1080_17470218.2012.711335</sage_id><sourcerecordid>1113981448</sourcerecordid><originalsourceid>FETCH-LOGICAL-c501t-cdd6ab8f276c3bb2bbb9e27f95680a619f2713c4ec4650644ded53d7c84bf65f3</originalsourceid><addsrcrecordid>eNqFkMtKAzEUhoMotlbfQGQ2gpvW3CddSSneoOBG1yHJJDIlnYxJx9K3N2XautNVbt85_8kHwDWCEwQFvEclLSFGYoIhwpMSIULYCRjurscQY3563CMxABcpLSGkpOTlORhgLBjhDA4BnBWtNZ2vVSzaaL-Vt42xRXBFW-RDZ1Ox7NK60NaHTTGB7BKcOeWTvdqvI_Dx9Pg-fxkv3p5f57PF2DCI1mNTVVxp4XDJDdEaa62nFpduyriAiqNpfkHEUGtonoNTWtmKkao0gmrHmSMjcNf3bWP4ymOs5apOxnqvGhu6JFH-8FQgSkVGaY-aGFKK1sk21isVtxJBuXMlD67kzpXsXeWym31Cp1e2OhYd5GTgdg-oZJR3UTWmTr8cZ5xjwTOHei6pTyuXoYtNNvNf-ENfUzcuxJXahOgruVZbH-IhiPzZ4QcI5JDi</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1113981448</pqid></control><display><type>article</type><title>A peculiar prevalence of p values just below .05</title><source>MEDLINE</source><source>SAGE Complete A-Z List</source><creator>Masicampo, E. J. ; Lalande, Daniel R.</creator><creatorcontrib>Masicampo, E. J. ; Lalande, Daniel R.</creatorcontrib><description>In null hypothesis significance testing (NHST), p values are judged relative to an arbitrary threshold for significance (.05). The present work examined whether that standard influences the distribution of p values reported in the psychology literature. We examined a large subset of papers from three highly regarded journals. Distributions of p were found to be similar across the different journals. Moreover, p values were much more common immediately below .05 than would be expected based on the number of p values occurring in other ranges. This prevalence of p values just below the arbitrary criterion for significance was observed in all three journals. We discuss potential sources of this pattern, including publication bias and researcher degrees of freedom.</description><identifier>ISSN: 1747-0218</identifier><identifier>EISSN: 1747-0226</identifier><identifier>DOI: 10.1080/17470218.2012.711335</identifier><identifier>PMID: 22853650</identifier><language>eng</language><publisher>London, England: Psychology Press</publisher><subject>Biological and medical sciences ; Databases, Bibliographic - statistics &amp; numerical data ; Fundamental and applied biological sciences. Psychology ; Humans ; Hypothesis testing ; Prevalence ; Probability ; Psychology ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychometrics. Statistics. Methodology ; Publication Bias ; Statistical inference ; Statistics ; Statistics as Topic ; Statistics. Mathematics</subject><ispartof>Quarterly journal of experimental psychology (2006), 2012-11, Vol.65 (11), p.2271-2279</ispartof><rights>Copyright The Experimental Psychology Society 2012</rights><rights>2012 Experimental Pscyhology Society</rights><rights>2015 INIST-CNRS</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c501t-cdd6ab8f276c3bb2bbb9e27f95680a619f2713c4ec4650644ded53d7c84bf65f3</citedby><cites>FETCH-LOGICAL-c501t-cdd6ab8f276c3bb2bbb9e27f95680a619f2713c4ec4650644ded53d7c84bf65f3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.1080/17470218.2012.711335$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.1080/17470218.2012.711335$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>314,780,784,21819,27924,27925,43621,43622</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=26566286$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/22853650$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Masicampo, E. J.</creatorcontrib><creatorcontrib>Lalande, Daniel R.</creatorcontrib><title>A peculiar prevalence of p values just below .05</title><title>Quarterly journal of experimental psychology (2006)</title><addtitle>Q J Exp Psychol (Hove)</addtitle><description>In null hypothesis significance testing (NHST), p values are judged relative to an arbitrary threshold for significance (.05). The present work examined whether that standard influences the distribution of p values reported in the psychology literature. We examined a large subset of papers from three highly regarded journals. Distributions of p were found to be similar across the different journals. Moreover, p values were much more common immediately below .05 than would be expected based on the number of p values occurring in other ranges. This prevalence of p values just below the arbitrary criterion for significance was observed in all three journals. We discuss potential sources of this pattern, including publication bias and researcher degrees of freedom.</description><subject>Biological and medical sciences</subject><subject>Databases, Bibliographic - statistics &amp; numerical data</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Humans</subject><subject>Hypothesis testing</subject><subject>Prevalence</subject><subject>Probability</subject><subject>Psychology</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychometrics. Statistics. Methodology</subject><subject>Publication Bias</subject><subject>Statistical inference</subject><subject>Statistics</subject><subject>Statistics as Topic</subject><subject>Statistics. Mathematics</subject><issn>1747-0218</issn><issn>1747-0226</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqFkMtKAzEUhoMotlbfQGQ2gpvW3CddSSneoOBG1yHJJDIlnYxJx9K3N2XautNVbt85_8kHwDWCEwQFvEclLSFGYoIhwpMSIULYCRjurscQY3563CMxABcpLSGkpOTlORhgLBjhDA4BnBWtNZ2vVSzaaL-Vt42xRXBFW-RDZ1Ox7NK60NaHTTGB7BKcOeWTvdqvI_Dx9Pg-fxkv3p5f57PF2DCI1mNTVVxp4XDJDdEaa62nFpduyriAiqNpfkHEUGtonoNTWtmKkao0gmrHmSMjcNf3bWP4ymOs5apOxnqvGhu6JFH-8FQgSkVGaY-aGFKK1sk21isVtxJBuXMlD67kzpXsXeWym31Cp1e2OhYd5GTgdg-oZJR3UTWmTr8cZ5xjwTOHei6pTyuXoYtNNvNf-ENfUzcuxJXahOgruVZbH-IhiPzZ4QcI5JDi</recordid><startdate>201211</startdate><enddate>201211</enddate><creator>Masicampo, E. J.</creator><creator>Lalande, Daniel R.</creator><general>Psychology Press</general><general>SAGE Publications</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>201211</creationdate><title>A peculiar prevalence of p values just below .05</title><author>Masicampo, E. J. ; Lalande, Daniel R.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c501t-cdd6ab8f276c3bb2bbb9e27f95680a619f2713c4ec4650644ded53d7c84bf65f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Biological and medical sciences</topic><topic>Databases, Bibliographic - statistics &amp; numerical data</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Humans</topic><topic>Hypothesis testing</topic><topic>Prevalence</topic><topic>Probability</topic><topic>Psychology</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychometrics. Statistics. Methodology</topic><topic>Publication Bias</topic><topic>Statistical inference</topic><topic>Statistics</topic><topic>Statistics as Topic</topic><topic>Statistics. Mathematics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Masicampo, E. J.</creatorcontrib><creatorcontrib>Lalande, Daniel R.</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Quarterly journal of experimental psychology (2006)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Masicampo, E. J.</au><au>Lalande, Daniel R.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A peculiar prevalence of p values just below .05</atitle><jtitle>Quarterly journal of experimental psychology (2006)</jtitle><addtitle>Q J Exp Psychol (Hove)</addtitle><date>2012-11</date><risdate>2012</risdate><volume>65</volume><issue>11</issue><spage>2271</spage><epage>2279</epage><pages>2271-2279</pages><issn>1747-0218</issn><eissn>1747-0226</eissn><abstract>In null hypothesis significance testing (NHST), p values are judged relative to an arbitrary threshold for significance (.05). The present work examined whether that standard influences the distribution of p values reported in the psychology literature. We examined a large subset of papers from three highly regarded journals. Distributions of p were found to be similar across the different journals. Moreover, p values were much more common immediately below .05 than would be expected based on the number of p values occurring in other ranges. This prevalence of p values just below the arbitrary criterion for significance was observed in all three journals. We discuss potential sources of this pattern, including publication bias and researcher degrees of freedom.</abstract><cop>London, England</cop><pub>Psychology Press</pub><pmid>22853650</pmid><doi>10.1080/17470218.2012.711335</doi><tpages>9</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1747-0218
ispartof Quarterly journal of experimental psychology (2006), 2012-11, Vol.65 (11), p.2271-2279
issn 1747-0218
1747-0226
language eng
recordid cdi_proquest_miscellaneous_1113981448
source MEDLINE; SAGE Complete A-Z List
subjects Biological and medical sciences
Databases, Bibliographic - statistics & numerical data
Fundamental and applied biological sciences. Psychology
Humans
Hypothesis testing
Prevalence
Probability
Psychology
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics. Statistics. Methodology
Publication Bias
Statistical inference
Statistics
Statistics as Topic
Statistics. Mathematics
title A peculiar prevalence of p values just below .05
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T09%3A52%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pasca&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20peculiar%20prevalence%20of%20p%20values%20just%20below%20.05&rft.jtitle=Quarterly%20journal%20of%20experimental%20psychology%20(2006)&rft.au=Masicampo,%20E.%20J.&rft.date=2012-11&rft.volume=65&rft.issue=11&rft.spage=2271&rft.epage=2279&rft.pages=2271-2279&rft.issn=1747-0218&rft.eissn=1747-0226&rft_id=info:doi/10.1080/17470218.2012.711335&rft_dat=%3Cproquest_pasca%3E1113981448%3C/proquest_pasca%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1113981448&rft_id=info:pmid/22853650&rft_sage_id=10.1080_17470218.2012.711335&rfr_iscdi=true