‘Data snooping’ and the significance level in multiple testing
Carrying out a number of statistical tests, using some or all of the same data repeatedly, increases the chance of making decision errors. If, moreover, the tests to be done are formulated after looking at the results of an interim analysis using the same data – a situation termed ‘data snooping’ –...
Gespeichert in:
| Format: | Buchkapitel |
|---|---|
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 134 |
|---|---|
| container_issue | |
| container_start_page | 129 |
| container_title | |
| container_volume | |
| description | Carrying out a number of statistical tests, using some or all of the same data repeatedly, increases the chance of making decision errors. If, moreover, the tests to be done are formulated after looking at the results of an interim analysis using the same data – a situation termed ‘data snooping’ – there is serious risk of biasing the entire investigation. Data snooping can be done in a controlled and reasonable way, or in an uncontrolled and misleading (and even unethical) way. Several consequences of, and potential solutions to, the problem of data snooping are explained. |
| doi_str_mv | 10.1002/9781119335139.ch17 |
| format | Book Chapter |
| fullrecord | <record><control><sourceid>wiley</sourceid><recordid>TN_cdi_wiley_ebooks_10_1002_9781119335139_ch17_ch17</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10.1002/9781119335139.ch17</sourcerecordid><originalsourceid>FETCH-LOGICAL-w168f-af6bb68d4be75c248397661d6f5ca63c67b22e1655d9a3e08e6def0b6e95fcbc3</originalsourceid><addsrcrecordid>eNptkMtKw0AUhkdEUGtewNW8QOJcMpcstWoVCm50HeZyph2MSWCiRVd9DH29Pom9IRTcnB9-_u8sPoQuKSkoIeyqUppSWnEuKK8KN6fqCJ3_NewYZfsFUUIzcoqylKIlbFvK8gzdrJbft2YwOLVd18d2tlr-YNN6PMwBpzhrY4jOtA5wAx_Q4Njit_dmiH0DeIA0rIkLdBJMkyDb5wi93N89jx_y6dPkcXw9zRdU6pCbIK2V2pcWlHCs1LxSUlIvg3BGcieVZQyoFMJXhgPRID0EYiVUIjjr-Ajx3d9FbOCzBtt1r6mmpN6YqA9M1BsT27Omin-ow_VX7HdE7wP_BYW9Y4A</addsrcrecordid><sourcetype>Enrichment Source</sourcetype><iscdi>true</iscdi><recordtype>book_chapter</recordtype></control><display><type>book_chapter</type><title>‘Data snooping’ and the significance level in multiple testing</title><source>Wiley Online Library All Obooks</source><contributor>Sowey, Eric ; Petocz, Peter</contributor><creatorcontrib>Sowey, Eric ; Petocz, Peter</creatorcontrib><description>Carrying out a number of statistical tests, using some or all of the same data repeatedly, increases the chance of making decision errors. If, moreover, the tests to be done are formulated after looking at the results of an interim analysis using the same data – a situation termed ‘data snooping’ – there is serious risk of biasing the entire investigation. Data snooping can be done in a controlled and reasonable way, or in an uncontrolled and misleading (and even unethical) way. Several consequences of, and potential solutions to, the problem of data snooping are explained.</description><identifier>ISBN: 9781119075820</identifier><identifier>ISBN: 1119075823</identifier><identifier>EISBN: 1119335132</identifier><identifier>EISBN: 9781119335139</identifier><identifier>DOI: 10.1002/9781119335139.ch17</identifier><language>eng</language><publisher>Chichester, UK: John Wiley & Sons, Ltd</publisher><subject>Bonferroni adjustment ; controlling the type I error size ; data snooping ; multiple testing</subject><ispartof>A Panorama of Statistics, 2016, p.129-134</ispartof><rights>2017 John Wiley & Sons, Ltd.</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002/9781119335139.ch17$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002/9781119335139.ch17$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>779,780,784,793,4323,27925,52532,52680</link.rule.ids></links><search><contributor>Sowey, Eric</contributor><contributor>Petocz, Peter</contributor><title>‘Data snooping’ and the significance level in multiple testing</title><title>A Panorama of Statistics</title><description>Carrying out a number of statistical tests, using some or all of the same data repeatedly, increases the chance of making decision errors. If, moreover, the tests to be done are formulated after looking at the results of an interim analysis using the same data – a situation termed ‘data snooping’ – there is serious risk of biasing the entire investigation. Data snooping can be done in a controlled and reasonable way, or in an uncontrolled and misleading (and even unethical) way. Several consequences of, and potential solutions to, the problem of data snooping are explained.</description><subject>Bonferroni adjustment</subject><subject>controlling the type I error size</subject><subject>data snooping</subject><subject>multiple testing</subject><isbn>9781119075820</isbn><isbn>1119075823</isbn><isbn>1119335132</isbn><isbn>9781119335139</isbn><fulltext>true</fulltext><rsrctype>book_chapter</rsrctype><creationdate>2016</creationdate><recordtype>book_chapter</recordtype><sourceid/><recordid>eNptkMtKw0AUhkdEUGtewNW8QOJcMpcstWoVCm50HeZyph2MSWCiRVd9DH29Pom9IRTcnB9-_u8sPoQuKSkoIeyqUppSWnEuKK8KN6fqCJ3_NewYZfsFUUIzcoqylKIlbFvK8gzdrJbft2YwOLVd18d2tlr-YNN6PMwBpzhrY4jOtA5wAx_Q4Njit_dmiH0DeIA0rIkLdBJMkyDb5wi93N89jx_y6dPkcXw9zRdU6pCbIK2V2pcWlHCs1LxSUlIvg3BGcieVZQyoFMJXhgPRID0EYiVUIjjr-Ajx3d9FbOCzBtt1r6mmpN6YqA9M1BsT27Omin-ow_VX7HdE7wP_BYW9Y4A</recordid><startdate>20161215</startdate><enddate>20161215</enddate><general>John Wiley & Sons, Ltd</general><scope/></search><sort><creationdate>20161215</creationdate><title>‘Data snooping’ and the significance level in multiple testing</title></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-w168f-af6bb68d4be75c248397661d6f5ca63c67b22e1655d9a3e08e6def0b6e95fcbc3</frbrgroupid><rsrctype>book_chapters</rsrctype><prefilter>book_chapters</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Bonferroni adjustment</topic><topic>controlling the type I error size</topic><topic>data snooping</topic><topic>multiple testing</topic><toplevel>online_resources</toplevel></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sowey, Eric</au><au>Petocz, Peter</au><format>book</format><genre>bookitem</genre><ristype>CHAP</ristype><atitle>‘Data snooping’ and the significance level in multiple testing</atitle><btitle>A Panorama of Statistics</btitle><date>2016-12-15</date><risdate>2016</risdate><spage>129</spage><epage>134</epage><pages>129-134</pages><isbn>9781119075820</isbn><isbn>1119075823</isbn><eisbn>1119335132</eisbn><eisbn>9781119335139</eisbn><abstract>Carrying out a number of statistical tests, using some or all of the same data repeatedly, increases the chance of making decision errors. If, moreover, the tests to be done are formulated after looking at the results of an interim analysis using the same data – a situation termed ‘data snooping’ – there is serious risk of biasing the entire investigation. Data snooping can be done in a controlled and reasonable way, or in an uncontrolled and misleading (and even unethical) way. Several consequences of, and potential solutions to, the problem of data snooping are explained.</abstract><cop>Chichester, UK</cop><pub>John Wiley & Sons, Ltd</pub><doi>10.1002/9781119335139.ch17</doi><tpages>6</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISBN: 9781119075820 |
| ispartof | A Panorama of Statistics, 2016, p.129-134 |
| issn | |
| language | eng |
| recordid | cdi_wiley_ebooks_10_1002_9781119335139_ch17_ch17 |
| source | Wiley Online Library All Obooks |
| subjects | Bonferroni adjustment controlling the type I error size data snooping multiple testing |
| title | ‘Data snooping’ and the significance level in multiple testing |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T19%3A46%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-wiley&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=bookitem&rft.atitle=%E2%80%98Data%20snooping%E2%80%99%20and%20the%20significance%20level%20in%20multiple%20testing&rft.btitle=A%20Panorama%20of%20Statistics&rft.au=Sowey,%20Eric&rft.date=2016-12-15&rft.spage=129&rft.epage=134&rft.pages=129-134&rft.isbn=9781119075820&rft.isbn_list=1119075823&rft_id=info:doi/10.1002/9781119335139.ch17&rft_dat=%3Cwiley%3E10.1002/9781119335139.ch17%3C/wiley%3E%3Curl%3E%3C/url%3E&rft.eisbn=1119335132&rft.eisbn_list=9781119335139&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |