Making protocols available with the article improved evaluation of selective outcome reporting

To compare primary outcomes reported in publications, protocols and registries and to evaluate the contribution of available protocols to assess selective outcome reporting (SOR) as compared with registration alone. We included all randomized controlled trials (RCTs) published in 2015 and 2016 in th...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of clinical epidemiology 2018-12, Vol.104, p.95-102
Hauptverfasser: Calméjane, Louis, Dechartres, Agnès, Tran, Viet Thi, Ravaud, Philippe
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 102
container_issue
container_start_page 95
container_title Journal of clinical epidemiology
container_volume 104
creator Calméjane, Louis
Dechartres, Agnès
Tran, Viet Thi
Ravaud, Philippe
description To compare primary outcomes reported in publications, protocols and registries and to evaluate the contribution of available protocols to assess selective outcome reporting (SOR) as compared with registration alone. We included all randomized controlled trials (RCTs) published in 2015 and 2016 in the five leading general medical journals. For each RCT, we evaluated whether the protocol was available and searched for registration. We extracted all primary outcomes reported in publications, registries, and protocols. We evaluated whether SOR was suspected (i.e., at least one discrepancy in primary outcomes), unclear, or not suspected based on comparisons of publications and (1) trial registration alone or (2) protocols in addition to registration. Selective outcome reporting was suspected for 77/274 (28.1%), unclear for 30 (10.9%), and not suspected for 167 (60.9%) when comparing publications and trial registration alone. With protocols available, the classification changed for 38 RCTs (13.9%): 11 not suspected of SOR based on registration became suspected of SOR with protocols available, and 27 with unclear assessment based on registration became suspected of SOR (n = 7) and not suspected of SOR (n = 20) with protocols available. Compared to registration alone, making protocols available allows for a more precise evaluation of SOR. •In this methodological review based on 274 trials published in high impact factor journals with a protocol available, we found that selective outcome reporting (SOR) could not be evaluated for 30 RCTs (10.9%) because of insufficient description of the primary outcomes in trial registries.•With protocols available, there were only three RCTs (1.1%) for which the risk of SOR could not be assessed, and we suspected additional cases of SOR that were not identified with trial registries alone.•Making protocols available along with the article may improve evaluation of SOR.
doi_str_mv 10.1016/j.jclinepi.2018.08.020
format Article
fullrecord <record><control><sourceid>proquest_hal_p</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_03894242v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0895435618305766</els_id><sourcerecordid>2127915128</sourcerecordid><originalsourceid>FETCH-LOGICAL-c478t-5f2db6998d443e52459a7e8e43fdc55baeaf2d8bb52530ad6e2dfcce311549cd3</originalsourceid><addsrcrecordid>eNqFkUFv1DAQhS1ERZfCX6gscYFDFtuJE_tGVQFFWtRLe8Vy7EnXwYkX2wni3-PVtj1wQRrJ0uh745n3ELqkZEsJbT-O29F4N8PBbRmhYktKMfICbajoRMUloy_RhgjJq6bm7Tl6ndJICO1Ix1-h85pQ2VLWbdCP7_qnmx_wIYYcTPAJ61U7r3sP-LfLe5z3gHXMzpSGmwq2gsWwar_o7MKMw4ATeDDZrYDDkk2YAEc4hKKZH96gs0H7BG8f3wt0_-Xz3fVNtbv9-u36aleZphO54gOzfSulsE1TA2cNl7oDAU09WMN5r0EXQvQ9Z7wm2rbA7GAM1JTyRhpbX6APp7l77dUhuknHPypop26udurYI7WQDWvYSgv7_sSWY34tkLKaXDLgvZ4hLEmxYrBkxbWuoO_-QcewxLlcUijWScopE4VqT5SJIaUIw_MGlKhjWmpUT2mpY1qKlGKkCC8fxy_9BPZZ9hRPAT6dACjerQ6iSsbBbMC6WCxXNrj__fEXIySqNA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2127915128</pqid></control><display><type>article</type><title>Making protocols available with the article improved evaluation of selective outcome reporting</title><source>Elsevier ScienceDirect Journals</source><source>ProQuest Central UK/Ireland</source><creator>Calméjane, Louis ; Dechartres, Agnès ; Tran, Viet Thi ; Ravaud, Philippe</creator><creatorcontrib>Calméjane, Louis ; Dechartres, Agnès ; Tran, Viet Thi ; Ravaud, Philippe</creatorcontrib><description>To compare primary outcomes reported in publications, protocols and registries and to evaluate the contribution of available protocols to assess selective outcome reporting (SOR) as compared with registration alone. We included all randomized controlled trials (RCTs) published in 2015 and 2016 in the five leading general medical journals. For each RCT, we evaluated whether the protocol was available and searched for registration. We extracted all primary outcomes reported in publications, registries, and protocols. We evaluated whether SOR was suspected (i.e., at least one discrepancy in primary outcomes), unclear, or not suspected based on comparisons of publications and (1) trial registration alone or (2) protocols in addition to registration. Selective outcome reporting was suspected for 77/274 (28.1%), unclear for 30 (10.9%), and not suspected for 167 (60.9%) when comparing publications and trial registration alone. With protocols available, the classification changed for 38 RCTs (13.9%): 11 not suspected of SOR based on registration became suspected of SOR with protocols available, and 27 with unclear assessment based on registration became suspected of SOR (n = 7) and not suspected of SOR (n = 20) with protocols available. Compared to registration alone, making protocols available allows for a more precise evaluation of SOR. •In this methodological review based on 274 trials published in high impact factor journals with a protocol available, we found that selective outcome reporting (SOR) could not be evaluated for 30 RCTs (10.9%) because of insufficient description of the primary outcomes in trial registries.•With protocols available, there were only three RCTs (1.1%) for which the risk of SOR could not be assessed, and we suspected additional cases of SOR that were not identified with trial registries alone.•Making protocols available along with the article may improve evaluation of SOR.</description><identifier>ISSN: 0895-4356</identifier><identifier>EISSN: 1878-5921</identifier><identifier>DOI: 10.1016/j.jclinepi.2018.08.020</identifier><identifier>PMID: 30196127</identifier><language>eng</language><publisher>United States: Elsevier Inc</publisher><subject>Bias ; Clinical trials ; Data analysis ; Documents ; Epidemiology ; Life Sciences ; Outcome ; Protocols ; Publishing/standards ; Randomized controlled trial ; Registration ; Registries ; Selective outcome reporting ; Studies</subject><ispartof>Journal of clinical epidemiology, 2018-12, Vol.104, p.95-102</ispartof><rights>2018 Elsevier Inc.</rights><rights>Copyright © 2018 Elsevier Inc. All rights reserved.</rights><rights>Copyright Elsevier Limited Dec 2018</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c478t-5f2db6998d443e52459a7e8e43fdc55baeaf2d8bb52530ad6e2dfcce311549cd3</citedby><cites>FETCH-LOGICAL-c478t-5f2db6998d443e52459a7e8e43fdc55baeaf2d8bb52530ad6e2dfcce311549cd3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2127915128?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>230,314,776,780,881,3536,27903,27904,45974,64362,64364,64366,72216</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/30196127$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink><backlink>$$Uhttps://hal.sorbonne-universite.fr/hal-03894242$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Calméjane, Louis</creatorcontrib><creatorcontrib>Dechartres, Agnès</creatorcontrib><creatorcontrib>Tran, Viet Thi</creatorcontrib><creatorcontrib>Ravaud, Philippe</creatorcontrib><title>Making protocols available with the article improved evaluation of selective outcome reporting</title><title>Journal of clinical epidemiology</title><addtitle>J Clin Epidemiol</addtitle><description>To compare primary outcomes reported in publications, protocols and registries and to evaluate the contribution of available protocols to assess selective outcome reporting (SOR) as compared with registration alone. We included all randomized controlled trials (RCTs) published in 2015 and 2016 in the five leading general medical journals. For each RCT, we evaluated whether the protocol was available and searched for registration. We extracted all primary outcomes reported in publications, registries, and protocols. We evaluated whether SOR was suspected (i.e., at least one discrepancy in primary outcomes), unclear, or not suspected based on comparisons of publications and (1) trial registration alone or (2) protocols in addition to registration. Selective outcome reporting was suspected for 77/274 (28.1%), unclear for 30 (10.9%), and not suspected for 167 (60.9%) when comparing publications and trial registration alone. With protocols available, the classification changed for 38 RCTs (13.9%): 11 not suspected of SOR based on registration became suspected of SOR with protocols available, and 27 with unclear assessment based on registration became suspected of SOR (n = 7) and not suspected of SOR (n = 20) with protocols available. Compared to registration alone, making protocols available allows for a more precise evaluation of SOR. •In this methodological review based on 274 trials published in high impact factor journals with a protocol available, we found that selective outcome reporting (SOR) could not be evaluated for 30 RCTs (10.9%) because of insufficient description of the primary outcomes in trial registries.•With protocols available, there were only three RCTs (1.1%) for which the risk of SOR could not be assessed, and we suspected additional cases of SOR that were not identified with trial registries alone.•Making protocols available along with the article may improve evaluation of SOR.</description><subject>Bias</subject><subject>Clinical trials</subject><subject>Data analysis</subject><subject>Documents</subject><subject>Epidemiology</subject><subject>Life Sciences</subject><subject>Outcome</subject><subject>Protocols</subject><subject>Publishing/standards</subject><subject>Randomized controlled trial</subject><subject>Registration</subject><subject>Registries</subject><subject>Selective outcome reporting</subject><subject>Studies</subject><issn>0895-4356</issn><issn>1878-5921</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNqFkUFv1DAQhS1ERZfCX6gscYFDFtuJE_tGVQFFWtRLe8Vy7EnXwYkX2wni3-PVtj1wQRrJ0uh745n3ELqkZEsJbT-O29F4N8PBbRmhYktKMfICbajoRMUloy_RhgjJq6bm7Tl6ndJICO1Ix1-h85pQ2VLWbdCP7_qnmx_wIYYcTPAJ61U7r3sP-LfLe5z3gHXMzpSGmwq2gsWwar_o7MKMw4ATeDDZrYDDkk2YAEc4hKKZH96gs0H7BG8f3wt0_-Xz3fVNtbv9-u36aleZphO54gOzfSulsE1TA2cNl7oDAU09WMN5r0EXQvQ9Z7wm2rbA7GAM1JTyRhpbX6APp7l77dUhuknHPypop26udurYI7WQDWvYSgv7_sSWY34tkLKaXDLgvZ4hLEmxYrBkxbWuoO_-QcewxLlcUijWScopE4VqT5SJIaUIw_MGlKhjWmpUT2mpY1qKlGKkCC8fxy_9BPZZ9hRPAT6dACjerQ6iSsbBbMC6WCxXNrj__fEXIySqNA</recordid><startdate>20181201</startdate><enddate>20181201</enddate><creator>Calméjane, Louis</creator><creator>Dechartres, Agnès</creator><creator>Tran, Viet Thi</creator><creator>Ravaud, Philippe</creator><general>Elsevier Inc</general><general>Elsevier Limited</general><general>Elsevier</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7QL</scope><scope>7QP</scope><scope>7RV</scope><scope>7T2</scope><scope>7T7</scope><scope>7TK</scope><scope>7U7</scope><scope>7U9</scope><scope>7X7</scope><scope>7XB</scope><scope>88C</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AEUYN</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>C1K</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>H94</scope><scope>K9.</scope><scope>KB0</scope><scope>M0S</scope><scope>M0T</scope><scope>M1P</scope><scope>M2O</scope><scope>M7N</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>P64</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope><scope>7X8</scope><scope>1XC</scope><scope>VOOES</scope></search><sort><creationdate>20181201</creationdate><title>Making protocols available with the article improved evaluation of selective outcome reporting</title><author>Calméjane, Louis ; Dechartres, Agnès ; Tran, Viet Thi ; Ravaud, Philippe</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c478t-5f2db6998d443e52459a7e8e43fdc55baeaf2d8bb52530ad6e2dfcce311549cd3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Bias</topic><topic>Clinical trials</topic><topic>Data analysis</topic><topic>Documents</topic><topic>Epidemiology</topic><topic>Life Sciences</topic><topic>Outcome</topic><topic>Protocols</topic><topic>Publishing/standards</topic><topic>Randomized controlled trial</topic><topic>Registration</topic><topic>Registries</topic><topic>Selective outcome reporting</topic><topic>Studies</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Calméjane, Louis</creatorcontrib><creatorcontrib>Dechartres, Agnès</creatorcontrib><creatorcontrib>Tran, Viet Thi</creatorcontrib><creatorcontrib>Ravaud, Philippe</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Calcium &amp; Calcified Tissue Abstracts</collection><collection>Nursing &amp; Allied Health Database</collection><collection>Health and Safety Science Abstracts (Full archive)</collection><collection>Industrial and Applied Microbiology Abstracts (Microbiology A)</collection><collection>Neurosciences Abstracts</collection><collection>Toxicology Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Healthcare Administration Database (Alumni)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest One Sustainability</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Healthcare Administration Database</collection><collection>Medical Database</collection><collection>Research Library</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Research Library (Corporate)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>Hyper Article en Ligne (HAL)</collection><collection>Hyper Article en Ligne (HAL) (Open Access)</collection><jtitle>Journal of clinical epidemiology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Calméjane, Louis</au><au>Dechartres, Agnès</au><au>Tran, Viet Thi</au><au>Ravaud, Philippe</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Making protocols available with the article improved evaluation of selective outcome reporting</atitle><jtitle>Journal of clinical epidemiology</jtitle><addtitle>J Clin Epidemiol</addtitle><date>2018-12-01</date><risdate>2018</risdate><volume>104</volume><spage>95</spage><epage>102</epage><pages>95-102</pages><issn>0895-4356</issn><eissn>1878-5921</eissn><abstract>To compare primary outcomes reported in publications, protocols and registries and to evaluate the contribution of available protocols to assess selective outcome reporting (SOR) as compared with registration alone. We included all randomized controlled trials (RCTs) published in 2015 and 2016 in the five leading general medical journals. For each RCT, we evaluated whether the protocol was available and searched for registration. We extracted all primary outcomes reported in publications, registries, and protocols. We evaluated whether SOR was suspected (i.e., at least one discrepancy in primary outcomes), unclear, or not suspected based on comparisons of publications and (1) trial registration alone or (2) protocols in addition to registration. Selective outcome reporting was suspected for 77/274 (28.1%), unclear for 30 (10.9%), and not suspected for 167 (60.9%) when comparing publications and trial registration alone. With protocols available, the classification changed for 38 RCTs (13.9%): 11 not suspected of SOR based on registration became suspected of SOR with protocols available, and 27 with unclear assessment based on registration became suspected of SOR (n = 7) and not suspected of SOR (n = 20) with protocols available. Compared to registration alone, making protocols available allows for a more precise evaluation of SOR. •In this methodological review based on 274 trials published in high impact factor journals with a protocol available, we found that selective outcome reporting (SOR) could not be evaluated for 30 RCTs (10.9%) because of insufficient description of the primary outcomes in trial registries.•With protocols available, there were only three RCTs (1.1%) for which the risk of SOR could not be assessed, and we suspected additional cases of SOR that were not identified with trial registries alone.•Making protocols available along with the article may improve evaluation of SOR.</abstract><cop>United States</cop><pub>Elsevier Inc</pub><pmid>30196127</pmid><doi>10.1016/j.jclinepi.2018.08.020</doi><tpages>8</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0895-4356
ispartof Journal of clinical epidemiology, 2018-12, Vol.104, p.95-102
issn 0895-4356
1878-5921
language eng
recordid cdi_hal_primary_oai_HAL_hal_03894242v1
source Elsevier ScienceDirect Journals; ProQuest Central UK/Ireland
subjects Bias
Clinical trials
Data analysis
Documents
Epidemiology
Life Sciences
Outcome
Protocols
Publishing/standards
Randomized controlled trial
Registration
Registries
Selective outcome reporting
Studies
title Making protocols available with the article improved evaluation of selective outcome reporting
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T00%3A49%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_hal_p&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Making%20protocols%20available%20with%20the%20article%20improved%20evaluation%20of%20selective%20outcome%20reporting&rft.jtitle=Journal%20of%20clinical%20epidemiology&rft.au=Calm%C3%A9jane,%20Louis&rft.date=2018-12-01&rft.volume=104&rft.spage=95&rft.epage=102&rft.pages=95-102&rft.issn=0895-4356&rft.eissn=1878-5921&rft_id=info:doi/10.1016/j.jclinepi.2018.08.020&rft_dat=%3Cproquest_hal_p%3E2127915128%3C/proquest_hal_p%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2127915128&rft_id=info:pmid/30196127&rft_els_id=S0895435618305766&rfr_iscdi=true