Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research
The extent to which findings in bilingualism research are contingent on specific analytic choices, experimental designs, or operationalisations, is currently unknown. Poor availability of data, analysis code, and materials has hindered the development of cumulative lines of research. In this review,...
Gespeichert in:
| Veröffentlicht in: | Bilingualism (Cambridge, England) England), 2021-11, Vol.24 (5), p.801-806 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 806 |
|---|---|
| container_issue | 5 |
| container_start_page | 801 |
| container_title | Bilingualism (Cambridge, England) |
| container_volume | 24 |
| creator | Bolibaugh, Cylcia Vanek, Norbert Marsden, Emma J. |
| description | The extent to which findings in bilingualism research are contingent on specific analytic choices, experimental designs, or operationalisations, is currently unknown. Poor availability of data, analysis code, and materials has hindered the development of cumulative lines of research. In this review, we survey current practices and advocate a credibility revolution in bilingualism research through the adoption of minimum standards of transparency. Full disclosure of data and code is necessary not only to assess the reproducibility of original findings, but also to test the robustness of these findings to different analytic specifications. Similarly, full provision of experimental materials and protocols underpins assessment of both the replicability of original findings, as well as their generalisability to different contexts and samples. We illustrate the review with examples where good practice has advanced the agenda in bilingualism research and highlight resources to help researchers get started. |
| doi_str_mv | 10.1017/S1366728921000535 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2591032800</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><cupid>10_1017_S1366728921000535</cupid><sourcerecordid>2591032800</sourcerecordid><originalsourceid>FETCH-LOGICAL-c426t-4bdc451ed02ce4d8d0a1e24af9c59ef6838f268ec4ff16444ace85f7075b8aa33</originalsourceid><addsrcrecordid>eNp1kM9KxDAQh4souK4-gLeA52qSpm3qTRb_wcIeXM9lmkzXLG1Tk1bxNXxiU3fFg3jKZH7zfQkTReeMXjLK8qsnlmRZzmXBGaU0TdKDaMZEVsRMCnYY6hDHU34cnXi_pZTTPM9n0efavoPTngBRDrWpTGOGD-LwzTbjYGxHTEemZrcZoTG-DZFHcOrlmqx67IiGAQh0mrQwoDPQBJUnfsC-D0wobIeeDJa01mGAe2f1qEzV4DcVGo1RMF1_xKfRUR00eLY_59Hz3e168RAvV_ePi5tlrATPhlhUWomUoaZcodBSU2DIBdSFSgusM5nImmcSlahrlgkhQKFM65zmaSUBkmQeXey84UuvI_qh3NrRdeHJkqcFowmXlIYptptSznrvsC57Z1pwHyWj5bT68s_qA5PsGWgrZ_QGf9X_U1-jIIls</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2591032800</pqid></control><display><type>article</type><title>Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research</title><source>Cambridge University Press Journals Complete</source><creator>Bolibaugh, Cylcia ; Vanek, Norbert ; Marsden, Emma J.</creator><creatorcontrib>Bolibaugh, Cylcia ; Vanek, Norbert ; Marsden, Emma J.</creatorcontrib><description>The extent to which findings in bilingualism research are contingent on specific analytic choices, experimental designs, or operationalisations, is currently unknown. Poor availability of data, analysis code, and materials has hindered the development of cumulative lines of research. In this review, we survey current practices and advocate a credibility revolution in bilingualism research through the adoption of minimum standards of transparency. Full disclosure of data and code is necessary not only to assess the reproducibility of original findings, but also to test the robustness of these findings to different analytic specifications. Similarly, full provision of experimental materials and protocols underpins assessment of both the replicability of original findings, as well as their generalisability to different contexts and samples. We illustrate the review with examples where good practice has advanced the agenda in bilingualism research and highlight resources to help researchers get started.</description><identifier>ISSN: 1366-7289</identifier><identifier>EISSN: 1469-1841</identifier><identifier>DOI: 10.1017/S1366728921000535</identifier><language>eng</language><publisher>Cambridge, UK: Cambridge University Press</publisher><subject>Bilingualism ; Coding ; Credibility ; Data Processing ; Datasets ; Disclosure ; Executive function ; Inferences ; Information sharing ; Language acquisition ; Language Enrichment ; Meta Analysis ; Reproducibility ; Scientific Enterprise ; Second language learning ; Second Languages ; Syntax</subject><ispartof>Bilingualism (Cambridge, England), 2021-11, Vol.24 (5), p.801-806</ispartof><rights>Copyright © The Author(s), 2021. Published by Cambridge University Press</rights><rights>Copyright © The Author(s), 2021. Published by Cambridge University Press. This work is licensed under the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0 (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c426t-4bdc451ed02ce4d8d0a1e24af9c59ef6838f268ec4ff16444ace85f7075b8aa33</citedby><cites>FETCH-LOGICAL-c426t-4bdc451ed02ce4d8d0a1e24af9c59ef6838f268ec4ff16444ace85f7075b8aa33</cites><orcidid>0000-0001-7500-264X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.cambridge.org/core/product/identifier/S1366728921000535/type/journal_article$$EHTML$$P50$$Gcambridge$$Hfree_for_read</linktohtml><link.rule.ids>164,314,776,780,27901,27902,55603</link.rule.ids></links><search><creatorcontrib>Bolibaugh, Cylcia</creatorcontrib><creatorcontrib>Vanek, Norbert</creatorcontrib><creatorcontrib>Marsden, Emma J.</creatorcontrib><title>Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research</title><title>Bilingualism (Cambridge, England)</title><addtitle>Bilingualism</addtitle><description>The extent to which findings in bilingualism research are contingent on specific analytic choices, experimental designs, or operationalisations, is currently unknown. Poor availability of data, analysis code, and materials has hindered the development of cumulative lines of research. In this review, we survey current practices and advocate a credibility revolution in bilingualism research through the adoption of minimum standards of transparency. Full disclosure of data and code is necessary not only to assess the reproducibility of original findings, but also to test the robustness of these findings to different analytic specifications. Similarly, full provision of experimental materials and protocols underpins assessment of both the replicability of original findings, as well as their generalisability to different contexts and samples. We illustrate the review with examples where good practice has advanced the agenda in bilingualism research and highlight resources to help researchers get started.</description><subject>Bilingualism</subject><subject>Coding</subject><subject>Credibility</subject><subject>Data Processing</subject><subject>Datasets</subject><subject>Disclosure</subject><subject>Executive function</subject><subject>Inferences</subject><subject>Information sharing</subject><subject>Language acquisition</subject><subject>Language Enrichment</subject><subject>Meta Analysis</subject><subject>Reproducibility</subject><subject>Scientific Enterprise</subject><subject>Second language learning</subject><subject>Second Languages</subject><subject>Syntax</subject><issn>1366-7289</issn><issn>1469-1841</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>IKXGN</sourceid><sourceid>AVQMV</sourceid><sourceid>BENPR</sourceid><sourceid>K50</sourceid><sourceid>M1D</sourceid><recordid>eNp1kM9KxDAQh4souK4-gLeA52qSpm3qTRb_wcIeXM9lmkzXLG1Tk1bxNXxiU3fFg3jKZH7zfQkTReeMXjLK8qsnlmRZzmXBGaU0TdKDaMZEVsRMCnYY6hDHU34cnXi_pZTTPM9n0efavoPTngBRDrWpTGOGD-LwzTbjYGxHTEemZrcZoTG-DZFHcOrlmqx67IiGAQh0mrQwoDPQBJUnfsC-D0wobIeeDJa01mGAe2f1qEzV4DcVGo1RMF1_xKfRUR00eLY_59Hz3e168RAvV_ePi5tlrATPhlhUWomUoaZcodBSU2DIBdSFSgusM5nImmcSlahrlgkhQKFM65zmaSUBkmQeXey84UuvI_qh3NrRdeHJkqcFowmXlIYptptSznrvsC57Z1pwHyWj5bT68s_qA5PsGWgrZ_QGf9X_U1-jIIls</recordid><startdate>20211101</startdate><enddate>20211101</enddate><creator>Bolibaugh, Cylcia</creator><creator>Vanek, Norbert</creator><creator>Marsden, Emma J.</creator><general>Cambridge University Press</general><scope>IKXGN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7T9</scope><scope>7XB</scope><scope>88B</scope><scope>88G</scope><scope>88J</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AIMQZ</scope><scope>ALSLI</scope><scope>AVQMV</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>CPGLG</scope><scope>CRLPW</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>K50</scope><scope>LIQON</scope><scope>M0P</scope><scope>M1D</scope><scope>M2M</scope><scope>M2R</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PSYQQ</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0001-7500-264X</orcidid></search><sort><creationdate>20211101</creationdate><title>Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research</title><author>Bolibaugh, Cylcia ; Vanek, Norbert ; Marsden, Emma J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c426t-4bdc451ed02ce4d8d0a1e24af9c59ef6838f268ec4ff16444ace85f7075b8aa33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Bilingualism</topic><topic>Coding</topic><topic>Credibility</topic><topic>Data Processing</topic><topic>Datasets</topic><topic>Disclosure</topic><topic>Executive function</topic><topic>Inferences</topic><topic>Information sharing</topic><topic>Language acquisition</topic><topic>Language Enrichment</topic><topic>Meta Analysis</topic><topic>Reproducibility</topic><topic>Scientific Enterprise</topic><topic>Second language learning</topic><topic>Second Languages</topic><topic>Syntax</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bolibaugh, Cylcia</creatorcontrib><creatorcontrib>Vanek, Norbert</creatorcontrib><creatorcontrib>Marsden, Emma J.</creatorcontrib><collection>Cambridge Journals Open Access</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Social Science Database (Alumni Edition)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest One Literature</collection><collection>Social Science Premium Collection</collection><collection>Arts Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>Linguistics Collection</collection><collection>Linguistics Database</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Art, Design & Architecture Collection</collection><collection>ProQuest One Literature - U.S. Customers Only</collection><collection>Education Database</collection><collection>Arts & Humanities Database</collection><collection>ProQuest Psychology</collection><collection>Social Science Database</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><jtitle>Bilingualism (Cambridge, England)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bolibaugh, Cylcia</au><au>Vanek, Norbert</au><au>Marsden, Emma J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research</atitle><jtitle>Bilingualism (Cambridge, England)</jtitle><addtitle>Bilingualism</addtitle><date>2021-11-01</date><risdate>2021</risdate><volume>24</volume><issue>5</issue><spage>801</spage><epage>806</epage><pages>801-806</pages><issn>1366-7289</issn><eissn>1469-1841</eissn><abstract>The extent to which findings in bilingualism research are contingent on specific analytic choices, experimental designs, or operationalisations, is currently unknown. Poor availability of data, analysis code, and materials has hindered the development of cumulative lines of research. In this review, we survey current practices and advocate a credibility revolution in bilingualism research through the adoption of minimum standards of transparency. Full disclosure of data and code is necessary not only to assess the reproducibility of original findings, but also to test the robustness of these findings to different analytic specifications. Similarly, full provision of experimental materials and protocols underpins assessment of both the replicability of original findings, as well as their generalisability to different contexts and samples. We illustrate the review with examples where good practice has advanced the agenda in bilingualism research and highlight resources to help researchers get started.</abstract><cop>Cambridge, UK</cop><pub>Cambridge University Press</pub><doi>10.1017/S1366728921000535</doi><tpages>6</tpages><orcidid>https://orcid.org/0000-0001-7500-264X</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1366-7289 |
| ispartof | Bilingualism (Cambridge, England), 2021-11, Vol.24 (5), p.801-806 |
| issn | 1366-7289 1469-1841 |
| language | eng |
| recordid | cdi_proquest_journals_2591032800 |
| source | Cambridge University Press Journals Complete |
| subjects | Bilingualism Coding Credibility Data Processing Datasets Disclosure Executive function Inferences Information sharing Language acquisition Language Enrichment Meta Analysis Reproducibility Scientific Enterprise Second language learning Second Languages Syntax |
| title | Towards a credibility revolution in bilingualism research: Open data and materials as stepping stones to more reproducible and replicable research |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T16%3A21%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Towards%20a%20credibility%20revolution%20in%20bilingualism%20research:%20Open%20data%20and%20materials%20as%20stepping%20stones%20to%20more%20reproducible%20and%20replicable%20research&rft.jtitle=Bilingualism%20(Cambridge,%20England)&rft.au=Bolibaugh,%20Cylcia&rft.date=2021-11-01&rft.volume=24&rft.issue=5&rft.spage=801&rft.epage=806&rft.pages=801-806&rft.issn=1366-7289&rft.eissn=1469-1841&rft_id=info:doi/10.1017/S1366728921000535&rft_dat=%3Cproquest_cross%3E2591032800%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2591032800&rft_id=info:pmid/&rft_cupid=10_1017_S1366728921000535&rfr_iscdi=true |