Research assessment under debate: disentangling the interest around the DORA declaration on Twitter

Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, espec...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Scientometrics 2024, Vol.129 (1), p.537-559
Hauptverfasser: Orduña-Malea, Enrique, Bautista-Puig, Núria
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 559
container_issue 1
container_start_page 537
container_title Scientometrics
container_volume 129
creator Orduña-Malea, Enrique
Bautista-Puig, Núria
description Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.
doi_str_mv 10.1007/s11192-023-04872-6
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2913687609</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2913687609</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</originalsourceid><addsrcrecordid>eNp9kE1LAzEQhoMoWKt_wFPAczSTbJOst1I_oVAovYdkk223tNmapIj_3tgVvAkDgeF5ZiYvQrdA74FS-ZAAoGaEMk5opSQj4gyNYKIUYUrAORpR4IrUwOklukppS4vEqRqhZumTN7HZYJOST2nvQ8bH4HzEzluT_SN2XSpNE9a7Lqxx3njcheyjTxmb2Bf21HtaLKdFaXYmmtz1AZdafXa5kNfoojW75G9-3zFavTyvZm9kvnh9n03npOFQZyKBVxXlVkljla-tqywww520yoFySigm21ZIU08aUJVh3FLjat7KE8nH6G4Ye4j9x7Gcp7f9MYayUbPyc6GkoHWh2EA1sU8p-lYfYrc38UsD1T9Z6iFLXbLUpyy1KBIfpFTgsPbxb_Q_1jf1sXe3</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2913687609</pqid></control><display><type>article</type><title>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</title><source>SpringerLink Journals - AutoHoldings</source><creator>Orduña-Malea, Enrique ; Bautista-Puig, Núria</creator><creatorcontrib>Orduña-Malea, Enrique ; Bautista-Puig, Núria</creatorcontrib><description>Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment &amp; innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.</description><identifier>ISSN: 0138-9130</identifier><identifier>EISSN: 1588-2861</identifier><identifier>DOI: 10.1007/s11192-023-04872-6</identifier><language>eng</language><publisher>Cham: Springer International Publishing</publisher><subject>Careers ; Computer Science ; Information Storage and Retrieval ; Library Science ; Scholarly communication ; Social networks ; Social organization</subject><ispartof>Scientometrics, 2024, Vol.129 (1), p.537-559</ispartof><rights>Akadémiai Kiadó, Budapest, Hungary 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</citedby><cites>FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</cites><orcidid>0000-0003-2404-0683</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11192-023-04872-6$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11192-023-04872-6$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27903,27904,41467,42536,51297</link.rule.ids></links><search><creatorcontrib>Orduña-Malea, Enrique</creatorcontrib><creatorcontrib>Bautista-Puig, Núria</creatorcontrib><title>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</title><title>Scientometrics</title><addtitle>Scientometrics</addtitle><description>Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment &amp; innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.</description><subject>Careers</subject><subject>Computer Science</subject><subject>Information Storage and Retrieval</subject><subject>Library Science</subject><subject>Scholarly communication</subject><subject>Social networks</subject><subject>Social organization</subject><issn>0138-9130</issn><issn>1588-2861</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQhoMoWKt_wFPAczSTbJOst1I_oVAovYdkk223tNmapIj_3tgVvAkDgeF5ZiYvQrdA74FS-ZAAoGaEMk5opSQj4gyNYKIUYUrAORpR4IrUwOklukppS4vEqRqhZumTN7HZYJOST2nvQ8bH4HzEzluT_SN2XSpNE9a7Lqxx3njcheyjTxmb2Bf21HtaLKdFaXYmmtz1AZdafXa5kNfoojW75G9-3zFavTyvZm9kvnh9n03npOFQZyKBVxXlVkljla-tqywww520yoFySigm21ZIU08aUJVh3FLjat7KE8nH6G4Ye4j9x7Gcp7f9MYayUbPyc6GkoHWh2EA1sU8p-lYfYrc38UsD1T9Z6iFLXbLUpyy1KBIfpFTgsPbxb_Q_1jf1sXe3</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Orduña-Malea, Enrique</creator><creator>Bautista-Puig, Núria</creator><general>Springer International Publishing</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>E3H</scope><scope>F2A</scope><orcidid>https://orcid.org/0000-0003-2404-0683</orcidid></search><sort><creationdate>2024</creationdate><title>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</title><author>Orduña-Malea, Enrique ; Bautista-Puig, Núria</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Careers</topic><topic>Computer Science</topic><topic>Information Storage and Retrieval</topic><topic>Library Science</topic><topic>Scholarly communication</topic><topic>Social networks</topic><topic>Social organization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Orduña-Malea, Enrique</creatorcontrib><creatorcontrib>Bautista-Puig, Núria</creatorcontrib><collection>CrossRef</collection><collection>Library &amp; Information Sciences Abstracts (LISA)</collection><collection>Library &amp; Information Science Abstracts (LISA)</collection><jtitle>Scientometrics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Orduña-Malea, Enrique</au><au>Bautista-Puig, Núria</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</atitle><jtitle>Scientometrics</jtitle><stitle>Scientometrics</stitle><date>2024</date><risdate>2024</risdate><volume>129</volume><issue>1</issue><spage>537</spage><epage>559</epage><pages>537-559</pages><issn>0138-9130</issn><eissn>1588-2861</eissn><abstract>Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment &amp; innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.</abstract><cop>Cham</cop><pub>Springer International Publishing</pub><doi>10.1007/s11192-023-04872-6</doi><tpages>23</tpages><orcidid>https://orcid.org/0000-0003-2404-0683</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0138-9130
ispartof Scientometrics, 2024, Vol.129 (1), p.537-559
issn 0138-9130
1588-2861
language eng
recordid cdi_proquest_journals_2913687609
source SpringerLink Journals - AutoHoldings
subjects Careers
Computer Science
Information Storage and Retrieval
Library Science
Scholarly communication
Social networks
Social organization
title Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-24T16%3A31%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Research%20assessment%20under%20debate:%20disentangling%20the%20interest%20around%20the%20DORA%20declaration%20on%20Twitter&rft.jtitle=Scientometrics&rft.au=Ordu%C3%B1a-Malea,%20Enrique&rft.date=2024&rft.volume=129&rft.issue=1&rft.spage=537&rft.epage=559&rft.pages=537-559&rft.issn=0138-9130&rft.eissn=1588-2861&rft_id=info:doi/10.1007/s11192-023-04872-6&rft_dat=%3Cproquest_cross%3E2913687609%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2913687609&rft_id=info:pmid/&rfr_iscdi=true