Research assessment under debate: disentangling the interest around the DORA declaration on Twitter
Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, espec...
Gespeichert in:
Veröffentlicht in: | Scientometrics 2024, Vol.129 (1), p.537-559 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 559 |
---|---|
container_issue | 1 |
container_start_page | 537 |
container_title | Scientometrics |
container_volume | 129 |
creator | Orduña-Malea, Enrique Bautista-Puig, Núria |
description | Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation. |
doi_str_mv | 10.1007/s11192-023-04872-6 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2913687609</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2913687609</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</originalsourceid><addsrcrecordid>eNp9kE1LAzEQhoMoWKt_wFPAczSTbJOst1I_oVAovYdkk223tNmapIj_3tgVvAkDgeF5ZiYvQrdA74FS-ZAAoGaEMk5opSQj4gyNYKIUYUrAORpR4IrUwOklukppS4vEqRqhZumTN7HZYJOST2nvQ8bH4HzEzluT_SN2XSpNE9a7Lqxx3njcheyjTxmb2Bf21HtaLKdFaXYmmtz1AZdafXa5kNfoojW75G9-3zFavTyvZm9kvnh9n03npOFQZyKBVxXlVkljla-tqywww520yoFySigm21ZIU08aUJVh3FLjat7KE8nH6G4Ye4j9x7Gcp7f9MYayUbPyc6GkoHWh2EA1sU8p-lYfYrc38UsD1T9Z6iFLXbLUpyy1KBIfpFTgsPbxb_Q_1jf1sXe3</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2913687609</pqid></control><display><type>article</type><title>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</title><source>SpringerLink Journals - AutoHoldings</source><creator>Orduña-Malea, Enrique ; Bautista-Puig, Núria</creator><creatorcontrib>Orduña-Malea, Enrique ; Bautista-Puig, Núria</creatorcontrib><description>Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.</description><identifier>ISSN: 0138-9130</identifier><identifier>EISSN: 1588-2861</identifier><identifier>DOI: 10.1007/s11192-023-04872-6</identifier><language>eng</language><publisher>Cham: Springer International Publishing</publisher><subject>Careers ; Computer Science ; Information Storage and Retrieval ; Library Science ; Scholarly communication ; Social networks ; Social organization</subject><ispartof>Scientometrics, 2024, Vol.129 (1), p.537-559</ispartof><rights>Akadémiai Kiadó, Budapest, Hungary 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</citedby><cites>FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</cites><orcidid>0000-0003-2404-0683</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11192-023-04872-6$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11192-023-04872-6$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27903,27904,41467,42536,51297</link.rule.ids></links><search><creatorcontrib>Orduña-Malea, Enrique</creatorcontrib><creatorcontrib>Bautista-Puig, Núria</creatorcontrib><title>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</title><title>Scientometrics</title><addtitle>Scientometrics</addtitle><description>Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.</description><subject>Careers</subject><subject>Computer Science</subject><subject>Information Storage and Retrieval</subject><subject>Library Science</subject><subject>Scholarly communication</subject><subject>Social networks</subject><subject>Social organization</subject><issn>0138-9130</issn><issn>1588-2861</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQhoMoWKt_wFPAczSTbJOst1I_oVAovYdkk223tNmapIj_3tgVvAkDgeF5ZiYvQrdA74FS-ZAAoGaEMk5opSQj4gyNYKIUYUrAORpR4IrUwOklukppS4vEqRqhZumTN7HZYJOST2nvQ8bH4HzEzluT_SN2XSpNE9a7Lqxx3njcheyjTxmb2Bf21HtaLKdFaXYmmtz1AZdafXa5kNfoojW75G9-3zFavTyvZm9kvnh9n03npOFQZyKBVxXlVkljla-tqywww520yoFySigm21ZIU08aUJVh3FLjat7KE8nH6G4Ye4j9x7Gcp7f9MYayUbPyc6GkoHWh2EA1sU8p-lYfYrc38UsD1T9Z6iFLXbLUpyy1KBIfpFTgsPbxb_Q_1jf1sXe3</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Orduña-Malea, Enrique</creator><creator>Bautista-Puig, Núria</creator><general>Springer International Publishing</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>E3H</scope><scope>F2A</scope><orcidid>https://orcid.org/0000-0003-2404-0683</orcidid></search><sort><creationdate>2024</creationdate><title>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</title><author>Orduña-Malea, Enrique ; Bautista-Puig, Núria</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-7134403b87ab8e9bd4b12a3d7b8d18d86827ff67a95c184a23b0ad93f7d4b123</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Careers</topic><topic>Computer Science</topic><topic>Information Storage and Retrieval</topic><topic>Library Science</topic><topic>Scholarly communication</topic><topic>Social networks</topic><topic>Social organization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Orduña-Malea, Enrique</creatorcontrib><creatorcontrib>Bautista-Puig, Núria</creatorcontrib><collection>CrossRef</collection><collection>Library & Information Sciences Abstracts (LISA)</collection><collection>Library & Information Science Abstracts (LISA)</collection><jtitle>Scientometrics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Orduña-Malea, Enrique</au><au>Bautista-Puig, Núria</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Research assessment under debate: disentangling the interest around the DORA declaration on Twitter</atitle><jtitle>Scientometrics</jtitle><stitle>Scientometrics</stitle><date>2024</date><risdate>2024</risdate><volume>129</volume><issue>1</issue><spage>537</spage><epage>559</epage><pages>537-559</pages><issn>0138-9130</issn><eissn>1588-2861</eissn><abstract>Much debate has been around the misapplication of metrics in research assessment. As a result of this concern, the Declaration on Research Assessment (DORA) was launched, an initiative that caused opposing viewpoints. However, the discussion topics about DORA have not been formally identified, especially in participatory environments outside the scholarly communication process, such as social networks. This paper contributes to that end by analyzing 20,717 DORA-related tweets published from 2015 to 2022. The results show an increasing volume of tweets, mainly promotional and informative, but with limited participation of users, either commenting or engaging with the tweets, generating a scarcely polarized conversation driven primarily by a few DORA promoters. While a varied list of discussion topics is found (especially "Open science and research assessment," "Academics career assessment & innovation," and "Journal Impact Factor"), the DORA debate appears as part of broader conversations (research evaluation, open science). Further studies are needed to check whether these results are restricted to Twitter or reveal more general patterns. The findings might interest the different evaluators and evaluated agents regarding their interests and concerns around the reforms in the research evaluation.</abstract><cop>Cham</cop><pub>Springer International Publishing</pub><doi>10.1007/s11192-023-04872-6</doi><tpages>23</tpages><orcidid>https://orcid.org/0000-0003-2404-0683</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0138-9130 |
ispartof | Scientometrics, 2024, Vol.129 (1), p.537-559 |
issn | 0138-9130 1588-2861 |
language | eng |
recordid | cdi_proquest_journals_2913687609 |
source | SpringerLink Journals - AutoHoldings |
subjects | Careers Computer Science Information Storage and Retrieval Library Science Scholarly communication Social networks Social organization |
title | Research assessment under debate: disentangling the interest around the DORA declaration on Twitter |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-24T16%3A31%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Research%20assessment%20under%20debate:%20disentangling%20the%20interest%20around%20the%20DORA%20declaration%20on%20Twitter&rft.jtitle=Scientometrics&rft.au=Ordu%C3%B1a-Malea,%20Enrique&rft.date=2024&rft.volume=129&rft.issue=1&rft.spage=537&rft.epage=559&rft.pages=537-559&rft.issn=0138-9130&rft.eissn=1588-2861&rft_id=info:doi/10.1007/s11192-023-04872-6&rft_dat=%3Cproquest_cross%3E2913687609%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2913687609&rft_id=info:pmid/&rfr_iscdi=true |