A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations
Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal sel...
Gespeichert in:
| Veröffentlicht in: | PloS one 2016-08, Vol.11 (8), p.e0161021-e0161021 |
|---|---|
| Hauptverfasser: | , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | e0161021 |
|---|---|
| container_issue | 8 |
| container_start_page | e0161021 |
| container_title | PloS one |
| container_volume | 11 |
| creator | Chorus, Caspar Waltman, Ludo |
| description | Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings. |
| doi_str_mv | 10.1371/journal.pone.0161021 |
| format | Article |
| fullrecord | <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_1814151810</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A461579375</galeid><doaj_id>oai_doaj_org_article_1d4536bb9885426aaaa264960d92901b</doaj_id><sourcerecordid>A461579375</sourcerecordid><originalsourceid>FETCH-LOGICAL-c725t-b7a438a56a9fb777bb7dee941b2b4beb91227cbcf887cc2f5646d8f5a36cd9413</originalsourceid><addsrcrecordid>eNqNk9-LEzEQxxdRvPP0PxBdEEQftuZ3Ni9CLXdaKRxY9TUk2Wybst30kl3x_nvTdu_oyj1cAklIPvOdYSaTZa8hmEDM4aeN70OrmsnOt3YCIIMAwSfZORQYFQwB_PTkfJa9iHEDAMUlY8-zM8QpAyXg59nlNF-osLLF0qjG5tOkeBtdzH2dz7c7Zbr8Ki0-5F-cirbKvx-95kvb1MXMdapzvo0vs2e1aqJ9NewX2a-ry5-zb8Xi-ut8Nl0UhiPaFZorgktFmRK15pxrzStrBYEaaaKtFhAhbrSpy5Ibg2rKCKvKmirMTJUwfJG9PeruGh_lkIEoYQkJpGkFiZgficqrjdwFt1XhVnrl5OHCh5VUoXOmsRJWhGKmtShLShBTaSBGBAOVQAJAnbQ-D956vbWVsW0XVDMSHb-0bi1X_o8kQghARRL4MAgEf9Pb2Mmti8Y2jWqt7w9xC4gZeRxKWElQyRL67j_04UQM1CrVVbq29ilEsxeVU8Ig5QJzmqjJA1Sald06k35W7dL9yODjyCAxnf3brVQfo5wvfzyevf49Zt-fsGurmm4dfdMfvtcYJEfQBB9jsPV9PSCQ-8a4y4bcN4YcGiOZvTmt5b3RXSfgfyuyBZ0</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1814151810</pqid></control><display><type>article</type><title>A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations</title><source>MEDLINE</source><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>PubMed Central</source><source>Free Full-Text Journals in Chemistry</source><source>Public Library of Science (PLoS)</source><creator>Chorus, Caspar ; Waltman, Ludo</creator><creatorcontrib>Chorus, Caspar ; Waltman, Ludo</creatorcontrib><description>Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0161021</identifier><identifier>PMID: 27560807</identifier><language>eng</language><publisher>United States: Public Library of Science</publisher><subject>Bibliometrics ; Biology and Life Sciences ; Biomedical Research - trends ; Cartels ; Citation analysis ; Citation indexes ; Coercivity ; Editorials ; Empirical analysis ; Engineering and Technology ; Impact analysis ; Impact factors ; Information science ; Information systems ; Journal Impact Factor ; Malpractice ; Medicine and Health Sciences ; Physical Sciences ; Publishing ; Research and Analysis Methods ; Research Design ; Scholarly publishing ; Science ; Scientometrics ; Self citation ; Social Sciences ; Studies ; Trends</subject><ispartof>PloS one, 2016-08, Vol.11 (8), p.e0161021-e0161021</ispartof><rights>COPYRIGHT 2016 Public Library of Science</rights><rights>2016 Chorus, Waltman. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2016 Chorus, Waltman 2016 Chorus, Waltman</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c725t-b7a438a56a9fb777bb7dee941b2b4beb91227cbcf887cc2f5646d8f5a36cd9413</citedby><orcidid>0000-0002-6380-4853</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC4999059/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC4999059/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,723,776,780,860,881,2096,2915,23845,27901,27902,53766,53768,79569,79570</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/27560807$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Chorus, Caspar</creatorcontrib><creatorcontrib>Waltman, Ludo</creatorcontrib><title>A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations</title><title>PloS one</title><addtitle>PLoS One</addtitle><description>Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings.</description><subject>Bibliometrics</subject><subject>Biology and Life Sciences</subject><subject>Biomedical Research - trends</subject><subject>Cartels</subject><subject>Citation analysis</subject><subject>Citation indexes</subject><subject>Coercivity</subject><subject>Editorials</subject><subject>Empirical analysis</subject><subject>Engineering and Technology</subject><subject>Impact analysis</subject><subject>Impact factors</subject><subject>Information science</subject><subject>Information systems</subject><subject>Journal Impact Factor</subject><subject>Malpractice</subject><subject>Medicine and Health Sciences</subject><subject>Physical Sciences</subject><subject>Publishing</subject><subject>Research and Analysis Methods</subject><subject>Research Design</subject><subject>Scholarly publishing</subject><subject>Science</subject><subject>Scientometrics</subject><subject>Self citation</subject><subject>Social Sciences</subject><subject>Studies</subject><subject>Trends</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>BENPR</sourceid><sourceid>DOA</sourceid><recordid>eNqNk9-LEzEQxxdRvPP0PxBdEEQftuZ3Ni9CLXdaKRxY9TUk2Wybst30kl3x_nvTdu_oyj1cAklIPvOdYSaTZa8hmEDM4aeN70OrmsnOt3YCIIMAwSfZORQYFQwB_PTkfJa9iHEDAMUlY8-zM8QpAyXg59nlNF-osLLF0qjG5tOkeBtdzH2dz7c7Zbr8Ki0-5F-cirbKvx-95kvb1MXMdapzvo0vs2e1aqJ9NewX2a-ry5-zb8Xi-ut8Nl0UhiPaFZorgktFmRK15pxrzStrBYEaaaKtFhAhbrSpy5Ibg2rKCKvKmirMTJUwfJG9PeruGh_lkIEoYQkJpGkFiZgficqrjdwFt1XhVnrl5OHCh5VUoXOmsRJWhGKmtShLShBTaSBGBAOVQAJAnbQ-D956vbWVsW0XVDMSHb-0bi1X_o8kQghARRL4MAgEf9Pb2Mmti8Y2jWqt7w9xC4gZeRxKWElQyRL67j_04UQM1CrVVbq29ilEsxeVU8Ig5QJzmqjJA1Sald06k35W7dL9yODjyCAxnf3brVQfo5wvfzyevf49Zt-fsGurmm4dfdMfvtcYJEfQBB9jsPV9PSCQ-8a4y4bcN4YcGiOZvTmt5b3RXSfgfyuyBZ0</recordid><startdate>20160825</startdate><enddate>20160825</enddate><creator>Chorus, Caspar</creator><creator>Waltman, Ludo</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AEUYN</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-6380-4853</orcidid></search><sort><creationdate>20160825</creationdate><title>A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations</title><author>Chorus, Caspar ; Waltman, Ludo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c725t-b7a438a56a9fb777bb7dee941b2b4beb91227cbcf887cc2f5646d8f5a36cd9413</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Bibliometrics</topic><topic>Biology and Life Sciences</topic><topic>Biomedical Research - trends</topic><topic>Cartels</topic><topic>Citation analysis</topic><topic>Citation indexes</topic><topic>Coercivity</topic><topic>Editorials</topic><topic>Empirical analysis</topic><topic>Engineering and Technology</topic><topic>Impact analysis</topic><topic>Impact factors</topic><topic>Information science</topic><topic>Information systems</topic><topic>Journal Impact Factor</topic><topic>Malpractice</topic><topic>Medicine and Health Sciences</topic><topic>Physical Sciences</topic><topic>Publishing</topic><topic>Research and Analysis Methods</topic><topic>Research Design</topic><topic>Scholarly publishing</topic><topic>Science</topic><topic>Scientometrics</topic><topic>Self citation</topic><topic>Social Sciences</topic><topic>Studies</topic><topic>Trends</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chorus, Caspar</creatorcontrib><creatorcontrib>Waltman, Ludo</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Gale In Context: Opposing Viewpoints</collection><collection>Gale In Context: Science</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Nursing & Allied Health Database</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest One Sustainability</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Materials Science Database</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agricultural Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials Science Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chorus, Caspar</au><au>Waltman, Ludo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations</atitle><jtitle>PloS one</jtitle><addtitle>PLoS One</addtitle><date>2016-08-25</date><risdate>2016</risdate><volume>11</volume><issue>8</issue><spage>e0161021</spage><epage>e0161021</epage><pages>e0161021-e0161021</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings.</abstract><cop>United States</cop><pub>Public Library of Science</pub><pmid>27560807</pmid><doi>10.1371/journal.pone.0161021</doi><tpages>e0161021</tpages><orcidid>https://orcid.org/0000-0002-6380-4853</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1932-6203 |
| ispartof | PloS one, 2016-08, Vol.11 (8), p.e0161021-e0161021 |
| issn | 1932-6203 1932-6203 |
| language | eng |
| recordid | cdi_plos_journals_1814151810 |
| source | MEDLINE; DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; PubMed Central; Free Full-Text Journals in Chemistry; Public Library of Science (PLoS) |
| subjects | Bibliometrics Biology and Life Sciences Biomedical Research - trends Cartels Citation analysis Citation indexes Coercivity Editorials Empirical analysis Engineering and Technology Impact analysis Impact factors Information science Information systems Journal Impact Factor Malpractice Medicine and Health Sciences Physical Sciences Publishing Research and Analysis Methods Research Design Scholarly publishing Science Scientometrics Self citation Social Sciences Studies Trends |
| title | A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-16T03%3A04%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Large-Scale%20Analysis%20of%20Impact%20Factor%20Biased%20Journal%20Self-Citations&rft.jtitle=PloS%20one&rft.au=Chorus,%20Caspar&rft.date=2016-08-25&rft.volume=11&rft.issue=8&rft.spage=e0161021&rft.epage=e0161021&rft.pages=e0161021-e0161021&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0161021&rft_dat=%3Cgale_plos_%3EA461579375%3C/gale_plos_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1814151810&rft_id=info:pmid/27560807&rft_galeid=A461579375&rft_doaj_id=oai_doaj_org_article_1d4536bb9885426aaaa264960d92901b&rfr_iscdi=true |