The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute

In the humanities and social sciences, bibliometric methods for the assessment of research performance are (so far) less common. This study uses a concrete example in an attempt to evaluate a research institute from the area of social sciences and humanities with the help of data from Google Scholar...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of the Association for Information Science and Technology 2016-11, Vol.67 (11), p.2778-2789
Hauptverfasser: Bornmann, Lutz, Thor, Andreas, Marx, Werner, Schier, Hermann
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2789
container_issue 11
container_start_page 2778
container_title Journal of the Association for Information Science and Technology
container_volume 67
creator Bornmann, Lutz
Thor, Andreas
Marx, Werner
Schier, Hermann
description In the humanities and social sciences, bibliometric methods for the assessment of research performance are (so far) less common. This study uses a concrete example in an attempt to evaluate a research institute from the area of social sciences and humanities with the help of data from Google Scholar (GS). In order to use GS for a bibliometric study, we developed procedures for the normalization of citation impact, building on the procedures of classical bibliometrics. In order to test the convergent validity of the normalized citation impact scores, we calculated normalized scores for a subset of the publications based on data from the Web of Science (WoS) and Scopus. Even if scores calculated with the help of GS and the WoS/Scopus are not identical for the different publication types (considered here), they are so similar that they result in the same assessment of the institute investigated in this study: For example, the institute's papers whose journals are covered in the WoS are cited at about an average rate (compared with the other papers in the journals).
doi_str_mv 10.1002/asi.23627
format Article
fullrecord <record><control><sourceid>proquest_wiley</sourceid><recordid>TN_cdi_proquest_miscellaneous_1845809108</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1845809108</sourcerecordid><originalsourceid>FETCH-LOGICAL-i3017-c99486e7567d283ac3de0a8ac41de8252d48f8b93db407a95f5951a8218a4fdc3</originalsourceid><addsrcrecordid>eNpFkUFv1DAQhSMEElXpgX_gI5e0dhwnDrdVgaVSVUAt6tGa2JPugBMH24Eu_4__1e0ulNO8w_vePOkVxWvBTwXn1RkkOq1kU7XPiqNKSl6KppbPn7RUL4uTlL5xzgXvtKrEUfHnZoMM5tmThUxhYmFgPfWewog5kk0sBxYxIUS7YfgT_HLw0cTyDt0sI0yUCRODybEULIFnyRJOFtNbtpoY3s8-RMghblnKi9uyJdF0x6YQR_D0Gx1bh3DnkV3bTfAQmYMMbAhx_2Fe-n_l0mM7-F-HppQpLxlfFS8G8AlP_t7j4uuH9zfnH8vLT-uL89VlSZKLtrRdV-sGW9W0rtISrHTIQYOthUNdqcrVetB9J11f8xY6NahOCdCV0FAPzsrj4s0hd47hx4Ipm5GSRe9hwrAkI3StNO8E1zvr2cH6izxuzRxphLg1gpvHqcxuKrOfyqyuL_ZiR5QHglLG-ycC4nfTtLJV5vZqbfiXdX0r1WfzTj4AIvicyA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1845809108</pqid></control><display><type>article</type><title>The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute</title><source>Wiley Online Library Journals Frontfile Complete</source><source>Business Source Complete</source><creator>Bornmann, Lutz ; Thor, Andreas ; Marx, Werner ; Schier, Hermann</creator><creatorcontrib>Bornmann, Lutz ; Thor, Andreas ; Marx, Werner ; Schier, Hermann</creatorcontrib><description>In the humanities and social sciences, bibliometric methods for the assessment of research performance are (so far) less common. This study uses a concrete example in an attempt to evaluate a research institute from the area of social sciences and humanities with the help of data from Google Scholar (GS). In order to use GS for a bibliometric study, we developed procedures for the normalization of citation impact, building on the procedures of classical bibliometrics. In order to test the convergent validity of the normalized citation impact scores, we calculated normalized scores for a subset of the publications based on data from the Web of Science (WoS) and Scopus. Even if scores calculated with the help of GS and the WoS/Scopus are not identical for the different publication types (considered here), they are so similar that they result in the same assessment of the institute investigated in this study: For example, the institute's papers whose journals are covered in the WoS are cited at about an average rate (compared with the other papers in the journals).</description><identifier>ISSN: 2330-1635</identifier><identifier>EISSN: 2330-1643</identifier><identifier>DOI: 10.1002/asi.23627</identifier><language>eng</language><publisher>Blackwell Publishing Ltd</publisher><subject>Assessments ; Bibliometrics ; Buildings ; Concretes ; Documents ; Mathematical analysis ; Research facilities ; Scientific papers</subject><ispartof>Journal of the Association for Information Science and Technology, 2016-11, Vol.67 (11), p.2778-2789</ispartof><rights>2016 ASIS&amp;T</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fasi.23627$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fasi.23627$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,777,781,1412,27905,27906,45555,45556</link.rule.ids></links><search><creatorcontrib>Bornmann, Lutz</creatorcontrib><creatorcontrib>Thor, Andreas</creatorcontrib><creatorcontrib>Marx, Werner</creatorcontrib><creatorcontrib>Schier, Hermann</creatorcontrib><title>The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute</title><title>Journal of the Association for Information Science and Technology</title><addtitle>J Assn Inf Sci Tec</addtitle><description>In the humanities and social sciences, bibliometric methods for the assessment of research performance are (so far) less common. This study uses a concrete example in an attempt to evaluate a research institute from the area of social sciences and humanities with the help of data from Google Scholar (GS). In order to use GS for a bibliometric study, we developed procedures for the normalization of citation impact, building on the procedures of classical bibliometrics. In order to test the convergent validity of the normalized citation impact scores, we calculated normalized scores for a subset of the publications based on data from the Web of Science (WoS) and Scopus. Even if scores calculated with the help of GS and the WoS/Scopus are not identical for the different publication types (considered here), they are so similar that they result in the same assessment of the institute investigated in this study: For example, the institute's papers whose journals are covered in the WoS are cited at about an average rate (compared with the other papers in the journals).</description><subject>Assessments</subject><subject>Bibliometrics</subject><subject>Buildings</subject><subject>Concretes</subject><subject>Documents</subject><subject>Mathematical analysis</subject><subject>Research facilities</subject><subject>Scientific papers</subject><issn>2330-1635</issn><issn>2330-1643</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><recordid>eNpFkUFv1DAQhSMEElXpgX_gI5e0dhwnDrdVgaVSVUAt6tGa2JPugBMH24Eu_4__1e0ulNO8w_vePOkVxWvBTwXn1RkkOq1kU7XPiqNKSl6KppbPn7RUL4uTlL5xzgXvtKrEUfHnZoMM5tmThUxhYmFgPfWewog5kk0sBxYxIUS7YfgT_HLw0cTyDt0sI0yUCRODybEULIFnyRJOFtNbtpoY3s8-RMghblnKi9uyJdF0x6YQR_D0Gx1bh3DnkV3bTfAQmYMMbAhx_2Fe-n_l0mM7-F-HppQpLxlfFS8G8AlP_t7j4uuH9zfnH8vLT-uL89VlSZKLtrRdV-sGW9W0rtISrHTIQYOthUNdqcrVetB9J11f8xY6NahOCdCV0FAPzsrj4s0hd47hx4Ipm5GSRe9hwrAkI3StNO8E1zvr2cH6izxuzRxphLg1gpvHqcxuKrOfyqyuL_ZiR5QHglLG-ycC4nfTtLJV5vZqbfiXdX0r1WfzTj4AIvicyA</recordid><startdate>201611</startdate><enddate>201611</enddate><creator>Bornmann, Lutz</creator><creator>Thor, Andreas</creator><creator>Marx, Werner</creator><creator>Schier, Hermann</creator><general>Blackwell Publishing Ltd</general><scope>BSCLL</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>201611</creationdate><title>The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute</title><author>Bornmann, Lutz ; Thor, Andreas ; Marx, Werner ; Schier, Hermann</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i3017-c99486e7567d283ac3de0a8ac41de8252d48f8b93db407a95f5951a8218a4fdc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Assessments</topic><topic>Bibliometrics</topic><topic>Buildings</topic><topic>Concretes</topic><topic>Documents</topic><topic>Mathematical analysis</topic><topic>Research facilities</topic><topic>Scientific papers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bornmann, Lutz</creatorcontrib><creatorcontrib>Thor, Andreas</creatorcontrib><creatorcontrib>Marx, Werner</creatorcontrib><creatorcontrib>Schier, Hermann</creatorcontrib><collection>Istex</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Journal of the Association for Information Science and Technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bornmann, Lutz</au><au>Thor, Andreas</au><au>Marx, Werner</au><au>Schier, Hermann</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute</atitle><jtitle>Journal of the Association for Information Science and Technology</jtitle><addtitle>J Assn Inf Sci Tec</addtitle><date>2016-11</date><risdate>2016</risdate><volume>67</volume><issue>11</issue><spage>2778</spage><epage>2789</epage><pages>2778-2789</pages><issn>2330-1635</issn><eissn>2330-1643</eissn><abstract>In the humanities and social sciences, bibliometric methods for the assessment of research performance are (so far) less common. This study uses a concrete example in an attempt to evaluate a research institute from the area of social sciences and humanities with the help of data from Google Scholar (GS). In order to use GS for a bibliometric study, we developed procedures for the normalization of citation impact, building on the procedures of classical bibliometrics. In order to test the convergent validity of the normalized citation impact scores, we calculated normalized scores for a subset of the publications based on data from the Web of Science (WoS) and Scopus. Even if scores calculated with the help of GS and the WoS/Scopus are not identical for the different publication types (considered here), they are so similar that they result in the same assessment of the institute investigated in this study: For example, the institute's papers whose journals are covered in the WoS are cited at about an average rate (compared with the other papers in the journals).</abstract><pub>Blackwell Publishing Ltd</pub><doi>10.1002/asi.23627</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2330-1635
ispartof Journal of the Association for Information Science and Technology, 2016-11, Vol.67 (11), p.2778-2789
issn 2330-1635
2330-1643
language eng
recordid cdi_proquest_miscellaneous_1845809108
source Wiley Online Library Journals Frontfile Complete; Business Source Complete
subjects Assessments
Bibliometrics
Buildings
Concretes
Documents
Mathematical analysis
Research facilities
Scientific papers
title The application of bibliometrics to research evaluation in the humanities and social sciences: An exploratory study using normalized Google Scholar data for the publications of a research institute
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T19%3A40%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_wiley&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=The%20application%20of%20bibliometrics%20to%20research%20evaluation%20in%20the%20humanities%20and%20social%20sciences:%20An%20exploratory%20study%20using%20normalized%20Google%20Scholar%20data%20for%20the%20publications%20of%20a%20research%20institute&rft.jtitle=Journal%20of%20the%20Association%20for%20Information%20Science%20and%20Technology&rft.au=Bornmann,%20Lutz&rft.date=2016-11&rft.volume=67&rft.issue=11&rft.spage=2778&rft.epage=2789&rft.pages=2778-2789&rft.issn=2330-1635&rft.eissn=2330-1643&rft_id=info:doi/10.1002/asi.23627&rft_dat=%3Cproquest_wiley%3E1845809108%3C/proquest_wiley%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1845809108&rft_id=info:pmid/&rfr_iscdi=true