Can we use Google Scholar to identify highly-cited documents?

Martin-Martin, Alberto, Orduna-Malea, Enrico, Harzing, Anne-Wil ORCID logoORCID: https://orcid.org/0000-0003-1509-3003 and Delgado López-Cózar, Emilio (2017) Can we use Google Scholar to identify highly-cited documents? Journal of Informetrics, 11 (1) . pp. 152-163. ISSN 1751-1577 [Article] (doi:10.1016/j.joi.2016.11.008)

[img]
Preview
PDF - Final accepted version (with author's formatting)
Available under License Creative Commons Attribution-NonCommercial-NoDerivatives 4.0.

Download (1MB) | Preview

Abstract

The main objective of this paper is to empirically test whether the identification of highly-cited documents through Google Scholar is feasible and reliable. To this end, we carried out a longitudinal analysis (1950 to 2013), running a generic query (filtered only by year of publication) to minimise the effects of academic search engine optimisation. This gave us a final sample of 64,000 documents (1,000 per year). The strong correlation between a document’s citations and its position in the search results (r= -0.67) led us to conclude that Google Scholar is able to identify highly-cited papers effectively.

This, combined with Google Scholar’s unique coverage (no restrictions on document type and source), makes the academic search engine an invaluable tool for bibliometric research relating to the identification of the most influential scientific documents. We find evidence, however, that Google Scholar ranks those documents whose language (or geographical web domain) matches with the user’s interface language higher than could be expected based on citations. Nonetheless, this language effect and other factors related to the Google Scholar’s operation, i.e. the proper identification of versions and the date of publication, only have an incidental impact. They do not compromise the ability of Google Scholar to identify the highly-cited papers.

Item Type: Article
Keywords (uncontrolled): Google Scholar, academic search engines, highly-cited documents, academic information retrieval
Research Areas: A. > Business School > International Management and Innovation > International and Cross-cultural Management group
Item ID: 21047
Useful Links:
Depositing User: Anne-Wil Harzing
Date Deposited: 20 Dec 2016 09:30
Last Modified: 29 Nov 2022 21:14
URI: https://eprints.mdx.ac.uk/id/eprint/21047

Actions (login required)

View Item View Item

Statistics

Activity Overview
6 month trend
296Downloads
6 month trend
418Hits

Additional statistics are available via IRStats2.