Large-scale analysis of micro-level citation patterns reveals nuanced selection criteria

Nat Hum Behav. 2019 Jun;3(6):568-575. doi: 10.1038/s41562-019-0585-7. Epub 2019 Apr 15.

Abstract

The analysis of citations to scientific publications has become a tool that is used in the evaluation of a researcher's work; especially in the face of an ever-increasing production volume1-6. Despite the acknowledged shortcomings of citation analysis and the ongoing debate on the meaning of citations7,8, citations are still primarily viewed as endorsements and as indicators of the influence of the cited reference, regardless of the context of the citation. However, only recently has attention9,10 been given to the connection between contextual information and the success of citing and cited papers, primarily because of the lack of extensive databases that cover both types of metadata. Here we address this issue by studying the usage of citations throughout the full text of 156,558 articles published by the Public Library of Science (PLoS), and by tracing their bibliometric history from among 60 million records obtained from the Web of Science. We find universal patterns of variation in the usage of citations across paper sections11. Notably, we find differences in microlevel citation patterns that were dependent on the ultimate impact of the citing paper itself; publications from high-impact groups tend to cite younger references, as well as more very young and better-cited references. Our study provides a quantitative approach to addressing the long-standing issue that not all citations count the same.

Publication types

  • Letter
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Bibliometrics*
  • Databases, Bibliographic
  • Humans
  • Periodicals as Topic / statistics & numerical data*
  • Research / statistics & numerical data*
  • Science / statistics & numerical data*