Citation in the Electronic Age
December 15, 2014
Science is an example of the "standing on the shoulders of giants" metaphor. Starting from their textbooks, and continuing through the many journal articles that they read, scientists build on what has been discovered before them. Isaac Newton used this metaphor in a February 5, 1676, letter to Robert Hooke, and it's imprinted on the British two pound coin. Scientists are more neutral subjects for currency than politicians.
Scientists cite previous work in their publications, but they need to limit the number of these citations to those few that they think are especially relevant. Obviously, all planetary studies owe a deep debt of gratitude to Copernicus, but planetary scientists generally do not cite his "De revolutionibus orbium coelestium."
For the same "standing on shoulders" reason, recent research papers have more relevance as resources, so they're cited often after they're first published, but then fade into obscurity. As I wrote in a previous article (Modeling Scientific Citation, December 16, 2011), physicists from the University of Fribourg (Fribourg, Switzerland) found that the frequency of new citations that a paper receives declines dramatically after just a few years.[3-4] Examining the citations of 450,000 papers published from 1893 to 2009 in American Physical Society journals, they found that the citation frequency appears to be an exponential decay at longer times.
One of the more interesting things discovered by the Swiss physicists is the revelation that 60,000 of the 450,000 papers (13%) weren't cited at all, at least in APS journals in their dataset.[3-4] It appears that many scientists are like the vast majority of novelists, who devote many hundreds of man-hours to their work, carefully wording and proofing a publication that no one reads. In this respect, The Two Cultures are very similar, at least at the lower ranks.
Now that journal articles have become available online, has this new form of "reference library" influenced scientific citation? A 2008 study published in the Journal of the American Society for Information Science and Technology found that the age of cited articles has increased continuously since the mid-1960s; that is, researchers were referring to an increasingly older body of literature. It was found, also, that the easy availability of recent articles on arXiv had the opposite effect in some physics subfields. Scientists were just looking at what came easily to their desktops.
A recent study on this topic, posted on arXiv, confirms the finding of overall citation aging found in the 2008 study.[6-7] The seven member research team from Google, Inc., used Google Scholar tools[8-9] to study citations from articles published in the period 1990-2013. In their study, they defined an "older article" as being one that was published at least 10, 15, or 20 years before the citing article, and they calculated the fraction of older citations for these ranges.
The Google team found the following:
• Citation of older articles has grown substantially from 1990 to 2013. In 2013, 36% of citations were for articles at least 10 years old, up from 28% in 1990.
|Time decay of paper relevance, which is a function of its citations in 91-day intervals, as a function of time. The data are grouped into three sets, as defined in ref. 4. This is a simplified version of fig. 1 of ref. 4.|
• The increase over the second half of the period (2002-2013) was twice the increase for the first half (1990-2001).
• This trend exists for older articles, also. In 2013, 21% of citations were to articles 15 years old and older, an increase of 30% over the 1990 level. Thirteen percent of citations were to articles 20 years old or older, an increase of 36% over the 1990 level.
A graphical summary of one important result is shown in the figure.
The Google team ascribes the cause of this trend to the now easy way that relevant older articles can be accessed. I was fortunate in having spent my career at places with large university and corporate libraries, but that advantage is not held by all scientists. In this case, the Internet is the great equalizer.
|Fraction of citations to older articles in published research, where "older" is defined as either fifteen or twenty years. (Fig. 3 of ref. 6, redrawn for clarity, via arXiv.)|
- Two Pound Coin Designs and Specifications, The Royal Mint Limited, 2014.
- Steven A. Feller, "20th Century Physicists On Bank Notes," Radiations (Magazine of the Sigma Pi Sigma Physics Honor Society), Fall 2010 (0.5 MB PDF File).
- Matúê Medo, Giulio Cimini, and Stanislao Gualdi, "Temporal Effects in the Growth of Networks," Physical Review Letters, vol. 107, no. 23 (December 2, 2011), Document No. 238701 (4 pages).
- Matúê Medo, Giulio Cimini, and Stanislao Gualdi, "Temporal Effects in the Growth of Networks," arXiv Preprint Server, September 26, 2011.
- Vincent Larivière, Éric Archambault, and Yves Gingras, "Long-term variations in the aging of scientific literature: From exponential growth to steady-state science (1900–2004)," Journal of the American Society for Information Science and Technology, vol. 59, no. 2 (January 15, 2008), pp. 288-296.
- Alex Verstak, Anurag Acharya, Helder Suzuki, Sean Henderson, Mikhail Iakhiaev, Cliff Chiung Yu Lin, and Namit Shetty, "On the Shoulders of Giants: The Growing Impact of Older Articles," arXiv, November 2, 2014.
- John Bohannon, "Older papers are increasingly remembered—and cited," Science, November 4, 2014.
- Google Scholar Citations
- Google Scholar Metrics
Permanent Link to this article
Linked Keywords: Science; standing on the shoulders of giants; metaphor; textbook; scientific literature; journal article; scientist; Isaac Newton; Robert Hooke; Great Britain; British; pound; GBP; currency; coin; politician; academic publishing; publication; citation; planetary science; planetary studies; Copernicus; planetary scientist; De revolutionibus orbium coelestium; heliocentrism; Aristarchus of Samos; Wikimedia Commons; research; physicist; University of Fribourg (Fribourg, Switzerland); rate; frequency; American Physical Society journals; exponential decay; arXiv; Swiss; dataset; novel; novelist; man-hour; galley proof; proofing; The Two Cultures; Journal of the American Society for Information Science and Technology; 1960s; physics; Google, Inc.; Google Scholar; graphics; graphical; career; university; corporation; corporate; library; Internet.
Latest Books by Dev Gualtieri
Thanks to Cory Doctorow of BoingBoing for his favorable review of Secret Codes!
Blog Article Directory on a Single Page
- J. Robert Oppenheimer and Black Holes - April 24, 2017
- Modeling Leaf Mass - April 20, 2017
- Easter, Chicks and Eggs - April 13, 2017
- You, Robot - April 10, 2017
- Collisions - April 6, 2017
- Eugene Garfield (1925-2017) - April 3, 2017
- Old Fossils - March 30, 2017
- Levitation - March 27, 2017
- Soybean Graphene - March 23, 2017
- Income Inequality and Geometrical Frustration - March 20, 2017
- Wireless Power - March 16, 2017
- Trilobite Sex - March 13, 2017
- Freezing, Outside-In - March 9, 2017
- Ammonia Synthesis - March 6, 2017
- High Altitude Radiation - March 2, 2017
- C.N. Yang - February 27, 2017
- VOC Detection with Nanocrystals - February 23, 2017
- Molecular Fountains - February 20, 2017
- Jet Lag - February 16, 2017
- Highly Flexible Conductors - February 13, 2017
- Graphene Friction - February 9, 2017
- Dynamic Range - February 6, 2017
- Robert Boyle's To-Do List for Science - February 2, 2017
- Nanowire Ink - January 30, 2017
- Random Triangles - January 26, 2017
- Torricelli's law - January 23, 2017
- Magnetic Memory - January 19, 2017
- Graphene Putty - January 16, 2017
- Seahorse Genome - January 12, 2017
- Infinite c - January 9, 2017
- 150 Years of Transatlantic Telegraphy - January 5, 2017
- Cold Work on the Nanoscale - January 2, 2017
- Holidays 2016 - December 22, 2016
- Ballistics - December 19, 2016
- Salted Frogs - December 15, 2016
- Negative Thermal Expansion - December 12, 2016
- Verbal Cues and Stereotypes - December 8, 2016
- Capacitance Sensing - December 5, 2016
- Gallium Nitride Tribology - December 1, 2016
- Lunar Origin - November 27, 2016
- Pumpkin Propagation - November 24, 2016
- Math Anxiety - November 21, 2016
- Borophene - November 17, 2016
- Forced Innovation - November 14, 2016
- Combating Glare - November 10, 2016
- Solar Tilt and Planet Nine - November 7, 2016
- The Proton Size Problem - November 3, 2016
- Coffee Acoustics and Espresso Foam - October 31, 2016
- SnIP - An Inorganic Double Helix - October 27, 2016
- Seymour Papert (1928-2016) - October 24, 2016
- Mapping the Milky Way - October 20, 2016
- Electromagnetic Shielding - October 17, 2016
- The Lunacy of the Cows - October 13, 2016
- Random Coprimes and Pi - October 10, 2016
- James Cronin (1931-2016) - October 6, 2016
- The Ubiquitous Helix - October 3, 2016
- The Five-Second Rule - September 29, 2016
- Resistor Networks - September 26, 2016
- Brown Dwarfs - September 22, 2016
- Intrusion Rheology - September 19, 2016
- Falsifiability - September 15, 2016
- Fifth Force - September 12, 2016
- Renal Crystal Growth - September 8, 2016
- The Normality of Pi - September 5, 2016
- Metering Electrical Power - September 1, 2016
Deep Archive 2006-2008