Citation Statistics

This is a report about the use and misuse of citation data in the assessment of scientific research. The idea that research assessment must be done using ``simple and objective'' methods is increasingly prevalent today. The ``simple and objective'' methods are broadly interpreted as bibliometrics, that is, citation data and the statistics derived from them. There is a belief that citation statistics are inherently more accurate because they substitute simple numbers for complex judgments, and hence overcome the possible subjectivity of peer review. But this belief is unfounded.

• Publication year

  2009

• Venue

  arXiv.org

• Publication date

  2009-10-19

• Fields of study

  Mathematics, Physics, Computer Science

• Identifiers
  DOI 10.1214/09-STS285arXiv 0910.3529
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A new methodology for ranking scientific institutions

  2008cited by this paper
• Effectiveness of Journal Ranking Schemes as a Tool for Locating Information

  2008cited by this paper
• Bemused by bibliometrics : using citation analysis to evaluate research quality

  2008cited by this paper
• Assessing Research in the Mathematical Sciences

  2007cited by this paper
• National scientific facilities and their science impact on nonbiomedical research

  2007cited by this paper
• Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar

  2007cited by this paper
• Aardvark et al.: quality journals and gamesmanship in management studies

  2007cited by this paper
• Generalized h-index for Disclosing Latent Facts in Citation Networks

  2006cited by this paper
• Measures for measures

  2006cited by this paper
• Citation indexes for science; a new dimension in documentation through association of ideas.

  2006cited by this paper
• Universal Behavior of a Research Productivity Index

  2005cited by this paper
• WHY THE IMPACT FACTOR OF JOURNALS SHOULD NOT BE USED FOR EVALUATING RESEARCH

  2005cited by this paper
• Is it possible to compare researchers with different scientific interests?

  2005cited by this paper
• An index to quantify an individual's scientific research output

  2005influential reference
• The number that's devouring science

  2005cited by this paper
• Impact factor: use and abuse.

  2004influential reference
• Performance indicators: good, bad, and ugly

  2004cited by this paper
• Citation counts and the Research Assessment Exercise V: Archaeology and the 2001 RAE

  2003cited by this paper
• Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists

  2002cited by this paper
• Show me the data!

  2001cited by this paper
• The Impact of Impact Factors

  2001cited by this paper
• History

  1999cited by this paper
• Why are the impacts of the leading medical journals so similar and yet so different? Item-by-item audits reveal a diversity of editorial material

  1998cited by this paper
• League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance

  1996cited by this paper
• The use of multiple indicators in the assessment of basic research

  1996cited by this paper
• Assessing basic research

  1993cited by this paper
• What do citations count? the rhetoric-first model

  1989cited by this paper
• Evidence of complex citer motivations

  1986cited by this paper
• JOURNAL RANKING AND SELECTION: A REVIEW IN PHYSICS

  1976cited by this paper
• Fifty Years

  1955cited by this paper

• Rethinking where and how we publish in health sciences

  2026cites this paper
• The SPR-Index: A Novel Metric Integrating the H-Index with Verified Peer Review Scores

  2025cites this paper
• A simple equation for rank-citation profiles

  2025cites this paper
• The Research Mind: A Multi-Dimensional Framework for Evaluating Research Quality, Productivity, and Integrity by Mitigating citation bias

  2025cites this paper
• Best Practices for Reproducibility, Research Assessment Reforms, and Implications for Experimental Economists

  2025cites this paper
• Writing to be read, or how to achieve more through less [Language Matters]

  2024cites this paper
• Evaluation of Research Productivity among Academic Glaucoma Specialists using the Relative Citation Ratio.

  2024cites this paper
• Are There Meaningful Prestige Metrics of Kinesiology-Related Journals?

  2024cites this paper
• Modeling citation concentration through a mixture of Leimkuhler curves

  2024cites this paper
• Research Outputs as Testimony & the APC as Testimonial Injustice in the Global South

  2023cites this paper
• Judging Importance before Checking Correctness: Quick Opinions in Mathematical Peer Review

  2023cites this paper
• Determinants of impact factor and Eigenfactor score in otolaryngology journals

  2023cites this paper
• Toward equitable open research: stakeholder co-created recommendations for research institutions, funders and researchers

  2023cites this paper
• pyBibX - A Python Library for Bibliometric and Scientometric Analysis Powered with Artificial Intelligence Tools

  2023cites this paper
• Synthesis of Publication Metrics in Kinesiology-Related Journals: Proxies for Rigor, Usage, and Prestige

  2023cites this paper
• Putting Fungal Biology and Biotechnology to the test

  2023cites this paper
• Evaluation of Research Productivity among Academic Vitreoretinal Surgeons using the Relative Citation Ratio.

  2023cites this paper
• Research, Reading, and Publication Habits of Nurses and Nursing Students Applied to Impact Journals: International Multicentre Study

  2023cites this paper
• Value dissonance in research(er) assessment: individual and perceived institutional priorities in review, promotion, and tenure

  2023cites this paper
• The role of citation networks to explain academic promotions: an empirical analysis of the Italian national scientific qualification

  2022cites this paper
• Text and Team: What Article Metadata Characteristics Drive Citations in Software Engineering?

  2022cites this paper
• International impact metric of Mathematics: determining leadership through scientific impact

  2022cites this paper
• Indicators of research quality, quantity, openness, and responsibility in institutional review, promotion, and tenure policies across seven countries

  2022cites this paper
• The Value of Data and Other Non-traditional Scholarly Outputs in Academic Review, Promotion, and Tenure in Canada and the United States

  2022cites this paper
• Promotion , and Tenure in Canada and the United States

  2022cites this paper
• Comparing the h-Index (Hirsch Index) of Nobel Laureates Scopus and Google Scholar Profiles in Chemistry and Economics Sciences

  2022cites this paper
• A simple model for citation curve

  2022cites this paper
• Poverty Research and its Discontents: Review and Discussion of Issues Raised in Dimensions of Poverty. Measurement, Epistemic Injustices and Social Activism (Beck, V., H.Hahn, and R.Lepenies eds., Springer, Cham, 2020)

  2021cites this paper
• Combatting the rise of paper mills

  2021cites this paper
• The relative citation ratio and the h-index among academic ophthalmologists: A retrospective cross-sectional analysis

  2021cites this paper
• Scientometric analysis of the Chaos journal (1991-2019): From descriptive statistics to complex networks viewpoints.

  2021cites this paper
• Symbolic capital and the basket of 8: What changed after the creation of the basket?

  2021cites this paper
• New perspectives in bibliometric indicators: Moving from citations to citing authors

  2021cites this paper
• Climate Change and Cultural Heritage: A Systematic Literature Review (2016–2020)

  2021cites this paper
• Performance Measurement: Issues, Approaches, and Opportunities

  2021cites this paper
• The Sci-Hub effect on papers’ citations

  2021cites this paper
• The End of Botany.

  2020cites this paper
• Nontraditional Approaches to Assessing Journal Importance: Case Study of Russian Journals on Earth Sciences

  2020cites this paper
• Journal- or article-based citation measure? A study of academic promotion at a Swiss university

  2020cites this paper
• National Lists of Scholarly Publication Channels: An Overview and Recommendations for Their Construction and Maintenance

  2020influential citation
• Tracking the cumulative knowledge spreading in a comprehensive citation network

  2020cites this paper
• Professional standards in bibliometric research evaluation? A meta-evaluation of European assessment practice 2005–2019

  2020cites this paper
• Quantitative science studies should be framed with middle-range theories and concepts from the social sciences

  2020cites this paper
• Citation inequality and the Journal Impact Factor: median, mean, (does it) matter?

  2020cites this paper
• Research Evaluation

  2020cites this paper
• Factors Influencing Publication Rates among Counselor Educators

  2020cites this paper
• Trends in Academic Neurological Spine Surgeon Productivity as Measured by the Relative Citation Ratio (RCR).

  2020cites this paper
• Authorship in top-ranked mathematical and physical journals: Role of gender on self-perceptions and bibliographic evidence

  2020cites this paper
• The "Distinguished" Physician-Scientist: Is a single bibliometric index sufficient for distinction?

  2020cites this paper
• Using Non-negative Tensor Decomposition for Unsupervised Textual Influence Modeling

  2019cites this paper
• A comprehensive approach to problems of performance measurement

  2019cites this paper
• Misconceptions surrounding the relationship between journal impact factor and citation distribution in veterinary medicine.

  2019cites this paper
• Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations

  2019cites this paper
• Ranking Accounting Journals by Topical Area and Methodology

  2019cites this paper
• Rooted citation graphs density metrics for research papers influence evaluation

  2019cites this paper
• Turning the tables: A university league-table based on quality not quantity

  2019cites this paper
• Corporate Culture in Academia and The Current Standards of Research Appraisal

  2019cites this paper
• Uptake and accumulation of pharmaceuticals and personal care products in leafy vegetables

  2019cites this paper
• Going beneath the shoulders of giants: tracking the cumulative knowledge spreading in a comprehensive citation network

  2019cites this paper
• Ten myths around open scholarly publishing

  2019cites this paper
• Corporate Culture in Academia and The Current Standards of Research Appraisal

  2019cites this paper
• Публикация научных работ: десять горячих тем

  2019cites this paper
• Ten Hot Topics around Scholarly Publishing

  2019cites this paper
• Evaluation of h-index and its citation intensity based variants in the field of mathematics

  2019cites this paper
• The Next 40 Years of Impact of the Food and Nutrition Bulletin

  2019cites this paper
• Mentoring Tenure-Track Faculty in Kinesiology

  2019cites this paper
• Scientific Communication of Russia in the Information Landscape of the Modern World

  2019cites this paper
• How significant are the public dimensions of faculty work in review, promotion and tenure documents?

  2019cites this paper
• Impact factor volatility due to a single paper: A comprehensive analysis

  2019cites this paper
• The Perception of Scientific Authorship Across Domains

  2018cites this paper
• Heuristics as conceptual lens for understanding and studying the usage of bibliometrics in research evaluation

  2018cites this paper
• Do citations and readership identify seminal publications?

  2018cites this paper
• Does bibliometric research confer legitimacy to research assessment practice? A sociological study of reputational control, 1972-2016

  2018cites this paper
• The Power of Scientometrics and the Development of Economics

  2018cites this paper
• The mismeasure of science: Citation analysis

  2018cites this paper
• The evaluation of scholarship in academic promotion and tenure processes: Past, present, and future

  2018cites this paper
• How to stop salami science: promotion of healthy trends in publishing behavior

  2018cites this paper
• La quantification de la recherche scientifique et ses enjeux : bases de données, indicateurs et cartographie des données bibliométriques

  2018cites this paper
• Prestigious Science Journals Struggle to Reach Even Average Reliability

  2018cites this paper
• Academic Social Network-Based Recommendation Approach for Knowledge Sharing

  2018cites this paper
• Mining scholarly publications for research evaluation

  2018cites this paper
• The future of scholarly publishing.

  2018cites this paper
• Publication incentives undermine the utility of science: Ecological research in Mexico

  2018influential citation
• How does research productivity relate to gender? Analyzing gender differences for multiple publication dimensions

  2018cites this paper
• CRIS with in-text citations as interactive entities

  2018cites this paper
• Impact Factors and the Central Limit Theorem

  2018cites this paper
• i The Complexity of Economies and Pluralism in

  2018cites this paper
• Nuevas aportaciones a la evaluación de la investigación:: la declaración de San Francisco

  2017cites this paper
• The influence of capitalism on the production of knowledge in nursing.

  2017cites this paper
• Different from Discipline to Discipline Diversity in the Scholarly Publication System

  2017cites this paper
• Citation analysis of scientific categories

  2017cites this paper
• Dérives de la recherche et détresse psychologique chez les universitaires

  2017cites this paper
• Gene Entity Recognition of Full Text Articles

  2017cites this paper
• Evaluation of citations: a proposition to supplement the corresponding rule book in Serbia

  2017cites this paper
• Math-Net.Ru All Russian mathematical portal

  2017cites this paper
• Leveraging Mathematical Subject Information to Enhance Bibliometric Data

  2017cites this paper
• Ranking in evolving complex networks

  2017cites this paper
• RTRS: a recommender system for academic researchers

  2017cites this paper
• The Complexity of Economies and Pluralism in Economics

  2017cites this paper
• Slightly dirty maths: The richly textured mechanisms of impact

  2017cites this paper