The Leiden ranking 2011/2012: Data collection, indicators, and interpretation

The Leiden Ranking 2011/2012 is a ranking of universities based on bibliometric indicators of publication output, citation impact, and scientific collaboration. The ranking includes 500 major universities from 41 different countries. This paper provides an extensive discussion of the Leiden Ranking 2011/2012. The ranking is compared with other global university rankings, in particular the Academic Ranking of World Universities (commonly known as the Shanghai Ranking) and the Times Higher Education World University Rankings. The comparison focuses on the methodological choices underlying the different rankings. Also, a detailed description is offered of the data collection methodology of the Leiden Ranking 2011/2012 and of the indicators used in the ranking. Various innovations in the Leiden Ranking 2011/2012 are presented. These innovations include (1) an indicator based on counting a university's highly cited publications, (2) indicators based on fractional rather than full counting of collaborative publications, (3) the possibility of excluding non-English language publications, and (4) the use of stability intervals. Finally, some comments are made on the interpretation of the ranking and a number of limitations of the ranking are pointed out. © 2012 Wiley Periodicals, Inc.

• Publication year

  2012

• Venue

  J. Assoc. Inf. Sci. Technol.

• Publication date

  2012-02-17

• Fields of study

  Computer Science, Economics, Education

• Identifiers
  DOI 10.1002/asi.22708arXiv 1202.3941
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Global University* Rankings and Their Impact

  2014cited by this paper
• Reply to Comments

  2013influential reference
• Ranking national research systems by citation indicators. A comparative analysis using whole and fractionalised counting methods

  2012cited by this paper
• Multidimensional ranking : the design and development of u-multirank

  2012influential reference
• Kitap Değerlendirmesi: Global University Rankings and Their Impact / A. Rauhvargers, 2011

  2011cited by this paper
• The effects and their stability of field normalization baseline on relative performance with respect to citation impact: A case study of 20 natural science departments

  2011cited by this paper
• Testing differences statistically with the Leiden ranking

  2011cited by this paper
• Globalisation of science in kilometres

  2011cited by this paper
• The new Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011

  2011cited by this paper
• Rickety numbers: Volatility of university rankings and policy implications

  2011influential reference
• A ranking of universities should account for differences in their disciplinary specialization

  2011cited by this paper
• Joint Research Publications: A Performance Indicator of University-Industry Collaboration

  2011influential reference
• Non-English papers decrease rankings

  2011cited by this paper
• Collaborations span 1,553 kilometres

  2011cited by this paper
• Caveats for using statistical significance tests in research assessments

  2011cited by this paper
• Severe language effect in university rankings: particularly Germany and France are wronged in citation-based rankings

  2010influential reference
• Too much noise in the Times Higher Education rankings

  2010cited by this paper
• University rankings smarten up

  2010cited by this paper
• Uncovering excellence in academic rankings: a closer look at the Shanghai ranking

  2010cited by this paper
• Towards a new crown indicator: Some theoretical considerations

  2010cited by this paper
• Multidimensional ranking: a new transparency tool for higher education and research

  2010influential reference
• Should you believe in the Shanghai ranking?

  2010cited by this paper
• Comparing university rankings

  2010cited by this paper
• Comment: Citation Statistics

  2009cited by this paper
• Important factors when interpreting bibliometric rankings of world universities: an example from oncology

  2008cited by this paper
• Comparisons of results of publication counting using different methods

  2008cited by this paper
• A short history of SHELX.

  2008cited by this paper
• Learning to Live with League Tables and Ranking: The Experience of Institutional Leaders

  2008cited by this paper
• Webometric Ranking of World Universities: Introduction, Methodology, and Future Developments

  2008cited by this paper
• International ranking systems for universities and institutions: a critical appraisal

  2007influential reference
• The Impact of League Tables and Ranking Systems on Higher Education Decision Making

  2007cited by this paper
• The world-class university and ranking : aiming beyond status

  2007cited by this paper
• Who Ranks the University Rankers?

  2007cited by this paper
• An Introduction to the Bootstrap

  2007cited by this paper
• Irreproducibility of the results of the Shanghai academic ranking of world universities

  2007cited by this paper
• A World of Difference: A Global Survey of University League Tables. Canadian Education Report Series.

  2006cited by this paper
• Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods

  2005cited by this paper
• The Academic Ranking of World Universities.

  2005cited by this paper
• Reply to the comments of Liu et al.

  2005influential reference
• Academic ranking of world universities using scientometrics  - A comment to the “Fatal Attraction”

  2005cited by this paper
• Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?

  2002cited by this paper
• Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance

  2001cited by this paper
• Attention!

  1998cited by this paper
• Change for the better

  1993cited by this paper
• Change for the better

  1973influential reference
• Too Much Noise

  1967influential reference

• Science-wide mapping and ranking of institutions based on affiliated authors’ impact and research integrity indicators

  2026cites this paper
• Global Trends in COPD Self-Management Research: A Dual-Perspective Bibliometric Analysis (January 2005–July 2025)

  2026cites this paper
• Panic‐Buying Behavior Is No More a Cosmetic Behavior: A Bibliometric Review and Future Research Agenda

  2026cites this paper
• Finding “similar” universities using ChatGPT for institutional benchmarking: A large‐scale comparison of European universities

  2025cites this paper
• Multilevel analysis of the scientific trajectory of BIM: insights from SciVal and cumulative capability development perspective

  2025cites this paper
• Is OpenAlex suitable for research quality evaluation and which citation indicator is best?

  2025cites this paper
• Internationalization of Higher Education: Science Mapping the Knowledge Base (1929–2022)

  2025cites this paper
• Evolution and effect of meeting abstracts in JCR journals

  2025cites this paper
• Mapping Agricultural Sustainability Through Life Cycle Assessment: A Narrative Review

  2025cites this paper
• Study the Advantages of MSME Products with A Bibliometric Approach

  2025cites this paper
• Sentiment Classification of Emoji and Text: An Analysis of Model Families, Fusion Strategies, and Performance Gains

  2025cites this paper
• Investigating the research output of institutions

  2025cites this paper
• Bibliometric Analysis of the 100 Most-Cited Clinical Trials on Gingival Recession Treatment: Trends in Flap Design, Biomaterials, and Global Contributions

  2025cites this paper
• The unequal dividend: gender differences in early-career researchers’ performance gains from international mobility

  2025cites this paper
• Telehealth in physiotherapy is moving towards equitable authorship: a bibliometric study

  2025cites this paper
• How similar are field-normalized citation impact scores obtained from OpenAlex and three popular commercial databases? An empirical comparison based on large German universities

  2025cites this paper
• China's rise as global scientific powerhouse: A trajectory of international collaboration and specialization in high-impact research

  2025cites this paper
• The attention inequality of scientists: A core-periphery structure perspective

  2025cites this paper
• How to Publish Research Papers in SCOPUS-Indexed General and Educational Journals

  2025influential citation
• Evolving Tools for Assessing and Mapping Scientific Research Landscapes

  2025cites this paper
• Freshness, Persistence and Success of Scientific Teams

  2025cites this paper
• The use of OpenAlex to produce meaningful bibliometric global overlay maps of science on the individual, institutional, and national levels

  2024cites this paper
• Global Ranking of Expertise about Russia

  2024cites this paper
• Citation distributions and research evaluations: The impossibility of formulating a universal indicator

  2024cites this paper
• Top 100 highly cited sustainability researchers

  2024cites this paper
• Research Among People Living With Dementia or Mild Cognitive Impairment in Physiotherapy Journals: A Scoping Review.

  2024cites this paper
• China's Rise as Global Scientific Powerhouse: A Trajectory of International Collaboration and Specialization in High-Impact Research

  2024cites this paper
• Microfinance Institutions and Corporate Social Responsibility. A scientometric study

  2024cites this paper
• Errors of measurement in scientometrics: classification schemes and document types in citation and publication rankings

  2024influential citation
• Wkład naukowców w ranking IDUB (Inicjatywa Doskonałości – Uczelnia Badawcza). Polscy badacze w Google Scholar

  2024cites this paper
• Geography of authorship: How geography shapes authorship attribution in big team science

  2024cites this paper
• Visualization of the Stingless Bee Research in Southeast Asia Region through Bibliometric Analysis using Scopus Database from 1984 to 2022

  2024cites this paper
• Possibilities for ranking business schools and considerations concerning the stability of such rankings

  2024influential citation
• Anatomy of the top 1% most highly cited publications: An empirical comparison of two approaches

  2024cites this paper
• Mutual Influence in Citation and Cooperation Patterns

  2024cites this paper
• University Evaluation Through Graduate Employment Prediction: An Influence Based Graph Autoencoder Approach

  2024cites this paper
• The relevance of higher-order ties

  2024cites this paper
• Distinct citation distributions complicate research evaluations. A single indicator that universally reveals research efficiency cannot be formulated

  2024influential citation
• What Is the Impact of Releasing Code With Publications?: Statistics from the Machine Learning, Robotics, and Control Communities

  2024cites this paper
• Missing institutions in OpenAlex: possible reasons, implications, and solutions

  2024influential citation
• Bibliometric Analysis of Published Documents on Entrepreneurship in Basic Sciences (Physics, Chemistry, Biology)

  2023cites this paper
• Using Blockchain for Enabling Transparent, Traceable, and Trusted University Ranking Systems

  2023cites this paper
• Explaining the Paradox of World University Rankings in China: Higher Education Sustainability Analysis with Sentiment Analysis and LDA Topic Modeling

  2023cites this paper
• A Critical Review of Fire Tests and Safety Systems in Road Tunnels: Limitations and Open Points

  2023cites this paper
• Board’s financial expertise: a bibliometric analysis and future research agenda

  2023cites this paper
• Field-level differences in paper and author characteristics across all fields of science in Web of Science, 2000–2020

  2023cites this paper
• Quantifying the mover’s advantage: transatlantic migration, employment prestige, and scientific performance

  2023cites this paper
• Global trends in waste materials: A bibliometric analysis

  2023cites this paper
• : What, Why, Who?

  2023cites this paper
• The Use of UAVs for Morphological Coastal Change Monitoring—A Bibliometric Analysis

  2023cites this paper
• Uncertain research country rankings. Should we continue producing uncertain rankings?

  2023cites this paper
• Trends in invasive insect pest research: a bibliometric analysis

  2023cites this paper
• Scientific mobility, prestige and skill alignment in academic institutions

  2023cites this paper
• Data inaccuracy quantification and uncertainty propagation for bibliometric indicators

  2023influential citation
• Factors associating with or predicting more cited or higher quality journal articles: An Annual Review of Information Science and Technology (ARIST) paper

  2023cites this paper
• Research Assessment Based on the Number of top Researchers

  2023cites this paper
• Brics & Entrepreneurial Universities: A Brazilian Perspective

  2023cites this paper
• Universities of applied sciences’ EU research project participation through the lens of differentiation

  2023cites this paper
• From academic to media capital: To what extent does the scientific reputation of universities translate into Wikipedia attention?

  2023influential citation
• Relevance of document types in the scores’ calculation of a specific field-normalized indicator: Are the scores strongly dependent on or nearly independent of the document type handling?

  2022cites this paper
• Evolution of the thematic structure and main producers of physical therapy interventions research: A bibliometric analysis (1986 to 2017)

  2022cites this paper
• A Bibliometric Analysis of Research Publications of the Bucharest University of Economic Studies in Time of Pandemics: Implications for Teachers’ Professional Publishing Activity

  2022cites this paper
• Identifying gender disparities in research performance: the importance of comparing apples with apples

  2022cites this paper
• Development of Public Administration Research with a Bibliometric Analysis

  2022cites this paper
• A quality and popularity based ranking method for research datasets

  2022cites this paper
• Simulation of the h index use at university departments within the bibliometrics-based heuristics framework: Can the indicator be used to compare individual researchers?

  2022cites this paper
• Fractionalization of research impact reveals global trends in university collaboration

  2022cites this paper
• German cities with universities: Socioeconomic position and university performance

  2022cites this paper
• Reasons and consequences of changes in Russian research assessment policies

  2022cites this paper
• Sustainability Committee Research: A Bibliometric Study

  2022cites this paper
• Indicators of research quality, quantity, openness, and responsibility in institutional review, promotion, and tenure policies across seven countries

  2022cites this paper
• In which fields are citations indicators of research quality?

  2022cites this paper
• A bibliometric and visualization-based analysis of temozolomide research hotspots and frontier evolution

  2022cites this paper
• A heuristic approach based on Leiden rankings to identify outliers: evidence from Italian universities in the European landscape

  2022cites this paper
• Mapping the field of physical therapy and identification of the leading active producers. A bibliometric analysis of the period 2000- 2018

  2022cites this paper
• Citations and References: Guidelines on Literature Practices

  2022cites this paper
• The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden

  2022cites this paper
• Opportunities and challenges for international institutional data comparisons

  2022cites this paper
• Kratom: A Bibliometric Analysis of Scientific Publications

  2022cites this paper
• International Journal of Instruction

  2022cites this paper
• Navigating the Trade-offs between Independence and Collaboration: A Network Analytic Method and Case Study

  2022cites this paper
• Author-level altmetrics for the evaluation of Chinese scholars

  2022cites this paper
• An anatomy of the academic ranking of world universities (Shanghai ranking)

  2022cites this paper
• Cui Bono? Cumulative Advantage in Open Access Publishing

  2022cites this paper
• Knowledge mapping of microfinance performance research: a bibliometric analysis

  2021cites this paper
• Sustainability practices in Spanish higher education institutions: An overview of status and implementation

  2021cites this paper
• Turkish-addressed social sciences citation index articles: What does the big picture tell us?

  2021cites this paper
• A Multicriteria Goal Programming Model for Ranking Universities

  2021cites this paper
• Analisis Bibliometrik dalam Penelitian Bidang Pendidikan: Teori dan Implementasi

  2021cites this paper
• Highly Cited Papers at the Spanish Domestic Level

  2021cites this paper
• Interpreting Bibliometric Data

  2021cites this paper
• Global citation inequality is on the rise

  2021cites this paper
• Mapping the impact of papers on various status groups: A new excellence mapping tool based on citation and reader scores

  2021cites this paper
• Total number of papers and in a single percentile fully describes research impact—Revisiting concepts and applications

  2021cites this paper
• Mapping trends and knowledge structure of energy efficiency research: what we know and where we are going

  2021cites this paper
• Laudation on the occasion of the presentation of the Derek de Solla Price Award 2021 to Prof. Ludo Waltman at the ISSI conference, Leuven, 2021

  2021cites this paper
• Researchers’ institutional mobility: bibliometric evidence on academic inbreeding and internationalization

  2021cites this paper
• How wide is the citation impact of scientific publications? A cross-discipline and large-scale analysis

  2021cites this paper
• (E-) Valuative Metrics as a Contested Field: A Comparative Analysis of the Altmetrics- and the Leiden Manifesto

  2021cites this paper
• Service composite quality as a strategic measure of patient well-being

  2021cites this paper