How much do different ways of calculating percentiles influence the derived performance indicators? A case study

Bibliometric indicators can be determined by comparing specific citation records with the percentiles of a reference set. However, there exists an ambiguity in the computation of percentiles because usually a significant number of papers with the same citation count are found at the border between percentile rank classes. The present case study of the citations to the journal Europhysics Letters (EPL) in comparison with all physics papers from the Web of Science shows the deviations which occur due to the different ways of treating the tied papers in the evaluation of the percentage of highly cited publications. A strong bias can occur, if the papers tied at the threshold number of citations are all considered as highly cited or all considered as not highly cited.

• Publication year

  2013

• Venue

  Scientometrics

• Publication date

  2013-02-26

• Fields of study

  Physics, Computer Science

• Identifiers
  DOI 10.1007/s11192-013-0984-xarXiv 1302.6392
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Scientometrics

  2018cited by this paper
• Basic properties of both percentile rank scores and the I3 indicator

  2012cited by this paper
• On the calculation of percentile-based bibliometric indicators

  2012cited by this paper
• Inconsistencies of recently proposed citation impact indicators and how to avoid them

  2012cited by this paper
• Accounting for the Uncertainty in the Evaluation of Percentile Ranks

  2012influential reference
• The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits

  2012influential reference
• Uncertainties and ambiguities in percentiles and how to avoid them

  2012cited by this paper
• Turning the tables on citation analysis one more time: Principles for comparing sets of documents

  2011cited by this paper
• Integrated Impact Indicators (I3) compared with Impact Factors (IFs): An alternative research design with policy implications

  2011cited by this paper

• A field- and time-normalized Bayesian approach to measuring the impact of a publication

  2024cites this paper
• Methods for analyse performance in distributed systems

  2023cites this paper
• Quantifying revolutionary discoveries: Evidence from Nobel prize-winning papers

  2023cites this paper
• On some properties of medians, percentiles, baselines, and thresholds in empirical bibliometric analysis

  2022influential citation
• Total number of papers and in a single percentile fully describes research impact—Revisiting concepts and applications

  2021cites this paper
• How can citation impact in bibliometrics be normalized? A new approach combining citing-side normalization and citation percentiles

  2020cites this paper
• An Overview of Author-Level Indicators of Research Performance

  2019cites this paper
• Field normalization of scientometric indicators

  2018influential citation
• Research assessment by percentile-based double rank analysis

  2017influential citation
• Citation score normalized by cited references (CSNCR): The introduction of a new citation impact indicator

  2016cites this paper
• The precision of the arithmetic mean, geometric mean and percentiles for citation data: An experimental simulation modelling approach

  2015cites this paper
• A review of the literature on citation impact indicators

  2015cites this paper
• Supplementary Report I to the Independent Review of the Role of Metrics in Research Assessment and Management

  2015cites this paper
• Interrater reliability and convergent validity of F1000Prime peer review

  2014cites this paper
• Sampling issues in bibliometric analysis

  2014cites this paper
• Examples for counterintuitive behavior of the new citation-rank indicator P100 for bibliometric evaluations

  2014cites this paper
• How to improve the outcome of performance evaluations in terms of percentiles for citation frequencies of my papers

  2014cites this paper
• The substantive and practical significance of citation impact differences between institutions: Guidelines for the analysis of percentiles using effect sizes and confidence intervals

  2014cites this paper
• From P100 to P100': A new citation‐rank approach

  2014cites this paper
• A case study of the arbitrariness of the h-index and the highly-cited-publications indicator

  2013cites this paper
• From P100 to P100_: Conception and improvement of a new citation-rank approach in bibliometrics

  2013cites this paper
• Which percentile-based approach should be preferred for calculating normalized citation impact values? An empirical comparison of five approaches including a newly developed citation-rank approach (P100)

  2013cites this paper