All metrics are equal, but some metrics are more equal than others: A systematic search and review on the use of the term ‘metric’

Objective To examine the use of the term ‘metric’ in health and social sciences’ literature, focusing on the interval scale implication of the term in Modern Test Theory (MTT). Materials and methods A systematic search and review on MTT studies including ‘metric’ or ‘interval scale’ was performed in the health and social sciences literature. The search was restricted to 2001–2005 and 2011–2015. A Text Mining algorithm was employed to operationalize the eligibility criteria and to explore the uses of ‘metric’. The paradigm of each included article (Rasch Measurement Theory (RMT), Item Response Theory (IRT) or both), as well as its type (Theoretical, Methodological, Teaching, Application, Miscellaneous) were determined. An inductive thematic analysis on the first three types was performed. Results 70.6% of the 1337 included articles were allocated to RMT, and 68.4% were application papers. Among the number of uses of ‘metric’, it was predominantly a synonym of ‘scale’; as adjective, it referred to measurement or quantification. Three incompatible themes ‘only RMT/all MTT/no MTT models can provide interval measures’ were identified, but ‘interval scale’ was considerably more mentioned in RMT than in IRT. Conclusion ‘Metric’ is used in many different ways, and there is no consensus on which MTT metric has interval scale properties. Nevertheless, when using the term ‘metric’, the authors should specify the level of the metric being used (ordinal, ordered, interval, ratio), and justify why according to them the metric is at that level.

• Publication year

  2018

• Venue

  PLoS ONE

• Publication date

  2018-03-06

• Fields of study

  Medicine, Mathematics

• Identifiers
  DOI 10.1371/journal.pone.0193861PMID 29509813PMCID 5839589
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Item Response Theory

  2018cited by this paper
• Minimal Clinically Important Difference as Applied in Rheumatology: An OMERACT Rasch Working Group Systematic Review and Critique

  2016cited by this paper
• Using Patient Health Questionnaire-9 item parameters of a common metric resulted in similar depression scores compared to independent item response theory model reestimation.

  2016cited by this paper
• Successful qualitative research: A practical guide for beginners

  2016cited by this paper
• An Activity Index for Raw Accelerometry Data and Its Comparison with Other Activity Metrics

  2016cited by this paper
• Multidimensional fatigue inventory and post-polio syndrome – a Rasch analysis

  2015cited by this paper
• Methodology for the development and calibration of the SCI-QOL item banks

  2015cited by this paper
• U.S. General Population Estimate for “Excellent” to “Poor” Self-Rated Health Item

  2015cited by this paper
• Linking Physical and Mental Health Summary Scores from the Veterans RAND 12-Item Health Survey (VR-12) to the PROMIS® Global Health Scale

  2015cited by this paper
• Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples.

  2015cited by this paper
• The Interaction of Ability Differences and Guessing When Modeling Differential Item Functioning With the Rasch Model

  2015cited by this paper
• Real and Artificial Differential Item Functioning in Polytomous Items

  2015cited by this paper
• Rasch‐ionale for neurologists

  2015cited by this paper
• Affective stress responses during leisure time: Validity evaluation of a modified version of the Stress-Energy Questionnaire

  2015cited by this paper
• Measuring individuals' response quality in self-administered psychological tests: an introduction to Gendre's functional method

  2015cited by this paper
• PARADISE 24: A Measure to Assess the Impact of Brain Disorders on People’s Lives

  2015cited by this paper
• Stevens’ forgotten crossroads: the divergent measurement traditions in the physical and psychological sciences from the mid-twentieth century

  2015cited by this paper
• Psychometric properties and adaptation of the ASRS in a Spanish sample of patients with substance use disorders: Application of two IRT Rasch models.

  2015cited by this paper
• Testing the PROMIS® Depression measures for monitoring depression in a clinical sample outside the US.

  2015cited by this paper
• The construction and validation of a developmental test for stage identification: Two exploratory studies.

  2014cited by this paper
• Generation of an Interval Metric Scale to Measure Attitude

  2014cited by this paper
• Some Thoughts about the Suitability of the Reliable Change Index (RCI) for Analysis of Ordinal Scale Data

  2014cited by this paper
• The English are healthier than the Americans: really?

  2014cited by this paper
• Quantification of Health by Scaling Similarity Judgments

  2014cited by this paper
• Calibration of the PROMIS Physical Function Item Bank in Dutch Patients with Rheumatoid Arthritis

  2014cited by this paper
• Differential item and test functioning methodology indicated that item response bias was not a substantial cause of country differences in mental well-being.

  2014cited by this paper
• IRT Model Misspecification and Measurement of Growth in Vertical Scaling.

  2014cited by this paper
• A Rasch analysis of the harm reduction self-efficacy questionnaire in Portugal.

  2014cited by this paper
• An Analysis of Item Response Theory and Rasch Models Based on the Most Probable Distribution Method

  2014cited by this paper
• Standardization of depression measurement: a common metric was developed for 11 self-report depression measures.

  2014cited by this paper
• Translation into Arabic of the Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 and validation in orthosis users

  2014cited by this paper
• A short tutorial on item response theory in rheumatology.

  2014cited by this paper
• Measuring the Contribution of Workers' Health and Psychosocial Work‐Environment on Production Efficiency

  2014cited by this paper
• Setting standards for severity of common symptoms in oncology using the PROMIS item banks and expert judgment

  2014cited by this paper
• Additive conjoint measurement and the resistance toward falsifiability in psychology

  2013cited by this paper
• Measuring Growth With Vertical Scales

  2013cited by this paper
• Attempting Measurement of Psychological Attributes

  2013cited by this paper
• Descriptive theories of behaviour may allow for the scientific measurement of psychological attributes

  2013cited by this paper
• An introduction to Rasch analysis for Psychiatric practice and research.

  2013cited by this paper
• A middle path between abandoning measurement and measurement theory

  2013cited by this paper
• Evaluating the Equal-Interval Hypothesis with Test Score Scales

  2013cited by this paper
• Career Decision Self-Efficacy Scale-Short Form: A Rasch Analysis of the Portuguese Version.

  2013cited by this paper
• The Gains From Vertical Scaling

  2013cited by this paper
• Implementation and assessment of Cognitive Load Theory (CLT) based questions in an electronic homework and testing system

  2013cited by this paper
• The Data Analytic Implications of Human Psychology's Dimensions Being Ordinally Scaled

  2013cited by this paper
• Best Practices for Measuring Students’ Attitudes toward Learning Science

  2013cited by this paper
• Developing and evaluating prediction models in rehabilitation populations.

  2012cited by this paper
• Health of the nation outcome scales evaluation in a community setting population

  2012cited by this paper
• Application of the Rasch model in measuring personality disorders.

  2012cited by this paper
• Real and Artificial Differential Item Functioning

  2012cited by this paper
• Can manual ability be measured with a generic ABILHAND scale? A cross-sectional study conducted on six diagnostic groups

  2012cited by this paper
• An Application of Explanatory Item Response Modeling for Model-Based Proficiency Scaling

  2012cited by this paper
• New Paradigm for Patient-Reported Outcomes Assessment in Foot & Ankle Research: Computerized Adaptive Testing

  2012cited by this paper
• Psychological measurement between physics and statistics

  2012cited by this paper
• Item set discrimination and the unit in the Rasch model.

  2012cited by this paper
• Environmental performance in the hotel sector: the case of the Western Canary Islands

  2012cited by this paper
• A psychometric measurement model for adult English language learners: Pearson Test of English Academic

  2012cited by this paper
• Alfred Binet and the Concept of Heterogeneous Orders†

  2012cited by this paper
• “The constantly recurring argument”: Inferring quantity from order

  2012cited by this paper
• Using the Graded Response Model to Control Spurious Interactions in Moderated Multiple Regression

  2012cited by this paper
• Strategies for assessment and outcome measurement in physical and rehabilitation medicine: an educational review.

  2011cited by this paper
• Cross-cultural validation of the Educational Needs Assessment Tool in RA in 7 European countries

  2011cited by this paper
• Road Maps for Learning: A Guide to the Navigation of Learning Progressions

  2011cited by this paper
• The Development of Gender Achievement Gaps in Mathematics and Reading During Elementary and Middle School

  2011cited by this paper
• Unified Balance Scale: an activity-based, bed to community, and aetiology-independent measure of balance calibrated with Rasch analysis.

  2011cited by this paper
• Generic ABILHAND questionnaire can measure manual ability across a variety of motor impairments

  2011cited by this paper
• Rasch analysis informed modifications to the Work Instability Scale for Rheumatoid Arthritis for use in work-related upper limb disorders.

  2011cited by this paper
• Understanding Rasch and Item Response Theory Models: Applications to the Estimation and Validation of Interval Latent Trait Measures from Responses to Rating Scale Questionnaires

  2011cited by this paper
• Rating scales and Rasch measurement

  2011cited by this paper
• An Analytic Comparison of Effect Sizes for Differential Item Functioning

  2011cited by this paper
• Psychological Measurement Needs Units, Ratios, and Real Quantities: A Commentary on Humphry

  2011cited by this paper
• Advanced Psychometric Methods for Developing and Evaluating Cut-Point-Based Indicators

  2011cited by this paper
• Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement

  2009cited by this paper
• A typology of reviews: an analysis of 14 review types and associated methodologies.

  2009cited by this paper
• Using Rasch scaled stage scores to validate orders of hierarchical complexity of balance beam task sequences.

  2008cited by this paper
• A parametric analysis of ordinal quality-of-life data can lead to erroneous results.

  2008cited by this paper
• Item response theory facilitated cocalibrating cognitive tests and reduced bias in estimated rates of decline.

  2008cited by this paper
• Attitudes, order and quantity: deterministic and direct probabilistic tests of unidimensional unfolding.

  2007cited by this paper
• An empirical study into the theory of unidimensional unfolding.

  2006cited by this paper
• Arbitrary Metrics Redux.

  2006cited by this paper
• Arbitrary metrics in psychology.

  2006cited by this paper
• Dynamic assessment of health outcomes: time to let the CAT out of the bag?

  2005cited by this paper
• A conceptual and psychometric framework for distinguishing categories and dimensions.

  2005cited by this paper
• Rethinking Psychosocial Constructs: Reply to Comments by Barrett, Kagan, and Maraun and Peters

  2005cited by this paper
• AN ALTERNATE APPROACH TO ASSESSING CROSS-CULTURAL MEASUREMENT EQUIVALENCE IN ADVERTISING RESEARCH

  2005cited by this paper
• Item Response Theory and the Measurement of Clinical Change

  2005cited by this paper
• Test Equating by Common Items and Common Subjects: Concepts and Applications

  2005cited by this paper
• Equating rehabilitation outcome scales: developing common metrics.

  2004cited by this paper
• Equating student satisfaction measures.

  2004cited by this paper
• Examining the effects of differential item (functioning and differential) test functioning on selection decisions: when are statistically significant effects practically important?

  2004cited by this paper
• Developing a follow-up survey focused on participation of children and youth with acquired brain injuries after discharge from inpatient rehabilitation

  2004cited by this paper
• Controversy and the Rasch Model: A Characteristic of Incompatible Paradigms?

  2004cited by this paper
• Why Psychometrics is Not Pathological

  2004cited by this paper
• A comparison of generalizability theory and many-facet Rasch measurement in an analysis of college sophomore writing

  2004cited by this paper
• IRT-Linked Standard Errors of Weighted Composites

  2004cited by this paper
• The impact of model misfit on partial credit model parameter estimates.

  2004cited by this paper
• A Discussion of Modern Versus Traditional Psychometrics As Applied to Personality Assessment Scales

  2003cited by this paper
• Measurement: a beginner's guide.

  2003cited by this paper
• Measurement precision of the clinician administered PTSD scale (CAPS): a RASCH model analysis.

  2003cited by this paper
• Mathematics, Measurement, Metaphor and Metaphysics II

  2003cited by this paper

• Turkish adaptation of the digital literacy scale: A rasch analysis

  2025cites this paper
• Measurement and Mind: Unveiling the Self-Delusion of Metrification in Psychology

  2024cites this paper
• The Job-Search Self-Efficacy (JSSE) Scale: an Item Response Theory Investigation

  2021cites this paper
• Guidelines on Design, Measurement and Statistics for Appetite.

  2021cites this paper
• A systematic literature review of ‘empathy’ and ‘games’

  2021cites this paper
• Introducing a Method for Intervals Correction on Multiple Likert Scales: A Case Study on an Urban Soundscape Data Collection Instrument

  2021cites this paper
• The Job-Search Self-Efficacy (JSSE) Scale: an Item Response Theory Investigation

  2021cites this paper
• A pilot study comparing The Borg CR Scale® (centiMax®) and the Beck Depression Inventory for scaling depressive symptoms

  2019cites this paper
• The Extended Barthel Index (EBI) can Be Reported as a Unidimensional Interval-Scaled Metric – A Psychometric Study

  2019cites this paper
• International Journal for the Scholarship of International Journal for the Scholarship of Teaching and Learning Teaching and Learning

  year unknowncites this paper