The kappa statistic in reliability studies: use, interpretation, and sample size requirements.

No abstract is available for this paper.

• Publication year

  2005

• Venue

  Physical Therapy

• Publication date

  2005-03-01

• Fields of study

  Medicine, Psychology

• Identifiers
  DOI 10.1093/PTJ/85.3.257PMID 15733050
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Inter-tester reliability of a new diagnostic classification system for patients with non-specific low back pain.

  2004cited by this paper
• Measures of Interobserver Agreement

  2003cited by this paper
• Comparison of Reliability Between the Lenke and King Classification Systems for Adolescent Idiopathic Scoliosis Using Radiographs That Were Not Premeasured

  2003cited by this paper
• Interexaminer Reliability of Low Back Pain Assessment Using the McKenzie Method

  2002cited by this paper
• Evaluation of the presence of sacroiliac joint region dysfunction using a combination of tests: a multicenter intertester reliability study.

  2002cited by this paper
• Multisurgeon Assessment of Coronal Pattern Classification Systems for Adolescent Idiopathic Scoliosis: Reliability and Error Analysis

  2002cited by this paper
• Observer Variability in Assessing Lumbar Spinal Stenosis Severity on Magnetic Resonance Imaging and Its Relation to Cross-Sectional Spinal Canal Area

  2002cited by this paper
• Kappa coefficients in medical research

  2002cited by this paper
• Reliability of assessing end-feel and pain and resistance sequence in subjects with painful shoulders and knees.

  2001cited by this paper
• Examining diagnostic tests: an evidence-based perspective.

  2001cited by this paper
• Bias and prevalence effects on kappa viewed in terms of sensitivity and specificity.

  2000cited by this paper
• Statistical methods in epidemiology. v. Towards an understanding of the kappa coefficient

  2000cited by this paper
• The effect of collapsing multinomial data when assessing agreement.

  2000cited by this paper
• Inter-examiner reliability in assessing passive intervertebral motion of the cervical spine.

  2000cited by this paper
• Research in health care : concepts, designs and methods

  2000cited by this paper
• The Use of a Classification Approach to Identify Subgroups of Patients With Acute Low Back Pain: Interrater Reliability and Short-Term Treatment Outcomes

  2000cited by this paper
• Sacroiliac joint diagnostics in the Hamburg Construction Workers Study.

  1999cited by this paper
• Interexaminer reliability in physical examination of the cervical spine.

  1999cited by this paper
• Statistical inference by confidence intervals: issues of interpretation and utilization.

  1999cited by this paper
• Preliminary study of the reliability of assessment procedures for indications for chiropractic adjustments of the lumbar spine.

  1999cited by this paper
• Using the kappa coefficient as a measure of reliability or reproducibility.

  1998cited by this paper
• The validity of self-reported cocaine use in a criminal justice treatment sample.

  1998cited by this paper
• Measurement reliability and agreement in psychiatry

  1998cited by this paper
• Sample size and optimal designs for reliability studies.

  1998cited by this paper
• Application and evaluation of the kappa statistic in the design and interpretation of chiropractic clinical research.

  1997cited by this paper
• Application and evaluation of the kappa statistic in the design and interpretation of chiropractic clinical research.

  1997cited by this paper
• Interpreting kappa values for two-observer nursing diagnosis data.

  1997cited by this paper
• Use of the standard error as a reliability index of interest: an applied example using elbow flexor strength data.

  1997cited by this paper
• Behavior and interpretation of the κ statistic: Resolution of the two paradoxes

  1996cited by this paper
• Dependence of Weighted Kappa Coefficients on the Number of Categories

  1996cited by this paper
• Behavior and interpretation of the kappa statistic: resolution of the two paradoxes.

  1996cited by this paper
• Statistical implications of the choice between a dichotomous or continuous trait in studies of interobserver agreement.

  1994cited by this paper
• Bias, prevalence and kappa.

  1993cited by this paper
• A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation.

  1992cited by this paper
• The Distress and Risk Assessment Method: A Simple Patient Classification to Identify Distress and Evaluate the Risk of Poor Outcome

  1992cited by this paper
• Statistical methods for assessing observer variability in clinical measures.

  1992cited by this paper
• Statistical methodology for reliability studies.

  1991cited by this paper
• Statistical methodology for reliability studies.

  1991cited by this paper
• Measuring interrater reliability among multiple raters: an example of methods for nominal data.

  1990cited by this paper
• Practical statistics for medical research

  1990cited by this paper
• High agreement but low kappa: II. Resolving the paradoxes.

  1990cited by this paper
• High agreement but low kappa: I. The problems of two paradoxes.

  1990cited by this paper
• Health Measurement Scales: A practical guide to thier development and use

  1989cited by this paper
• Kappa coefficient calculation using multiple ratings per subject: a special communication.

  1989cited by this paper
• Design and Analysis of Reliability Studies: The Statistical Evaluation of Measurement Errors

  1989cited by this paper
• A reappraisal of the kappa coefficient.

  1988cited by this paper
• Sample size determinations for the two rater kappa statistic

  1988cited by this paper
• The Kappa Coefficient and the Prevalence of a Diagnosis

  1988cited by this paper
• Misinterpretation and misuse of the kappa statistic.

  1987cited by this paper
• Issues in the Use of Kappa to Estimate Reliability

  1986cited by this paper
• Statistical methods for assessing agreement between two methods of clinical measurement.

  1986cited by this paper
• Statistical Methods for Rates and Proportions, 2nd ed

  1981cited by this paper
• Coefficient Kappa: Some Uses, Misuses, and Alternatives

  1981cited by this paper
• Integration and generalization of kappas for multiple raters.

  1980cited by this paper
• Large sample variance of kappa in the case of different sets of raters.

  1979cited by this paper
• Considerations in the choice of interobserver reliability estimates.

  1977cited by this paper
• The measurement of observer agreement for categorical data.

  1977cited by this paper
• ON THE METHODS AND THEORY OF RELIABILITY

  1976cited by this paper
• Statistical methods for rates and proportions

  1973cited by this paper
• Measuring nominal scale agreement among many raters.

  1971cited by this paper
• Interpretation and uses of medical statistics

  1969cited by this paper
• Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.

  1968cited by this paper
• Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit.

  1968cited by this paper
• AKUFO AND IBARAPA.

  1965cited by this paper
• A Coefficient of Agreement for Nominal Scales

  1960cited by this paper

• Impact of multimodal training on nursing staff's competencies in dementia mealtime support: A mixed-methods pilot study.

  2026cites this paper
• Effectiveness Of A Multimodal Educational Intervention To Improve Shared Decision-Making Skills Among Pediatric Hospitalists.

  2026cites this paper
• Accuracy of Prehospital Head Injury Assessment: Emergency Medical Dispatcher Versus Emergency Department.

  2026cites this paper
• Diagnostically competitive performance of a physiology-informed generative multi-task network for contrast-free CT perfusion

  2026cites this paper
• Dental-Dedicated MRI in the Assessment of Pulp Vitality and Apical Periodontitis: A Feasibility Study.

  2026cites this paper
• Impact of digital versus faxed e-referrals on triage decisions in a medical retina clinic.

  2026cites this paper
• Setting priorities for how future research in multiple sclerosis in Canada considers equity, diversity and inclusion: A modified e-Delphi study

  2026cites this paper
• Effect of a liquid syllabus on student engagement and sense of belonging

  2026cites this paper
• Machine learning intervention on cyber-hate in code-switch texts: a systematic review with open challenges and solutions

  2026cites this paper
• Addressing stakeholder dynamics in megaprojects: a framework for governance

  2026cites this paper
• SEMODS: A Validated Dataset of Open-Source Software Engineering Models

  2026cites this paper
• Evaluation of Dutch General Practitioners ultrasound referrals and opportunities for point-of-care ultrasound: A retrospective analysis

  2026cites this paper
• Evaluation of the Analytical Performance of the STANDARD Q COVID‐19 Antigenic Test in Suspected COVID‐19 Cases in Bobo‐Dioulasso, Burkina Faso

  2026cites this paper
• Differentiating large-duct pancreatic ductal adenocarcinoma from malignant intraductal papillary mucinous neoplasm: MRI characteristics and diagnostic implications.

  2026cites this paper
• Concordance Analysis of ALEX‐2, ImmunoCAP, and Prick Test for Respiratory Allergies in Lima, Peru

  2026cites this paper
• From Tags to Trees: Structuring Fine-Grained Knowledge for Controllable Data Selection in LLM Instruction Tuning

  2026cites this paper
• Observando os Rios: Citizen Science Monitoring Water Quality in Brazil

  2026cites this paper
• My Life Values Test: Design, Construction, and Psychometric Validation of a Tool for Managing Values

  2026cites this paper
• A multimodal deep learning framework for nutritional estimation and health-oriented recipe analysis

  2026cites this paper
• Designing with Dev-X: A systematic mapping of Developer Experience interventions and their business impact

  2026cites this paper
• Development and assessment of an ex vivo imaging protocol for dental-dedicated MRI systems: A pilot study

  2026cites this paper
• Flaky Tests in a Large Industrial Database Management System: An Empirical Study of Fixed Issue Reports for SAP HANA

  2026cites this paper
• Ultra‐Processed Food Consumption, Mental Health, and Quality of Life in Adults: A Systematic Review Protocol

  2026cites this paper
• Beyond the Digital Divide: Exploring Literacy, Perspectives, and Barriers to GenAI Among K12 EFL Teachers in China's Under‐Resourced Regions

  2026cites this paper
• The environmental niche of light purse seine vessels in the Arabian high seas

  2026cites this paper
• Designing tailored patent search approaches – A case study on nursing care technology

  2026cites this paper
• Enhancing liver diffusion-weighted imaging quality with correlation-weighted averaging: notable benefits in the left hepatic lobe.

  2026cites this paper
• [Concordance and methodological validity: the relevance of the kappa index in nutritional studies].

  2026cites this paper
• Consistency of Radiological Staging in Resectable Mismatch-Repair Proficient Colon Cancer: An Interobserver Agreement Study

  2026cites this paper
• The Semi-Structured Clinical Interview for the Assessment of Compulsive Sexual Behavior (SSCI-CSB): Development, Reliability, and Validity.

  2026cites this paper
• Validation of a multiplex qRT-PCR assay for the detection of RSV, influenza A/B virus and SARS-CoV-2

  2026cites this paper
• Enhanced paper grip test for foot strength assessment in healthy young adults: test–retest reliability and comparison with handgrip test

  2026influential citation
• A Lean Six Sigma-based model for assessing continuous improvement maturity in IT processes

  2026cites this paper
• A Tool for Automatically Cataloguing and Selecting Pre-Trained Models and Datasets for Software Engineering

  2026cites this paper
• Comparative Analysis of the Whistles of Three Oceanic Dolphins in the Comoros

  2026cites this paper
• Evaluation of the accuracy of sleep–wake detection by MotionWatch 8 in healthy individuals

  2026cites this paper
• The relationship between AI-chatbots use, student assessment performance and learning outcomes in higher education

  2026cites this paper
• Emergency Department Use of Ocular Point-of-Care Ultrasound and its Utility in Diagnosis at a Tertiary Academic Medical Center.

  2026cites this paper
• Introduction of a standardized semi-quantitative body condition scoring system for cattle and pigs in the Democratic Republic of the Congo.

  2026cites this paper
• Feasibility of preoperative patient self-assessed frailty: a single-centre pilot study.

  2026cites this paper
• Natural Language Processing for Enhanced Clinical Decision Support in Allergy Verification for Medication Prescriptions

  2025cites this paper
• Cataloguing Hugging Face Models to Software Engineering Activities: Automation and Findings

  2025cites this paper
• Comparisons Between Quantitative FMECA Methods: A Case Study on Power Transformer Risk Assessments

  2025influential citation
• Consistent Seagrass Mapping Across Various Tide Levels From Planet SuperDove Images

  2025cites this paper
• Microglial Responses to MSC-EVs Treatment in Animal and Cellular Models of Ischemic Stroke: a Systematic Review with Meta-analysis

  2025influential citation
• HPV genotyping agreement between paired cervical cytological sample and biopsy across lesion severity and vaccination

  2025cites this paper
• My Body, My Exoskeleton: Co-Designing Intersectional Visions of Robotic Augmentations through Drawings

  2025cites this paper
• Relationship Between Lumbar Multifidus Morphometry and Pain/Disability in Individuals With Chronic Nonspecific Low Back Pain After Considering Demographics, Fear‐Avoidance Beliefs, Insomnia, and Spinal Degenerative Changes

  2025influential citation
• Retrospective Assessment of Endometriosis Pain Over the Life Course: A Reliability Study Within the ComPaRe‐Endometriosis Cohort

  2025cites this paper
• Modic Change Edema in Chronic Low Back Pain Treated With Infliximab or Placebo

  2025cites this paper
• Wetland Vegetation Species Classification Using Optical and SAR Remote Sensing Images: A Case Study of Chongming Island, Shanghai, China

  2025cites this paper
• FLUID-SENSITIVE SEQUENCES MODIFY THE MODIC CLASSIFICATION IN MRI

  2025cites this paper
• Microwaves Versus Combined Microwaves and Fractional Carbon Dioxide Laser in the Treatment of Postpartum Abdominal Laxity Among Filipino Patients in a Tertiary Hospital: A Randomized, Prospective, Assessor‐Blinded, Simultaneous Split‐Abdomen Trial

  2025cites this paper
• An AI-Powered Research Assistant in the Lab: A Practical Guide for Text Analysis Through Iterative Collaboration with LLMs

  2025cites this paper
• The Role of Artificial Intelligence (ChatGPT-4o) in Supporting Tumor Board Decisions

  2025cites this paper
• Accuracy of information on the underlying cause of death: An analysis in Colombia during the COVID-19 pandemic in 2021

  2025cites this paper
• Level of agreement between two asthma control questionnaires in children and adolescents

  2025cites this paper
• Diagnostically Competitive Performance of a Physiology-Informed Generative Multi-Task Network for Contrast-Free CT Perfusion

  2025cites this paper
• Integrating Enzyme‐DNA Complex and CRISPR/Cas12a for Robust Norovirus Detection

  2025cites this paper
• Geospatial analysis of impact of climate change on potential habitat of Boswellia serrata Roxb. Ex Colebr in Eastern India

  2025cites this paper
• Use of health administrative data to identify migraine in individuals with a recognized pregnancy: A validation study in Ontario, Canada.

  2025cites this paper
• When assessing representative images of fine-needle aspirate cytological smears of canine mast cell tumours, interobserver agreement is influenced by educational attainment.

  2025cites this paper
• Patterns of observer error in scoring macromorphoscopic traits for population affinity

  2025cites this paper
• Evaluation of Mortality and Hospitalization Due to Decompensated Heart Failure and Appropriate Shocks in Reduced Ejection Fraction in Patients with an Implantable Cardioverter–Defibrillator According to a Novel Tissue Doppler Echocardiographic Method

  2025influential citation
• Psychosocial factors associated with physical activity, weight management, and sleep in adults with hip and knee osteoarthritis: a systematic review

  2025cites this paper
• Human and Machine Reliability in Postural Assessment of Forest Operations by OWAS Method: Level of Agreement and Time Resources

  2025cites this paper
• Descriptor: C++ Self-Admitted Technical Debt Dataset (CppSATD)

  2025influential citation
• Applying Machine Learning Algorithms for Spatial Modeling of Flood Susceptibility Prediction over São Paulo Sub-Region

  2025cites this paper
• Camera-based mobile applications for movement screening in healthy adults: a systematic review

  2025cites this paper
• Poets Over Quants: Automation and AI Threats Increase the Value People Place on Creativity.

  2025cites this paper
• HuHoLa: A novel Hummock-Hollow-Lawn mire microtopography modelling approach

  2025cites this paper
• The relationship between the eradication of Helicobacter pylori and the occurrence of stomach cancer: an updated meta-analysis and systemic review

  2025influential citation
• Handgrip strength is not correlated with the five-times sit-to-stand test in kidney transplant patients

  2025cites this paper
• Rate of Spinal Osteochondromas Diagnosed in Pediatric Patients With Hereditary Multiple Osteochondromas: A Systematic Review and Meta-Analysis.

  2025cites this paper
• The Lyme Disease Controversy: An AI-Driven Discourse Analysis of a Quarter Century of Academic Debate and Divides

  2025cites this paper
• Pediatric Rapid Ultrasound for Shock and Hypotension Phenotype Differentiation in the Emergency Department: Evaluation of Feasibility and Reliability in a Malawi Cohort

  2025cites this paper
• A Systematic Review and Critical Appraisal of the Psychometric Properties of the Child Abuse Potential Inventory (CAPI)

  2025cites this paper
• The Hubble Image Similarity Project

  2025cites this paper
• Evaluation of the Ability of Machine Learning-Models to Assess Postural Orientation Errors During a Single-Leg Squat

  2025cites this paper
• Enhancing Log Sentiments: An Exploratory Study of Sentiments and Emotions with Software Logs

  2025influential citation
• Habitat Occupancy of Brown Hyaenas and Civets in a Multi‐Predator, Semi‐Arid Savanna Landscape

  2025cites this paper
• Inter-rater reliability of stress signatures in exfoliated primary dentition - Improving scientific rigor and reproducibility in histological data collection

  2025cites this paper
• Analysis of the Potential of the Territory of the Sikhote-Alin Mobile Belt (Khabarovsk Krai) for Detecting Placers Using the Base Surfaces Method with Enoe and MaxEnt Software

  2025influential citation
• Interrater reliability of the SPARK36, a novel instrument to guide preventive nurse-led consultations with parents of three-year olds.

  2025cites this paper
• Telephone-based assessment of fatigue and dyspnea in individuals with Parkinson’s disease

  2025influential citation
• Quality of life after brain injury in children and adolescents questionnaire – validation of the proxy version (QOLIBRI-KID/ADO-Proxy)

  2025influential citation
• Differential neural reward processes in internet addiction: A systematic review of brain imaging research.

  2025cites this paper
• Okul Öncesi Öğrenme Bağlılığı Gözlem Aracının Geliştirilmesi: Geçerlik ve Güvenirlik Çalışması

  2025cites this paper
• Accuracy of real-time PCR assays for human papillomavirus using urine samples: a systematic review and meta-analysis

  2025cites this paper
• A Deep Learning Ordinal Classifier

  2025cites this paper
• Mapping relationships among gross motor skills in 16,989 children using network analysis

  2025influential citation
• YouTube is an Inconsistent Source of Information on Orthobiologics: Implications for Content Quality, Reliability, Comprehensiveness, and Patient Decision-Making.

  2025cites this paper
• Measurement Matters: Prevalence and Consequence of Parental Nonstandard Work Schedules

  2025cites this paper
• WHO survey tool for behavioral insights on COVID-19: A psychometric study for translation, adaptation and content validity in Persian

  2025cites this paper
• PaRT: Enhancing Proactive Social Chatbots with Personalized Real-Time Retrieval

  2025cites this paper
• Assessing the reliability of the Beck Depression Inventory adapted for Turkish culture: A meta-analysis

  2025cites this paper
• Radiographic classification of mandibular osteoradionecrosis: A blinded prospective multi-disciplinary interobserver diagnostic performance study.

  2025cites this paper
• Using latent class modelling to evaluate the performance of a computer vision system for pig carcass contamination.

  2025cites this paper
• A Computer-Aided Approach to Canine Hip Dysplasia Assessment: Measuring Femoral Head–Acetabulum Distance with Deep Learning

  2025cites this paper
• Critical appraisal tool (CAT) for the evaluation of evidence from animal observational epidemiological studies

  2025cites this paper