Receiver operating characteristic analysis: a tool for the quantitative evaluation of observer performance and imaging systems.

No abstract is available for this paper.

• Publication year

  2006

• Venue

  Journal of the American College of Radiology

• Publication date

  2006-06-01

• Fields of study

  Medicine, Computer Science

• Identifiers
  DOI 10.1016/J.JACR.2006.02.021PMID 17412096
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Review of several proposed three-class classification decision rules and their relation to the ideal observer decision rule

  2005cited by this paper
• Ideal observers and optimal ROC hypersurfaces in N-class classification

  2004cited by this paper
• Assessment of medical imaging and computer-assist systems: lessons from recent experience.

  2002cited by this paper
• Statistical power in observer-performance studies: comparison of the receiver operating characteristic and free-response methods in tasks involving localization.

  2002cited by this paper
• "Proper" Binormal ROC Curves: Theory and Maximum-Likelihood Estimation.

  1999cited by this paper
• Variance-component modeling in the analysis of receiver operating characteristic index estimates.

  1997cited by this paper
• Proper receiver operating characteristic analysis: the bigamma model.

  1997cited by this paper
• The "proper" binormal model: parametric receiver operating characteristic curve estimation with degenerate data.

  1997cited by this paper
• A receiver operating characteristic partial area index for highly sensitive diagnostic tests.

  1996cited by this paper
• Unified measurement of observer performance in detecting and localizing target objects on images.

  1996cited by this paper
• Comparison of receiver operating characteristic curves on the basis of optimal operating points.

  1996cited by this paper
• Quantification of failure to demonstrate statistical significance. The usefulness of confidence intervals.

  1993cited by this paper
• The Efficacy of Diagnostic Imaging

  1991influential reference
• Free-response methodology: alternate analysis and a new observer-performance experiment.

  1990cited by this paper
• Analyzing a Portion of the ROC Curve

  1989cited by this paper
• Satisfaction of search in diagnostic radiology.

  1989cited by this paper
• Some practical issues of experimental design and data analysis in radiological ROC studies.

  1989cited by this paper
• The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves

  1988cited by this paper
• Form of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement of performance.

  1986cited by this paper
• ROC Methodology in Radiologic Imaging

  1986cited by this paper
• ROC analysis applied to the evaluation of medical imaging techniques.

  1979cited by this paper
• Basic principles of ROC analysis.

  1978influential reference
• A Free Response Approach To The Measurement And Characterization Of Radiographic Observer Performance

  1977cited by this paper
• Visual detection and localization of radiographic images.

  1975cited by this paper
• Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data

  1969cited by this paper
• Operating Characteristics, Signal Detectability, and the Method of Free Response

  1961cited by this paper

• Object‐Based Flow Map Classification Combining Speckle Imaging and Machine Learning

  2026cites this paper
• Inconsistency in use and derivation of clinically meaningful changes in anterior cruciate ligament reconstruction: A systematic review.

  2026cites this paper
• A Novel Methodology for Establishing Best Values for MCID, SCB, and PASS Thresholds for Rotator Cuff Repair

  2026cites this paper
• Explainable Artificial Intelligence to Quantify Adenoid Hypertrophy-related Upper Airway Obstruction using 3D Shape Analysis.

  2025cites this paper
• Electrochemical genomagnetic assay for detection of SARS-CoV-2 RNA using a disposable microfluidic platform.

  2025cites this paper
• RASEL: An Ensemble Model for Selection of Core SNPs and Its Application for Identification and Classification of Cattle Breeds.

  2025cites this paper
• Automated detection of traumatic bleeding in CT images using 3D U-Net# and multi-organ segmentation

  2025cites this paper
• Radiomics and Deep Learning Interplay for Predicting MGMT Methylation in Glioblastoma: The Crucial Role of Segmentation Quality

  2025cites this paper
• Identifikasi Penggunaan Material Untuk Hunian Modular Sementara Menggunakan Metode Statistik Ciri Orde Pertama

  2025cites this paper
• A pulmonary nodule is worth 8 × 8 × 8 words: computed tomography-based 3D vision transformer predicts early-stage high-grade lung adenocarcinoma of micropapillary and/or solid subtypes

  2025cites this paper
• End-to-end simulation of a machine vision system for virtual task-based assessment

  2025cites this paper
• A bioinformatics approach of specificity protein transcription factors in head and neck squamous cell carcinoma

  2024cites this paper
• Predicting Survival in Glioblastoma Using Gene Expression Databases: A Neural Network Analysis

  2024cites this paper
• Aerodynamic Threshold Measures for Reflecting Glottal Closure in Voice Disorders.

  2024cites this paper
• Performance changes due to differences among annotating radiologists for training data in computerized lesion detection

  2024cites this paper
• Vocal Range Variations Elicited With a Standard Mandarin Reading Passage in Individuals With Voice Disorders.

  2024cites this paper
• An evaluation of pedestrian crash risk factors at urban intersections in a developing country: Comparing the classification accuracy of methods accounting for unobserved heterogeneity

  2024cites this paper
• Variability of MCID, SCB, and PASS Thresholds in Studies Assessing Patient-Reported Outcomes After Rotator Cuff Repair: A Systematic Review

  2024cites this paper
• Exploring Autism Spectrum Disorder: A Comparative Study of Traditional Classifiers and Deep Learning Classifiers to Analyze Functional Connectivity Measures from a Multicenter Dataset

  2024cites this paper
• An Autonomous Sleep-Stage Detection Technique in Disruptive Technology Environment

  2024cites this paper
• Time-to-event learning paradigm as a generalized approach to estimate risk of breast cancer using image-based deep learning models

  2024cites this paper
• An Investigation of Lesion Detection Accuracy for Artificial Intelligence–Based Denoising of Low-Dose 64Cu-DOTATATE PET Imaging in Patients with Neuroendocrine Neoplasms

  2023cites this paper
• Predicting Suicide Risk among South African University Students: Optimal Cutoff Score for the Center for Epidemiological Studies Depression Scale

  2023cites this paper
• Determining a cut-off point for intervention analgesia in rabbits using the Bristol Rabbit Pain Scale.

  2023cites this paper
• Fully convolutional network for automated detection and diagnosis of mammographic masses

  2023cites this paper
• Deriving quantitative information from multiparametric MRI via Radiomics: Evaluation of the robustness and predictive value of radiomic features in the discrimination of low-grade versus high-grade gliomas with machine learning.

  2023cites this paper
• Effect of data harmonization of multicentric dataset in ASD/TD classification

  2023cites this paper
• Functional Magnetic Resonance Urography in Ureteropelvic Junction Obstruction: Proposal for a Pediatric Quantitative Score

  2022cites this paper
• Multi-site harmonization of MRI data uncovers machine-learning discrimination capability in barely separable populations: An example from the ABIDE dataset

  2022cites this paper
• Association between history of abortion and current use of contraceptives among Mongolian Women

  2022cites this paper
• Visual expertise modulates baseline brain activity: a preliminary resting-state fMRI study using expertise model of radiologists

  2022cites this paper
• Signal-Level Fusion Approach for Embedded Ultrasonic Sensors in Damage Detection of Real RC Structures

  2022cites this paper
• Early stage of radiological expertise modulates resting-state local coherence in the inferior temporal lobe

  2022cites this paper
• Ecological determinants and risk areas of Striga hermonthica infestation in western Kenya under changing climate

  2022cites this paper
• Relationship between image information content and observer performance in digital intraoral radiography

  2022cites this paper
• A deep learning-and CT image-based prognostic model for the prediction of survival in non-small cell lung cancer.

  2021cites this paper
• Online prediction tool for female pelvic floor dysfunction: development and validation

  2021cites this paper
• Machine Learning Methods for Predicting Conversion from Mild Cognitive Impairment to Alzheimer's Disease. A Systematic Review.

  2021cites this paper
• Machine learning methods for predicting progression from mild cognitive impairment to Alzheimer’s disease dementia: a systematic review

  2021cites this paper
• Validation of a candidate instrument to assess image quality in digital mammography using ROC analysis.

  2021cites this paper
• Lung Nodule Malignancy Prediction in Sequential CT Scans: Summary of ISBI 2018 Challenge

  2021cites this paper
• Concept of a Random Variable

  2021cites this paper
• Procurement, commissioning and QA of AI based solutions: An MPE's perspective on introducing AI in clinical practice.

  2021cites this paper
• Objective Task-Based Evaluation of Artificial Intelligence-Based Medical Imaging Methods:: Framework, Strategies, and Role of the Physician.

  2021cites this paper
• Performance changes due to differences in training data for cerebral aneurysm detection in head MR angiography images

  2021cites this paper
• Validation of a mammographic image quality modification algorithm using 3D-printed breast phantoms

  2021cites this paper
• Visual experience modulates whole‐brain connectivity dynamics: A resting‐state fMRI study using the model of radiologists

  2021cites this paper
• Outcomes and Resource Use Associated with Acute Respiratory Failure in Safety Net Hospitals Across the United States.

  2021cites this paper
• Predictive Value of Magnetic Resonance Imaging in Patients With Juvenile Idiopathic Arthritis in Clinical Remission

  2021cites this paper
• Applications to Data Analytics and Modeling

  2021cites this paper
• Development of training environment for deep learning with medical images on supercomputer system based on asynchronous parallel Bayesian optimization

  2020cites this paper
• A blinded clinical study using a subepidermal moisture biocapacitance measurement device for early detection of pressure injuries

  2020cites this paper
• Analyzing CNN Based Behavioural Malware Detection Techniques on Cloud IaaS

  2020cites this paper
• Diagnostic performance of integrated digital breast tomosynthesis (DBT) and molecular breast tomosynthesis (MBT) among women scheduled for breast biopsy

  2020cites this paper
• Decoding visual information from high-density diffuse optical tomography neuroimaging data

  2020influential citation
• A controlled study on the diagnostic accuracy of panoramic and peri-apical radiography for detecting furcation involvement

  2020cites this paper
• Using β hCG, prolactin and IGFBP I single or in Pairs to diagnose PROM

  2020cites this paper
• Comparison of SSD and Faster R-CNN Algorithms to Detect the Airports with Data Set Which Obtained From Unmanned Aerial Vehicles and Satellite Images

  2020cites this paper
• Incorporating dose–volume histogram parameters of swallowing organs at risk in a videofluoroscopy-based predictive model of radiation-induced dysphagia after head and neck cancer intensity-modulated radiation therapy

  2020cites this paper
• Autism Spectrum Disorder and Childhood Apraxia of Speech: Early Language-Related Hallmarks across Structural MRI Study

  2020cites this paper
• Multivariate Data Analysis and Machine Learning for Prediction of MCI-to-AD Conversion.

  2020cites this paper
• A deep residual learning network for predicting lung adenocarcinoma manifesting as ground-glass nodule on CT images

  2019cites this paper
• Visual evidence for interpreting diagnostic decision of deep neural network in computer-aided diagnosis

  2019influential citation
• Lincoln How Does Age Affect Baseline Screening Mammography How Does Age Affect Baseline Screening Mammography Performance Measures? A Decision Model Performance Measures? A Decision Model

  2019influential citation
• Descriptive Evaluation and Accuracy of a Mobile App to Assess Fall Risk in Seniors: Retrospective Case-Control Study

  2019influential citation
• Evaluation of Altered Functional Connections in Male Children With Autism Spectrum Disorders on Multiple-Site Data Optimized With Machine Learning

  2019influential citation
• Prediction of future gastric cancer risk using a machine learning algorithm and comprehensive medical check-up data: A case-control study

  2019cites this paper
• Early Crack Detection of Reinforced Concrete Structure Using Embedded Sensors

  2019cites this paper
• Computer-aided diagnosis of ground-glass opacity pulmonary nodules using radiomic features analysis

  2019influential citation
• A simple method for semi-automatic readjustment for positioning in post-mortem head computed tomography imaging

  2019cites this paper
• Creation of value for business from the importance-performance analysis: the case of health clubs

  2019cites this paper
• Visual grading evaluation of reconstruction methods and dose optimisation in abdominal Computed Tomography

  2019cites this paper
• Improved Fault Detection and Isolation of Small Faults using Multiple Residual Generators and Complex Detection Hypotheses: Case Study of an Electro-Hydraulic Aerospace Actuator

  2019cites this paper
• Measuring trail users’ perception of crowding in a peri-urban nature park: A best-worst scaling experiment

  2018cites this paper
• Estimation of task-based modulations in functional connectivity with MEG: a comparison of methods

  2018cites this paper
• 302. Quantitative analysis and SVM-based classification of 18F-FDG PET data in mammary carcinoma

  2018cites this paper
• Measuring Chemotherapy Response in Breast Cancer Using Optical and Ultrasound Spectroscopy

  2018cites this paper
• Cluster signal-to-noise analysis for evaluation of the information content in an image.

  2018cites this paper
• Données image et décision : détection automatique de variations dans des séries temporelles par réseau de Kohonen

  2018cites this paper
• Selection of Performance Measures for Brainprint Authentication

  2018cites this paper
• Identification of fluorescence in situ hybridization assay markers for prediction of disease progression in prostate cancer patients on active surveillance

  2018cites this paper
• Human liver Cancer Segmentation and analysis using Human Machine Interation Method

  2018cites this paper
• Using the Quantization Error from Self-Organizing Map (SOM) Output for Fast Detection of Critical Variations in Image Time Series

  2018cites this paper
• Detection accuracy of maxillary sinus floor septa in panoramic radiographs using CBCT as gold standard: a multi-observer receiver operating characteristic (ROC) study

  2018cites this paper
• ROC Analizi ile Zung Depresyon Ölçeği Kesme Noktalarının Belirlenmesi

  2018cites this paper
• Medical Image Perception

  2018cites this paper
• ICADx: interpretable computer aided diagnosis of breast masses

  2018cites this paper
• Fully convolutional network and sparsity-based dictionary learning for liver lesion detection in CT examinations

  2018cites this paper
• Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection

  2018cites this paper
• Deep Learning Classification of 3.5-GHz Band Spectrograms With Applications to Spectrum Sensing

  2018cites this paper
• Prediction of Glucose Metabolism Disorder Risk Using a Machine Learning Algorithm: Pilot Study

  2018cites this paper
• Data Improvement Through Simplification: Implications for Low-Resource Settings

  2018cites this paper
• Reliability Analysis of Ground-Penetrating Radar for the Detection of Subsurface Delamination

  2018cites this paper
• STIM map: detection map for exoplanets imaging beyond asymptotic Gaussian residual speckle noise

  2018cites this paper
• Retinal Vessels Segmentation Techniques and Algorithms: A Survey

  2018cites this paper
• Verification of modified receiver-operating characteristic software using simulated rating data

  2018cites this paper
• Latent feature representation with depth directional long-term recurrent learning for breast masses in digital breast tomosynthesis

  2017cites this paper
• Foreign Bribery: Incentives and Enforcement

  2017influential citation
• Advanced chemometric techniques for the analysis of complex samples using one- and two-dimensional gas chromatography coupled with time-of-flight mass spectrometry

  2017cites this paper
• Bone comparison identification method based on chest computed tomography imaging.

  2017cites this paper