P-Value Precision and Reproducibility

No abstract is available for this paper.

• Publication year

  2011

• Venue

  American Statistician

• Publication date

  2011-11-01

• Fields of study

  Mathematics, Medicine

• Identifiers
  DOI 10.1198/tas.2011.10129PMID 22690019PMCID PMC3370685
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Odds are, it's wrong: Science fails to face the shortcomings of statistics

  2010cited by this paper
• P-Values are Random Variables

  2008cited by this paper
• Reproducibility probability estimation for testing statistical hypotheses

  2008influential reference
• An Introduction to the Bootstrap

  2007cited by this paper
• The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant

  2006cited by this paper
• Reproducibility probability in clinical trials

  2002cited by this paper
• P Values as Random Variables—Expected P Values

  1999cited by this paper
• A Note on Information Seldom Reported via the P Value

  1999cited by this paper
• ITERATED BOOTSTRAP PREDICTION INTERVALS

  1998cited by this paper
• The behavior of the P-value when the alternative hypothesis is true.

  1997cited by this paper
• Improving Tabular Displays, With NAEP Tables as Examples and Inspirations

  1997cited by this paper
• Some results on bootstrap prediction intervals

  1996influential reference
• [Jackknife and bootstrap].

  1992influential reference
• A comment on replication, p-values and evidence.

  1992influential reference
• Beyond ANOVA: Basics of Applied Statistics.

  1986cited by this paper
• Asymptotic Lognormality of $P$-Values

  1982influential reference
• Minimum Distance Estimators for Location and Goodness of Fit

  1981cited by this paper
• Influence Functions for Testing

  1981influential reference
• Rudiments of Numeracy

  1977cited by this paper
• A Statistical Education.

  1977cited by this paper
• On Statistical Education

  1972cited by this paper
• The Median Significance Level and other Small Sample Measures of Test Efficacy

  1969cited by this paper
• Stochastic comparison of tests

  1960influential reference

• Improving research reproducibility in surgery: A narrative review on caveats in research methodology

  2025influential citation
• Statistical Reproducibility of Umbrella Alternative Tests

  2025cites this paper
• Accurate and efficient P-values for rank-based independence tests with clustered data using a saddlepoint approximation

  2025cites this paper
• Time-scale effects on runoff simulation and parameters sensitivity using SWAT model

  2025cites this paper
• Survival-inferred fragility of statistical significance in phase III oncology trials

  2025influential citation
• Unification of Rare and Weak Multiple Testing Models using Moderate Deviations Analysis and Log-Chisquared P-values

  2025cites this paper
• Application of cox proportional hazard model to ‎study the influence of determinants on under five ‎mortality in Odisha, India

  2025cites this paper
• Risk-Weight Calculation of Candidate Risk Factors for Incidental Osteoporotic Fracture in Patients with Rheumatic Diseases: A Potentially Accurate Approach

  2025cites this paper
• Survival-Inferred Fragility of Statistical Significance in Phase III Oncology Trials

  2025cites this paper
• Investigation of diesel spray characteristics from injectors with asymmetric hole distribution

  2025cites this paper
• Methodological Considerations in the Analysis of Acoustically Evoked Neural Signals: A Comparative Study of Active EEG, Passive EEG and MEG

  2024influential citation
• A Conceptual Framework for Quantifying the Robustness of a Regression-Based Causal Inference in Observational Study

  2024cites this paper
• Classification and Physical Characteristic Analysis of Fermi-GBM Gamma-Ray Bursts Based on Deep Learning

  2024cites this paper
• Reporting of confidence intervals, achievement of intended sample size, and adjustment for multiple primary outcomes in randomised trials of physical therapy interventions: an analysis of 100 representatively sampled trials.

  2024cites this paper
• Testing psychometric property on the Indonesian Academic Self-Efficacy Scale (TIASS)

  2024cites this paper
• A culture-independent nucleic acid diagnostics method for use in the detection and quantification of Burkholderia cepacia complex contamination in aqueous finished pharmaceutical products

  2024cites this paper
• Transcranial Doppler Ultrasound and Concussion–Supplemental Symptoms with Physiology: A Systematic Review

  2024cites this paper
• Liquid-assisted mechanochemical synthesis, crystallographic, theoretical and molecular docking study on HIV instasome of novel copper complexes: (µ-acetato)-bis(2,2′-bipyridine)-copper and bromidotetrakis(2-methyl-1H-imidazole)-copper bromide

  2023cites this paper
• False Indications of Dose-Response Nonlinearity in Large Epidemiologic Cancer Radiation Cohort Studies; A Simulation Exercise

  2023cites this paper
• Interact: A visual what-if analysis tool for virtual product design

  2023cites this paper
• Statslator: Interactive Translation of NHST and Estimation Statistics Reporting Styles in Scientific Documents

  2023cites this paper
• Machine learning applied to functional magnetic resonance imaging in anxiety disorders.

  2023cites this paper
• Extraordinary Claims in the Literature on High-Intensity Interval Training (HIIT): I. Bonafide Scientific Revolution or a Looming Crisis of Replication and Credibility?

  2023cites this paper
• Follow the leader(board) with confidence: Estimating p-values from a single test set with item and response variance

  2023cites this paper
• The P value - and its historical underpinnings – pro and con

  2023cites this paper
• The correlation between the city bus accessibility and transit ridership in Surabaya City, Indonesia

  2023cites this paper
• Adaptations on the Use of p-Values for Statistical Inference: An Interpretation of Messages from Recent Public Discussions

  2023influential citation
• Optimization and machining characteristics of ST 60 steel material due to the annealing process using the Taguchi method

  2023cites this paper
• Trials and tribulations of statistical significance in biochemistry and omics.

  2023cites this paper
• Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal Editors

  2022cites this paper
• Hierarchy of evidence for endometriosis diagnosis and surgery.

  2022influential citation
• Reproducibility of Health Claims in Meta-Analysis Studies of COVID Quarantine (Stay-at-Home) Orders

  2022influential citation
• A two-step pre-processing tool to remove Gaussian and ectopic noise for heart rate variability analysis

  2022cites this paper
• A New Hope for Liquid Biopsies: Early Detection of Pancreatic Cancer By Means of Protease Activity Detection in Serum Applying a Hierarchical Decision Structure

  2022cites this paper
• Application of univariate and multivariate statistical analyzes in clonal selection of Eucalyptus spp. for charcoal production

  2022cites this paper
• What Can a Systematic Review of Cannabis Trials Tell Us?

  2022cites this paper
• Reconsidering evidence-based management of endometriosis

  2022cites this paper
• How to write about alternatives to classical hypothesis testing outside of the statistical literature: Approximate Bayesian model selection applied to a biomechanics study

  2022cites this paper
• Confidence Intervals and Smallest Worthwhile Change Are Not a Panacea

  2022influential citation
• The impact of organisational capabilities on the performance of small- and medium-sized enterprises (SMEs)

  2022cites this paper
• Early Detection of Pancreatic Cancers Using Liquid Biopsies and Hierarchical Decision Structure

  2022cites this paper
• Rare and Weak Detection Models under Moderate Deviations Analysis and Log-Chisquared P-values

  2022cites this paper
• Quantifying the Reproducibility of Cell-Perturbation Experiments

  2022cites this paper
• Early Detection of Pancreatic Cancers Using Liquid Biopsies and Hierarchical Decision Structure

  2022cites this paper
• Statistical Reliability of a Diet-Disease Association Meta-analysis

  2022influential citation
• Correspondence: Reward, but do not yet require, interval hypothesis tests.

  2022cites this paper
• Statistische Inferenz mittels Schätzung: Empfehlungen der International Society of Physiotherapy Journal Editors

  2022cites this paper
• Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal Editors

  2022cites this paper
• Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal Editors

  2022cites this paper
• The Worst of Both Worlds: A Comparative Analysis of Errors in Learning from Data in Psychology and Machine Learning

  2022cites this paper
• Reliability of a Meta-analysis of Air Quality−Asthma Cohort Studies

  2022cites this paper
• Survey and Recommendations on the Use of P-Values Driving Decisions in Nonclinical Pharmaceutical Applications

  2022cites this paper
• Statistical inference through estimation: Recommendations from the International Society of Physiotherapy Journal Editors

  2022cites this paper
• Resveratrol protects against myocardial ischemic injury via the inhibition of NF-κB-dependent inflammation and the enhancement of antioxidant defenses

  2021cites this paper
• Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal Editors.

  2021cites this paper
• Variability of Bayes Factor estimates in Bayesian Analyses of Variance

  2021cites this paper
• Case Study: Evaluation of a meta-analysis of the association between soy protein and cardiovascular disease

  2021cites this paper
• Evaluation of a meta-analysis of the association between red and processed meat and selected human health effects

  2021influential citation
• Standard meta-analysis methods are not robust

  2021cites this paper
• Gender in 30 Years of IEEE Visualization

  2021cites this paper
• Seek for Success: A Visualization Approach for Understanding the Dynamics of Academic Careers

  2021cites this paper
• The effect of metabolic phenotype on sociability and social group size preference in a coral reef fish

  2021cites this paper
• Sander Greenland’s contribution to the Discussion of ‘Testing by betting: A strategy for statistical and scientific communication’ by Glenn Shafer

  2021cites this paper
• Unification of Rare/Weak Detection Models using Moderate Deviations Analysis and Log-Chisquared P-values

  2021cites this paper
• Living with Neighbors. III. The Origin of the Spin–Orbit Alignment of Galaxy Pairs: A Neighbor versus the Large-scale Structure

  2021cites this paper
• Pairwise Comparisons Using Ranks in the One-Way Model

  2021cites this paper
• Replication: Do not trust your p‐value, be it small or large

  2021influential citation
• Variability of Bayes Factor estimates in Bayesian Analysis of Variance

  2021cites this paper
• Accounting research and the significance test crisis

  2021cites this paper
• Integrated Genomic and Transcriptomic Analysis reveals key genes for predicting dual-phenotype Hepatocellular Carcinoma Prognosis

  2021cites this paper
• Log-Chisquared P-values under Rare and Weak Departures

  2021cites this paper
• There are natural scores: Full comment on Shafer,"Testing by betting: A strategy for statistical and scientific communication"

  2021influential citation
• Reconceptualizing the p-value from a likelihood ratio test: a probabilistic pairwise comparison of models based on Kullback-Leibler discrepancy measures

  2020cites this paper
• Application of protein set enrichment analysis to correlation of protein functional sets with mass spectral features and multivariate proteomic tests

  2020cites this paper
• RE: Extended Mortality Follow-up of a Cohort of 25,460 Workers Exposed to Acrylonitrile.

  2020cites this paper
• Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance

  2020cites this paper
• Utilization of GC–MS untargeted metabolomics to assess the delayed response of glufosinate treatment of transgenic herbicide resistant (HR) buffalo grasses (Stenotaphrum secundatum L.)

  2020cites this paper
• Decoupling control of chassis integrated system for electric wheel vehicle

  2020cites this paper
• The probability of a robust inference for internal validity

  2020cites this paper
• Confidence Interval as a Better Alternative to P-Value for Clinical Significance

  2020cites this paper
• Engaging More Effectively With Visitors to Coastal Regions for Improved Management Outcomes: Insights From the Ningaloo Coast, Australia

  2020cites this paper
• On the Orbital Spacing Pattern of Kepler Multiple-planet Systems

  2020influential citation
• A physics-aware learning architecture with input transfer networks for predictive modeling

  2020cites this paper
• At the eve of the 40th anniversary of the Journal of Economic Psychology: Standards, practices, and challenges

  2020cites this paper
• Ameliorating Environmental Effects on Hyperspectral Images for Improved Phenotyping in Greenhouse and Field Conditions

  2020cites this paper
• The Role of p-Values in Judging the Strength of Evidence and Realistic Replication Expectations

  2020cites this paper
• Reproducibility literature analysis - a federal information professional perspective

  2020cites this paper
• Hippocampus shape deformation: potential diagnostic biomarker for chronic back pain in women.

  2020cites this paper
• Vladimir Vovk’s contribution to the Discussion of ‘Testing by betting: A strategy for statistical and scientific communication’ by Glenn Shafer

  2020cites this paper
• The reign of the p-value is over: what alternative analyses could we employ to fill the power vacuum?

  2019cites this paper
• Oil-induced responses of cardiac and red muscle mitochondria in red drum (Sciaenops ocellatus).

  2019cites this paper
• Running head: Accelerometry and flight in the Harris's Hawk 1 Exploring the relation between flapping behaviour and accelerometer signal during 2 ascending flight, and a new approach to calibration 3

  2019cites this paper
• Evaluation of a meta-analysis of air quality and heart attacks, a case study

  2019cites this paper
• From One Environment to Many: The Problem of Replicability of Statistical Inferences

  2019cites this paper
• Valid P-Values Behave Exactly as They Should: Some Misleading Criticisms of P-Values and Their Resolution With S-Values

  2019cites this paper
• Exploring the relationship between flapping behaviour and accelerometer signal during ascending flight, and a new approach to calibration

  2019cites this paper
• On Causal Inferences for Personalized Medicine: How Hidden Causal Assumptions Led to Erroneous Causal Claims About the D-Value

  2019cites this paper
• On the probability of a causal inference is robust for internal validity

  2019cites this paper
• Bayesian multilevel model of micro RNA levels in ovarian-cancer and healthy subjects

  2019cites this paper
• The reliability of an environmental epidemiology meta‐analysis, a case study

  2019influential citation