Common misinterpretations of statistical significance and P-values in dairy research

Graphical Abstract Summary: The focus in published dairy research on P-values has limited the value of such research by dividing results into either “significant” or “nonsignificant.” A focus on effect sizes will improve the interpretability and value of dairy research and reduce dichotomous thinking.

• Publication year

  2025

• Venue

  JDS Communications

• Publication date

  2025-09-01

• Fields of study

  Agricultural and Food Sciences, Medicine

• Identifiers
  DOI 10.3168/jdsc.2025-0835PMID 41220983PMCID 12598483
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• Preweaning nutrient supply improves lactation productivity and reduced the risk of culling in Holstein cows.

  2025influential reference
• The effect of non-steroidal anti-inflammatory drugs, therapeutic hoof trimming and orthopedic block application on lameness in multiparous dairy cattle, a randomized controlled trial.

  2025cited by this paper
• Oxytocin, prostaglandin F2α, and scopolamine for uterine involution of dairy cows

  2024cited by this paper
• Study on the Pattern of Postpartum Uterine Involution in Dairy Cows

  2023cited by this paper
• Statistical inference through estimation: recommendations from the International Society of Physiotherapy Journal Editors

  2022cited by this paper
• Discuss practical importance of results based on interval estimates and p-value functions, not only on point estimates and null p-values

  2022cited by this paper
• Statistical inference through estimation: Recommendations from the International Society of Physiotherapy Journal Editors

  2022cited by this paper
• Graduate Student Literature Review: A systematic review on the associations between nonsteroidal anti-inflammatory drug use at the time of diagnosis and treatment of claw horn lameness in dairy cattle and lameness scores, algometer readings, and lying times.

  2022cited by this paper
• Post hoc power is not informative

  2022cited by this paper
• The effect of pegbovigrastim on early-lactation disease, production, and reproduction in dairy cows.

  2021cited by this paper
• Mycoplasma bovis infection in dairy herds-Risk factors and effect of control measures.

  2020influential reference
• The impact of ecbolic therapy in the early postpartum period on uterine involution and reproductive health in dairy cows

  2019cited by this paper
• Are confidence intervals better termed “uncertainty intervals”?

  2019influential reference
• Valid P-Values Behave Exactly as They Should: Some Misleading Criticisms of P-Values and Their Resolution With S-Values

  2019influential reference
• Invited review: Reproducible research from noisy data: Revisiting key statistical principles for the animal sciences.

  2018cited by this paper
• Equivalence Tests

  2017cited by this paper
• Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations

  2016influential reference
• Invited review: Recommendations for reporting intervention studies on reproductive performance in dairy cattle: Improving design, analysis, and interpretation of research on reproduction.

  2016cited by this paper
• Misuse of 'trend' to describe 'almost significant' differences in anaesthesia research.

  2015cited by this paper
• Trap of trends to statistical significance: likelihood of near significant P value becoming more significant with extra data

  2014influential reference
• Power failure: why small sample size undermines the reliability of neuroscience

  2013cited by this paper
• Crystallization, Collapse, and Glass Transition in Low‐Water Food Systems

  2010cited by this paper
• Effects of calcium chloride and calcium sulfate in an oral bolus given as a supplement to postpartum dairy cows.

  2009influential reference
• Invited review: Use of meta-analysis in animal health and reproduction: methods and applications.

  2009cited by this paper
• Ordinal logistic regression

  2008cited by this paper
• A meta-analysis of the impact of monensin in lactating dairy cattle. Part 2. Production effects.

  2008influential reference
• Assessment of the duration of the pain response associated with lameness in dairy cows, and the influence of treatment

  2008cited by this paper
• The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant

  2006influential reference
• Effects of rumen-protected choline and monensin on milk production and metabolism of periparturient dairy cows.

  2006influential reference
• Role of ketoprofen in the modulation of hyperalgesia associated with lameness in dairy cattle

  2005influential reference
• Effect of a monensin controlled release capsule on metabolic parameters in transition dairy cows.

  2003influential reference
• Statistical Assumptions as Empirical Commitments

  2001cited by this paper
• Measurement in Medicine: The Analysis of Method Comparison Studies

  1983cited by this paper

• Either a Confidence Interval Covers, or It Doesn't (Or Does It?): A Model-Based View of Ex-Post Coverage Probability

  2026cites this paper
• JDS Communications® 2025 Editorial Report.

  2026cites this paper
• Effects of supplementing a Bacillus-based direct-fed microbial on ex vivo fermentation traits and on performance of lactating Holstein dairy cows.

  2025cites this paper
• A comparison of short-term analgesic effects of xylazine alone or combined with levomethadone or ketamine in calves after hot-iron disbudding.

  2025cites this paper