Hypothesis Tests for Bernoulli Experiments: Ordering the Sample Space by Bayes Factors and Using Adaptive Significance Levels for Decisions

The main objective of this paper is to find the relation between the adaptive significance level presented here and the sample size. We statisticians know of the inconsistency, or paradox, in the current classical tests of significance that are based on p-value statistics that are compared to the canonical significance levels (10%, 5%, and 1%): “Raise the sample to reject the null hypothesis” is the recommendation of some ill-advised scientists! This paper will show that it is possible to eliminate this problem of significance tests. We present here the beginning of a larger research project. The intention is to extend its use to more complex applications such as survival analysis, reliability tests, and other areas. The main tools used here are the Bayes factor and the extended Neyman–Pearson Lemma.

• Publication year

  2017

• Venue

  Entropy

• Publication date

  2017-12-20

• Fields of study

  Mathematics, Computer Science

• Identifiers
  DOI 10.3390/e19120696
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Title: Redefine Statistical Significance

  2017cited by this paper
• Big names in statistics want to shake up much-maligned P value

  2017cited by this paper
• The ASA Statement on p-Values: Context, Process, and Purpose

  2016cited by this paper
• Error probabilities in default Bayesian hypothesis testing

  2016cited by this paper
• Adaptative significance levels using optimal decision rules: Balancing by weighting the error probabilities

  2016cited by this paper
• Measuring statistical evidence using relative belief

  2015cited by this paper
• Reproducibility issues in science, is P value really the only answer?

  2014cited by this paper
• Bayesian epistemic values: focus on surprise, measure probability!

  2014cited by this paper
• Gamma ventral capsulotomy for obsessive-compulsive disorder: a randomized clinical trial.

  2014cited by this paper
• Adaptive revised standards for statistical evidence

  2014cited by this paper
• Revised evidence for statistical standards

  2014cited by this paper
• A New Bayesian Test to Test for the Intractability-Countering Hypothesis

  2013cited by this paper
• Revised standards for statistical evidence

  2013cited by this paper
• RELATIONSHIP BETWEEN BAYESIAN AND FREQUENTIST SIGNIFICANCE INDICES

  2012cited by this paper
• Can a Significance Test Be Genuinely Bayesian

  2008cited by this paper
• Principles of Statistical Inference

  2006cited by this paper
• CALIBRATING BAYES FACTOR UNDER PRIOR PREDICTIVE DISTRIBUTIONS

  2005cited by this paper
• Bayesian evidence test for precise hypotheses

  2003cited by this paper
• An unconditional exact test for the Hardy-Weinberg equilibrium law: sample-space ordering using the Bayes factor.

  2001cited by this paper
• Compatible prior distributions

  2000cited by this paper
• BAYESIAN HYPOTHESIS TEST: Using Surface Integrals to Distribute Prior Information Among the Hypotheses

  1995cited by this paper
• Bayes factors

  1995cited by this paper
• Elimination of Nuisance Parameters

  1988cited by this paper
• ON THE CONCEPT OF P-VALUE

  1988cited by this paper
• The Weighted Likelihood Ratio, Linear Hypotheses on Normal Location Parameters

  1971cited by this paper
• Sequential Trials, Sequential Analysis and the Likelihood Principle

  1966cited by this paper
• Probability and Statistics

  1959influential reference
• A STATISTICAL PARADOX

  1957cited by this paper
• A comment on D. V. Lindley's statistical paradox

  1957cited by this paper
• On the Problem of the Most Efficient Tests of Statistical Hypotheses

  1933cited by this paper
• Theory of Probability

  year unknowncited by this paper

• Digital public infrastructure as a driver of financial inclusion in India

  2025influential citation
• On the Nuisance Parameter Elimination Principle in Hypothesis Testing

  2024cites this paper
• A Bayesian Measure of Model Accuracy

  2024cites this paper
• A Bayesian robustness measure in significance tests for equivalence tests

  2024influential citation
• Are the tests overpowered or underpowered? A unified solution to correctly specify type I errors in design of clinical trials for two sample proportions

  2024cites this paper
• Adaptive Significance Levels in Tests for Linear Regression Models: The e-Value and P-Value Cases

  2022cites this paper
• New Bayesian approaches to equivalence testing

  2021influential citation
• Community security is the key to sustainable governance: Methods and functions of crime hotspot predictions

  2021cites this paper
• A Bayesian binary algorithm for root mean squared-based acoustic signal segmentation.

  2019cites this paper
• Adaptative significance levels in linear regression models with known variance

  2019cites this paper
• Blending Bayesian and Classical Tools to Define Optimal Sample-Size-Dependent Significance Levels

  2019cites this paper