Multiple comparison procedures for discrete uniform and homogeneous tests

Discrete uniform and homogeneous p‐values often arise in applications with multiple testing. For example, this occurs in genome wide association studies whenever a non‐parametric one‐sample (or two‐sample) test is applied throughout the gene loci. In this paper, we consider multiple comparison procedures for such scenarios based on several existing estimators for the proportion of true null hypotheses, π0 , which take the discreteness of the p‐values into account. The theoretical guarantees of the several approaches with respect to the estimation of π0 and the false discovery rate control are reviewed. The performance of the discrete procedures is investigated through intensive Monte Carlo simulations considering both independent and dependent p‐values. The methods are applied to three real data sets for illustration purposes too. Since the particular estimator of π0 used to compute the q‐values may influence its performance, relative advantages and disadvantages of the reviewed procedures are discussed. Practical recommendations are given.

• Publication year

  2021

• Venue

  Journal of the Royal Statistical Society: Series C (Applied Statistics)

• Publication date

  2021-11-26

• Fields of study

  Not labeled

• Identifiers
  DOI 10.1111/rssc.12529
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Comments on Dr. Aniket Biswas' Letter to the Editor

  2020cited by this paper
• On Benjamini–Hochberg procedure applied to mid p-values

  2019influential reference
• A two-sample test for the equality of univariate marginal distributions for high-dimensional data

  2019cited by this paper
• Goodness‐of‐fit tests for disorder detection in NGS experiments

  2018cited by this paper
• False discovery rate control for multiple testing based on discrete p‐values

  2018cited by this paper
• New FDR bounds for discrete and heterogeneous tests

  2018cited by this paper
• False discovery rate estimation for large‐scale homogeneous discrete p‐values

  2016influential reference
• The Power of Alternative Kolmogorov-Smirnov Tests Based on Transformations of the Data

  2015cited by this paper
• Multiple testing with discrete data: Proportion of true null hypotheses and two adaptive FDR procedures

  2014cited by this paper
• Multiple Test Functions and Adjusted p-Values for Test Statistics with Discrete Distributions

  2014cited by this paper
• Empirical Test of the Strong Form Efficiency of the Warsaw Stock Exchange: The Analysis of WIG 20 Index Shares

  2012cited by this paper
• Statistical Applications in Genetics and Molecular Biology How to analyze many contingency tables simultaneously in genetic association studies

  2012cited by this paper
• Adaptive and dynamic adaptive procedures for false discovery rate control and estimation

  2012cited by this paper
• False discovery rate controlling procedures for discrete tests

  2011influential reference
• Genome analysis Advance Access publication April 2, 2012 CONTRA: copy number analysis for targeted resequencing

  2011cited by this paper
• A False Discovery Rate Procedure for Categorical Data

  2011cited by this paper
• Discovering the false discovery rate

  2010cited by this paper
• On fuzzy familywise error rate and false discovery rate procedures for discrete distributions

  2009cited by this paper
• Adaptive False Discovery Rate Control under Independence and Dependence

  2009cited by this paper
• Efficient Capital Markets: A Review of Theory and Empirical Work

  2007cited by this paper
• A modified false discovery rate multiple‐comparisons procedure for discrete data, applied to human immunodeficiency virus genetics

  2005cited by this paper
• Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach

  2004influential reference
• Time series analysis.

  2003cited by this paper
• Statistical significance for genomewide studies

  2003influential reference
• The positive false discovery rate: a Bayesian interpretation and the q-value

  2003cited by this paper
• Gene-expression profiles in hereditary breast cancer.

  2001cited by this paper
• THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY

  2001cited by this paper
• A step-down multiple hypotheses testing procedure that controls the false discovery rate under independence

  1999cited by this paper
• Controlling the false discovery rate: a practical and powerful approach to multiple testing

  1995cited by this paper
• Hereditary breast cancer.

  1991influential reference
• Nonparametric Statistical Inference (2nd ed.)

  1986influential reference
• Stock return variances: The arrival of information and the reaction of traders

  1986cited by this paper
• On the Impossibility of Informationally Efficient Markets

  1980cited by this paper
• Robust tests for equality of variances

  1961influential reference
• Rank-Sum Tests for Dispersions

  1960cited by this paper
• A Nonparametric Sum of Ranks Procedure for Relative Spread in Unpaired Samples

  1960cited by this paper

• AICO: Feature Significance Tests for Supervised Learning

  2025cites this paper