A Novel Weighted Hybrid Method for Multiple Hypothesis Testing of Genomic Data

Multiple Hypothesis Testing presents challenges due to increased false discoveries when conducting statistical tests simultaneously. Despite the pro-posal of novel correction techniques, the procedure of selecting the most suit-able method has remained a black box. The trade-off that arises from con-trolling false positives and negatives through different correction techniques underlines the need for a cohesive framework. This study addresses the above challenges with a special focus on gene expression data and evaluates six widely used Multiple Hypothesis Testing (MHT) methods, namely, Bonferroni, Holm, sequential goodness of fit (SGoF), Benjamini-Hochberg, Benjamini-Yekutieli, and Storey’s Q-values, across different scenarios to compare two in-dependent groups. Our results show that Storey’s Q-value performs well with large effect sizes, whereas SGoF excels in low-effect scenarios. However, the Bonferroni and Holm methods offer high precision owing to the strict control of false positives. Recognizing the limitations of relying on a single method, we introduce a novel Weighted Hybrid Method (WHM), a decision-support framework that allows users to navigate between approaches rather than serv-ing as a new statistical test. An innovative Significant Index Plot (SIP) is un-veiled to assist in the detection of significant hypotheses across different meth-ods. The framework was tested on four genomic datasets: gene expression in multiple sclerosis (GSE21942), myelodysplastic syndrome (GSE61853), alcohol-related gene expression (GSE52553), and age-related corneal tran-scriptomes (GSE58315), extending the usage to enable independent hypoth-esis weighting. A novel Python library, MultiDST, and a web interface were developed to enable researchers to apply the framework efficiently, improving the transparency of their findings.

• Publication year

  2025

• Venue

  Sri Lankan Journal of Applied Statistics

• Publication date

  2025-08-28

• Fields of study

  Not labeled

• Identifiers
  DOI 10.4038/sljas.v26i2.8201
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Revisiting the genome-wide significance threshold for common variant GWAS

  2021cited by this paper
• MultipleTesting.com: A tool for life science researchers for multiple hypothesis testing correction

  2021cited by this paper
• Accounting for multiple testing in the analysis of spatio-temporal environmental data

  2020cited by this paper
• Bon-EV: an improved multiple testing procedure for controlling false discovery rates

  2017cited by this paper
• Data-driven hypothesis weighting increases detection power in genome-scale multiple testing

  2016cited by this paper
• Statistical Significance for Genome Wide Studies Under Unequal Variance

  2015cited by this paper
• Increased Expression of Interferon Signaling Genes in the Bone Marrow Microenvironment of Myelodysplastic Syndromes

  2015cited by this paper
• Evolution of Cis-Regulatory Elements and Regulatory Networks in Duplicated Genes of Arabidopsis1[OPEN]

  2015cited by this paper
• sgof: An R Package for Multiple Testing Problems

  2014cited by this paper
• Ethanol treatment of lymphoblastoid cell lines from alcoholics and non-alcoholics causes many subtle changes in gene expression.

  2014cited by this paper
• Transcriptome analysis of the human corneal endothelium.

  2014cited by this paper
• Tutorial in biostatistics: multiple hypothesis testing in genomics

  2012cited by this paper
• Systematic review of genome-wide expression studies in multiple sclerosis

  2011cited by this paper
• Theories of Data Analysis: From Magical Thinking Through Classical Statistics

  2011cited by this paper
• A new multitest correction (SGoF) that increases its statistical power when increasing the number of tests

  2009influential reference
• Why Most Published Research Findings Are False

  2005cited by this paper
• THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY

  2001cited by this paper
• The Future of Genetic Studies of Complex Human Diseases

  1996cited by this paper
• Controlling the false discovery rate: a practical and powerful approach to multiple testing

  1995cited by this paper
• A Simple Sequentially Rejective Multiple Test Procedure

  1979cited by this paper
• Some thoughts on clinical trials, especially problems of multiplicity.

  1977cited by this paper
• Il calcolo delle assicurazioni su gruppi di teste

  1935cited by this paper

• No citing papers are available for this paper.