Praznik: High performance information-based feature selection

Abstract Information filters are an important class of feature selection methods. They bring together strong theoretical background, execution speed and high selection quality. The paper provides a brief review of said methods and introduces praznik, an R package collecting their efficient implementations. Its functionality is discussed with illustrative example analyses on established benchmark datasets, which also demonstrate the package’s competitive accuracy and very high computational efficiency in comparison to other tools. Moreover, praznik exposes its low-level functionality, which aims to support research and development of novel information theory based methods.

• Publication year

  2021

• Venue

  SoftwareX

• Publication date

  2021-12-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1016/j.softx.2021.100819
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Predicting COVID-19 mortality with electronic medical records

  2021cited by this paper
• Combination of Ensembles of Regularized Regression Models with Resampling-Based Lasso Feature Selection in High Dimensional Data

  2020cited by this paper
• Feature selection methods for root‐cause analysis among top‐level product attributes

  2020cited by this paper
• Gene Selection for Cancer Classification using a New Hybrid of Binary Black Hole Algorithm

  2020cited by this paper
• mlr: Machine Learning in R

  2016cited by this paper
• Domain-Adversarial Training of Neural Networks

  2015cited by this paper
• R: A language and environment for statistical computing.

  2014cited by this paper
• Conditional Likelihood Maximisation: A Unifying Framework for Information Theoretic Feature Selection

  2012cited by this paper
• Feature Selection with the Boruta Package

  2010cited by this paper
• Classification and Regression by randomForest

  2007cited by this paper
• Consistent Feature Selection for Pattern Recognition in Polynomial Time

  2007cited by this paper
• Computational Statistics and Data Analysis (CSDA)

  2006cited by this paper
• A Mathematical Theory of Communication

  2006cited by this paper
• On the Use of Variable Complementarity for Feature Selection in Cancer Classification

  2006cited by this paper
• The igraph software package for complex network research

  2006cited by this paper
• Filter Methods

  2006cited by this paper
• Result Analysis of the NIPS 2003 Feature Selection Challenge

  2004cited by this paper
• Fast Binary Feature Selection with Conditional Mutual Information

  2004cited by this paper
• Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy

  2003cited by this paper
• An Introduction to Variable and Feature Selection

  2003cited by this paper
• Random Forests

  2001cited by this paper
• System Response Time and User Satisfaction: An Experimental Study of Browser-based Applications

  2000cited by this paper
• Data Visualization and Feature Selection: New Algorithms for Nongaussian Data

  1999cited by this paper
• OpenMP: an industry standard API for shared-memory programming

  1998cited by this paper
• A decision-theoretic generalization of on-line learning and an application to boosting

  1997cited by this paper
• Irrelevant Features and the Subset Selection Problem

  1994cited by this paper
• The mathematical theory of communication

  1950cited by this paper
• THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS

  1936cited by this paper
• Expert Systems With Applications

  year unknowncited by this paper

• A group decision making-based parallel multi-label feature selection for big data applications

  2026cites this paper
• The floral volatile methyl salicylate influences pollinators and pollination at multiple spatial scales

  2026cites this paper
• A new statistical framework for future drought assessment – mutual information-based regional integrated standardized multicriteria decision for drought assessment

  2025cites this paper
• Advancing climate modeling: a multi-framework methodology for evaluating GCMs and predicting drought trends

  2025cites this paper
• Amino Acid Profile Alterations in the Mother–Fetus System in Gestational Diabetes Mellitus and Macrosomia

  2025cites this paper
• Multi-scale multi-label feature selection via fuzzy mutual information

  2025cites this paper
• Improving future drought predictions – a novel multi-method framework based on mutual information for subset selection and spatial aggregation of global climate models of precipitation

  2024cites this paper
• Prediction enhancement for surface water sodium adsorption ratio using limited inputs: Implementation of hybridized stacked ensemble model with feature selection algorithm

  2024cites this paper
• Development of Forecasting of Monthly SAR Time Series in River Systems: A Multivariate Data Decomposition-Based Hybrid Approach

  2024cites this paper
• A novel framework for multi-label feature selection: integrating mutual information and Pythagorean fuzzy CRADIS

  2024cites this paper
• Sparse feature selection and rare value prediction in imbalanced regression

  2024cites this paper
• Identification of Tumor Budding-Associated Genes in Breast Cancer through Transcriptomic Profiling and Network Diffusion Analysis

  2024cites this paper
• QSAR Regression Models for Predicting HMG-CoA Reductase Inhibition

  2024cites this paper
• Radiomic analysis for early differentiation of lung cancer recurrence from fibrosis in patients treated with lung stereotactic ablative radiotherapy

  2023influential citation
• An Efficient Binary Sand Cat Swarm Optimization for Feature Selection in High-Dimensional Biomedical Data

  2023cites this paper
• Development of a Machine Learning-Based Model to Predict Timed-Up-and-Go Test in Older Adults

  2023cites this paper
• Exploring the uncertainty of machine learning models and geostatistical mapping of rare earth element potential in Indiana coals, USA

  2023cites this paper
• Left Ventricular Myocardial Dysfunction Evaluation in Thalassemia Patients Using Echocardiographic Radiomic Features and Machine Learning Algorithms

  2023influential citation
• CT radiomics to predict Deauville score 4 positive and negative Hodgkin lymphoma manifestations

  2022cites this paper
• Bread crust extract protects rats’ vascular grafts from in vitro ischemia/reperfusion injury

  2022cites this paper
• MyDJ: Sensing Food Intakes with an Attachable on Your Eyeglass Frame

  2022cites this paper
• Fine-Scale Mapping of Natural Ecological Communities Using Machine Learning Approaches

  2022cites this paper
• Kendall transformation brings a robust categorical representation of ordinal data

  2020cites this paper