Cost-Sensitive Classification: Empirical Evaluation of a Hybrid Genetic Decision Tree Induction Algorithm

This paper introduces ICET, a new algorithm for cost-sensitive classification. ICET uses a genetic algorithm to evolve a population of biases for a decision tree induction algorithm. The fitness function of the genetic algorithm is the average cost of classification when using the decision tree, including both the costs of tests (features, measurements) and the costs of classification errors. ICET is compared here with three other algorithms for cost-sensitive classification -- EG2, CS-ID3, and IDX -- and also with C4.5, which classifies without regard to cost. The five algorithms are evaluated empirically on five real-world medical datasets. Three sets of experiments are performed. The first set examines the baseline performance of the five algorithms on the five datasets and establishes that ICET performs significantly better than its competitors. The second set tests the robustness of ICET under a variety of conditions and shows that ICET maintains its advantage. The third set looks at ICET's search in bias space and discovers a way to improve the search.

• Publication year

  1994

• Venue

  Journal of Artificial Intelligence Research

• Publication date

  1994-08-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1613/jair.120arXiv cs/9503102
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• How Learning Can Guide Evolution

  1996cited by this paper
• Learning and evolution: a quantitative genetics approach.

  1995cited by this paper
• Goal-Directed Inductive Learning: Trading off Accuracy for Reduced Error Cost

  1994influential reference
• An Artificial Intelligence Approach

  1994cited by this paper
• Cost-Sensitive Pruning of Decision Trees

  1994cited by this paper
• Lamarckian Evolution, The Baldwin Effect and Function Optimization

  1994cited by this paper
• Feature Selection for Case-Based Classification of Cloud Types: An Empirical Comparison

  1994cited by this paper
• Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin Effect

  1993cited by this paper
• Lookahead Feature Construction for Learning Hard Concepts

  1993cited by this paper
• An SE-tree based Characterization of the Induction Problem

  1993cited by this paper
• Crossover or Mutation?

  1992cited by this paper
• Genetic Programming: On the Programming of Computers by Means of Natural Selection

  1992cited by this paper
• Combinations of genetic algorithms and neural networks: a survey of the state of the art

  1992cited by this paper
• C4.5: Programs for Machine Learning

  1992influential reference
• Interactions between learning and evolution

  1991cited by this paper
• An Artificial Intelligence Approach to Analog Systems Diagnosis

  1991cited by this paper
• A Method for Inductive Cost Optimization

  1991cited by this paper
• Probabilistic reasoning in intelligent systems: Networks of plausible inference

  1991influential reference
• CSL: a cost-sensitive learning system for sensing and grasping objects

  1990influential reference
• Generating Better Decision Trees

  1989influential reference
• Explicitly biased generalization

  1989influential reference
• Building Robust Learning Systems by Combining Induction and Optimization

  1989cited by this paper
• Cost-Sensitive Concept Learning of Sensor Use in Approach ad Recognition

  1989influential reference
• Economic Induction: A Case Study

  1988influential reference
• When learning guides evolution

  1987cited by this paper
• Optimization of Control Parameters for Genetic Algorithms

  1986influential reference
• Heuristics : intelligent search strategies for computer problem solving

  1984cited by this paper
• Projection Pursuit Regression

  1981influential reference
• Cases of doubt in allocation problems

  1974influential reference
• Canalization of Development and the Inheritance of Acquired Characters

  1942cited by this paper
• A New Factor in Evolution

  1896cited by this paper

• Reducing class overlap in feature space using Kalman filtering with particle swarm optimization

  2025cites this paper
• AFABench: A Generic Framework for Benchmarking Active Feature Acquisition

  2025cites this paper
• Control and optimization of grid-connected inverters for distributed generation using Ziegler–Nichols and Genetic Algorithm

  2025cites this paper
• Cost-Sensitive Learning for HER2-Positive Breast Cancer Diagnosis Using Clinical Data: A Resourceconscious Framework for Low-Resource Settings

  2025cites this paper
• An Intelligent Model Based on Data Mining and Machine Learning Approaches for Diagnosing Hepatitis Disease

  2025cites this paper
• A Mathematical Programming Model with Cost Sensitivity in the Objective Function for Imbalanced Datasets Challenges

  2025cites this paper
• Feature selection and extraction strategies for non-targeted analysis using GC-MS and GC-IMS: A tutorial.

  2025cites this paper
• A Generalized Multigranulation Rough Set Model by Synthesizing Optimistic and Pessimistic Attitude Preferences

  2025cites this paper
• Auto Insurance Fraud Detection: Leveraging Cost Sensitive and Insensitive Algorithms for Comprehensive Analysis

  2025cites this paper
• CORTEX: Cost-sensitive rule and tree extraction method

  2025cites this paper
• On enhancing the explainability and fairness of tree ensembles

  2025cites this paper
• A Survey on Active Feature Acquisition Strategies

  2025influential citation
• A Comprehensive Survey on Imbalanced Data Learning

  2025cites this paper
• The InterModel Vigorish (IMV) as a flexible and portable approach for quantifying predictive accuracy with binary outcomes

  2025cites this paper
• Unbiased Isotonic Regression Tree for Discovering Hidden Heterogeneity in Monotonicity Constraints

  2025cites this paper
• Generative Model for Decision Trees

  2024cites this paper
• Artificial intelligence-based optimal EVCS integration with stochastically sized and distributed PVs in an RDNS segmented in zones

  2024cites this paper
• Feature graphs for interpretable unsupervised tree ensembles: centrality, interaction, and application in disease subtyping

  2024cites this paper
• Cost‐sensitive classification with time constraint on incomplete data

  2024cites this paper
• AutoElicit: Using Large Language Models for Expert Prior Elicitation in Predictive Modelling

  2024cites this paper
• Probabilistic scoring lists for interpretable machine learning

  2024cites this paper
• Is F1 Score Suboptimal for Cybersecurity Models? Introducing Cscore, a Cost-Aware Alternative for Model Assessment

  2024cites this paper
• Interval-valued test cost sensitive attribute reduction related to risk attitude

  2024cites this paper
• K-GBS3FCM - KNN Graph-Based Safe Semi-Supervised Fuzzy C-Means

  2024cites this paper
• Learning decision catalogues for situated decision making: The case of scoring systems

  2024cites this paper
• A Novel K-Means Clustering under Bi-Partition of Feature Set

  2024cites this paper
• Applications of Autonomous Learning Multi Model System to Multiclass Imbalanced Datasets

  2024cites this paper
• Identification and ranking biomaterials for bone scaffolds using machine learning and PROMETHEE

  2023cites this paper
• Optimal Allocation of Plug-In Electric Vehicle Charging Stations in The Distribution Network with Distributed Generation

  2023cites this paper
• Optimal Decision Trees for Separable Objectives: Pushing the Limits of Dynamic Programming

  2023influential citation
• Road Feature Detection for Advance Driver Assistance System Using Deep Learning

  2023cites this paper
• Disease Detection and Prediction Using the Liver Function Test Data: A Review of Machine Learning Algorithms

  2022cites this paper
• The Mixed-Integer Linear Programming for Cost-Constrained Decision Trees with Multiple Condition Attributes

  2022cites this paper
• Integration of aggressive bound tightening and Mixed Integer Programming for Cost-sensitive feature selection in medical diagnosis

  2022cites this paper
• A Comparison of Automatic Labelling Approaches for Sentiment Analysis

  2022cites this paper
• Fast Generic Interaction Detection for Model Interpretability and Compression

  2022cites this paper
• Linear Cost-sensitive Max-margin Embedded Feature Selection for SVM

  2022cites this paper
• A hyper-parameter tuning approach for cost-sensitive support vector machine classifiers

  2022cites this paper
• Compressed Rule Ensemble Learning

  2022cites this paper
• Evaluation Gaps in Machine Learning Practice

  2022cites this paper
• Breast cancer diagnosis using feature extraction and boosted C5.0 decision tree algorithm with penalty factor.

  2022cites this paper
• A reinforcement learning guided adaptive cost-sensitive feature acquisition method

  2022cites this paper
• The tree based linear regression model for hierarchical categorical variables

  2022cites this paper
• Constraint Enforcement on Decision Trees: A Survey

  2022cites this paper
• Predict-then-optimize or predict-and-optimize? An empirical evaluation of cost-sensitive learning strategies

  2022cites this paper
• A random forest classifier with cost-sensitive learning to extract urban landmarks from an imbalanced dataset

  2021cites this paper
• Tailoring inventory classification to industry applications: the benefits of understandable machine learning

  2021cites this paper
• Cost-Sensitive LightGBM-Based Online Fault Detection Method for Wind Turbine Gearboxes

  2021cites this paper
• Fraud Detection System Adoption: Success Factors

  2021cites this paper
• Cardiovascular risk assessment using data mining inferencing and feature engineering techniques

  2021cites this paper
• Mathematical optimization in classification and regression trees

  2021cites this paper
• Extraction of Space Containing Noise and Forecast of Complex Data by Multiway Tree Bi-Level GA

  2021cites this paper
• Collaborative Human-ML Decision Making Using Experts' Privileged Information Under Uncertainty

  2021cites this paper
• DEBOHID: A differential evolution based oversampling approach for highly imbalanced datasets

  2021cites this paper
• Using POMDPs for learning cost sensitive decision trees

  2021cites this paper
• Set-valued classification - overview via a unified framework

  2021cites this paper
• Cost-sensitive meta-learning framework

  2021cites this paper
• Cost-sensitive ensemble learning: a unifying framework

  2021cites this paper
• A Mixed Integer Linear Programming Support Vector Machine for Cost-Effective Group Feature Selection: Branch-Cut-and-Price Approach

  2021cites this paper
• Induction of decision trees as classification models through metaheuristics

  2021cites this paper
• Optimising HEP parameter fits via Monte Carlo weight derivative regression

  2020cites this paper
• A False Negative Cost Minimization Ensemble Methods for Customer Churn Analysis

  2020cites this paper
• COSM: Controlled Over-Sampling Method. A Methodological Proposal to Overcome the Class Imbalance Problem in Data Mining

  2020cites this paper
• Cost-sensitive sample shifting in feature space

  2020cites this paper
• Bid-Aware Active Learning in Real-Time Bidding for Display Advertising

  2020cites this paper
• Imbalanced classification: A paradigm‐based review

  2020cites this paper
• Misclassification cost-sensitive ensemble learning: A unifying framework

  2020cites this paper
• Genetic adversarial training of decision trees

  2020cites this paper
• Cost-sensitive ensemble methods for bankruptcy prediction in a highly imbalanced data distribution: a real case from the Spanish market

  2020cites this paper
• Adaptive covariate acquisition for minimizing total cost of classification

  2020cites this paper
• Financial Crime & Fraud Detection Using Graph Computing: Application Considerations & Outlook

  2020cites this paper
• How to Control the Error Rates of Binary Classifiers

  2020cites this paper
• Granularity-driven sequential three-way decisions: A cost-sensitive approach to classification

  2020cites this paper
• Research on personal credit evaluation of internet finance based on blockchain and decision tree algorithm

  2020cites this paper
• Advances in Computational Intelligence: 19th Mexican International Conference on Artificial Intelligence, MICAI 2020, Mexico City, Mexico, October 12–17, 2020, Proceedings, Part II

  2020cites this paper
• Imbalanced classification: an objective-oriented review

  2020cites this paper
• Development, implementation, and prospective validation of a model to predict 60-day end-of-life in hospitalized adults upon admission at three sites

  2020cites this paper
• A mixed integer linear programming support vector machine for cost-effective feature selection

  2020cites this paper
• G-Forest: An ensemble method for cost-sensitive feature selection in gene expression microarrays

  2020cites this paper
• Graph Computing for Financial Crime and Fraud Detection: Trends, Challenges and Outlook

  2020cites this paper
• Cost-sensitive decision tree with multiple resource constraints

  2019cites this paper
• A genetic-ELM neural network computational method for diagnosis of the Parkinson disease gait dataset

  2019cites this paper
• Selective sampling for trees and forests

  2019cites this paper
• Cost-sensitive classifier chains: Selecting low-cost features in multi-label classification

  2019cites this paper
• Enhancing techniques for learning decision trees from imbalanced data

  2019cites this paper
• Cost-sensitive active learning with a label uniform distribution model

  2019cites this paper
• EBNO: Evolution of cost‐sensitive Bayesian networks

  2019cites this paper
• Optimizing Value of Information Over an Infinite Time Horizon

  2019cites this paper
• Cost-Constrained Classifier Cascade using Sparse Probit Models : Invited Presentation

  2019cites this paper
• Classification Problem in Imbalanced Datasets

  2019cites this paper
• Learning misclassification costs for imbalanced classification on gene expression data

  2019cites this paper
• Early Diagnostics Model for Dengue Disease Using Decision Tree-Based Approaches

  2019cites this paper
• Cost-Sensitive Feature Selection Based on Label Significance and Positive Region

  2019cites this paper
• Value of Information in Probabilistic Logic Programs

  2019cites this paper
• Cost-Sensitive Tree Induction

  2019cites this paper
• A Cost-Sensitive Feature Selection Method for High-Dimensional Data

  2019cites this paper
• Synthetic minority oversampling for function approximation problems

  2019cites this paper
• A Variable Importance Measure for a Cost Sensitive Random forest Predition on a Budget.

  2019influential citation
• Cost-sensitive feature selection using two-archive multi-objective artificial bee colony algorithm

  2019cites this paper
• Rough Sets: International Joint Conference, IJCRS 2019, Debrecen, Hungary, June 17–21, 2019, Proceedings

  2019cites this paper