Toward a Fairness-Aware Scoring System for Algorithmic Decision-Making

Scoring systems, as a type of predictive model, have significant advantages in interpretability and transparency and facilitate quick decision-making. As such, scoring systems have been extensively used in a wide variety of industries such as healthcare and criminal justice. However, the fairness issues in these models have long been criticized, and the use of big data and machine learning algorithms in the construction of scoring systems heightens this concern. In this paper, we propose a general framework to create fairness-aware, data-driven scoring systems. First, we develop a social welfare function that incorporates both efficiency and group fairness. Then, we transform the social welfare maximization problem into the risk minimization task in machine learning, and derive a fairness-aware scoring system with the help of mixed integer programming. Lastly, several theoretical bounds are derived for providing parameter selection suggestions. Our proposed framework provides a suitable solution to address group fairness concerns in the development of scoring systems. It enables policymakers to set and customize their desired fairness requirements as well as other application-specific constraints. We test the proposed algorithm with several empirical data sets. Experimental evidence supports the effectiveness of the proposed scoring system in achieving the optimal welfare of stakeholders and in balancing the needs for interpretability, fairness, and efficiency.

• Publication year

  2021

• Venue

  Unknown venue

• Publication date

  2021-09-21

• Fields of study

  Mathematics, Computer Science, Economics

• Identifiers
  arXiv 2109.10053
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• An Instrumental Variable Forest Approach for Detecting Heterogeneous Treatment Effects in Observational Studies

  2021cited by this paper
• Understanding the complexity of sepsis mortality prediction via rule discovery and analysis: a pilot study

  2021cited by this paper
• New machine learning scoring system for predicting postoperative mortality in gastroduodenal ulcer perforation: A study using a Japanese nationwide inpatient database.

  2021cited by this paper
• Unequal but Fair: Incorporating Distributive Justice in Operational Allocation Models

  2021cited by this paper
• Fairness in Credit Scoring: Assessment, Implementation and Profit Implications

  2021cited by this paper
• Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects

  2021cited by this paper
• Finance and Firm Volatility: Evidence from Small Business Lending in China

  2021cited by this paper
• Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021

  2021cited by this paper
• Privacy-Preserving Cost-Sensitive Learning

  2020influential reference
• Too Relaxed to Be Fair

  2020influential reference
• Serum bilirubin level correlates with mortality in patients with traumatic brain injury

  2020cited by this paper
• Five-County Validation of the Indiana Risk Assessment System – Pretrial Assessment Tool (IRAS-PAT) using a Local Validation Approach

  2020cited by this paper
• Artificial Intelligence and Algorithmic Bias: Source, Detection, Mitigation, and Implications

  2020cited by this paper
• Validation of the Ohio Youth Assessment System Dispositional Tool (OYAS-DIS): An Examination of Race and Gender Differences

  2020cited by this paper
• Crowd, Lending, Machine, and Bias

  2020cited by this paper
• Designing Fairly Fair Classifiers Via Economic Fairness Notions

  2020cited by this paper
• Overbooked and Overlooked: Machine Learning and Racial Bias in Medical Appointment Scheduling

  2020cited by this paper
• Estimating poverty rates in subnational populations of interest: An assessment of the Simple Poverty Scorecard

  2020cited by this paper
• Fairness in Machine Learning

  2020cited by this paper
• Fair allocation of indivisible goods and chores

  2019cited by this paper
• Unlocking Fairness: a Trade-off Revisited

  2019cited by this paper
• Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads

  2019cited by this paper
• Interpretable Machine Learning

  2019cited by this paper
• Dissecting racial bias in an algorithm used to manage the health of populations

  2019influential reference
• Inherent Tradeoffs in Learning Fair Representation

  2019cited by this paper
• Risk factors for mortality in elderly and very elderly critically ill patients with sepsis: a prospective, observational, multicenter cohort study

  2019influential reference
• A Survey on Bias and Fairness in Machine Learning

  2019influential reference
• Assessing algorithmic fairness with unobserved protected class using data combination

  2019cited by this paper
• Group Retention when Using Machine Learning in Sequential Decision Making: the Interplay between User Dynamics and Fairness

  2019cited by this paper
• Fairness Constraints: A Flexible Approach for Fair Classification

  2019influential reference
• Big Data Analytics in Operations Management

  2018cited by this paper
• Predicting Colorectal Cancer Mortality: Models to Facilitate Patient‐Physician Conversations and Inform Operational Decision Making

  2018cited by this paper
• A community approach to mortality prediction in sepsis via gene expression analysis

  2018influential reference
• Empirical Risk Minimization under Fairness Constraints

  2018influential reference
• Probably Approximately Metric-Fair Learning

  2018cited by this paper
• Integer Programming

  2018cited by this paper
• Bilirubin Is Inversely Associated With Cardiovascular Disease Among HIV‐Positive and HIV‐Negative Individuals in VACS (Veterans Aging Cohort Study)

  2018cited by this paper
• Designing Fair, Efficient, and Interpretable Policies for Prioritizing Homeless Youth for Housing Resources

  2018cited by this paper
• Classification with Fairness Constraints: A Meta-Algorithm with Provable Guarantees

  2018influential reference
• AI can be sexist and racist — it’s time to make it fair

  2018cited by this paper
• Approximation algorithms for stochastic clustering

  2018cited by this paper
• Ensuring Fairness in Machine Learning to Advance Health Equity

  2018cited by this paper
• Efficiency in lung transplant allocation strategies

  2018cited by this paper
• Assessing Risk Assessment in Action

  2018cited by this paper
• Big Data and Service Operations

  2018cited by this paper
• Association of an Electroencephalography-Based Risk Score With Seizure Probability in Hospitalized Patients

  2017cited by this paper
• CREDIT SCORING IN THE ERA OF BIG DATA

  2017cited by this paper
• Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness

  2017cited by this paper
• The Role of Beliefs in Driving Gender Discrimination

  2017cited by this paper
• Implementation of the Surviving Sepsis Campaign guidelines

  2017cited by this paper
• Fairness in Criminal Justice Risk Assessments: The State of the Art

  2017cited by this paper
• Which Is the Fairest (Rent Division) of Them All?

  2017cited by this paper
• Recycling Privileged Learning and Distribution Matching for Fairness

  2017cited by this paper
• Algorithmic Decision Making and the Cost of Fairness

  2017influential reference
• A Short-term Intervention for Long-term Fairness in the Labor Market

  2017cited by this paper
• Learning Non-Discriminatory Predictors

  2017cited by this paper
• Psychometric properties of the PTSD Checklist for DSM-5: a pilot study

  2016cited by this paper
• Inherent Trade-Offs in the Fair Determination of Risk Scores

  2016cited by this paper
• Fair Division of Indivisible Goods

  2016cited by this paper
• Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatment

  2016influential reference
• Glasgow Coma Scale used as a prognostic factor in unconscious patients following cardiac arrest in prehospital situations: preliminary data.

  2016cited by this paper
• Equality of Opportunity in Supervised Learning

  2016influential reference
• MIMIC-III, a freely accessible critical care database

  2016influential reference
• Controversies in Critical Care Nutrition Support.

  2016cited by this paper
• Big Data's Disparate Impact

  2016influential reference
• Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments

  2016influential reference
• The Case for Process Fairness in Learning: Feature Selection for Fair Decision Making

  2016cited by this paper
• Variability in targeted arterial oxygenation levels in patients with severe sepsis or septic shock

  2015influential reference
• Supersparse linear integer models for optimized medical scoring systems

  2015influential reference
• Does unfairness feel different if it can be linked to group membership? Cognitive, affective, behavioral and physiological implications of discrimination and unfairness☆

  2015cited by this paper
• A targeted real-time early warning score (TREWScore) for septic shock

  2015cited by this paper
• Fairness Constraints: Mechanisms for Fair Classification

  2015cited by this paper
• Interpretable classification models for recidivism prediction

  2015influential reference
• The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)

  2015influential reference
• Predicting Customer Value Using Clumpiness: From RFM to RFMC

  2015cited by this paper
• Using Fairness Models to Improve Equity in Health Delivery Fleet Management

  2014cited by this paper
• LIBOL: a library for online learning algorithms

  2014cited by this paper
• A survey of Algorithms and Analysis for Adaptive Online Learning

  2014cited by this paper
• Development and validation of the Emergency Department Assessment of Chest pain Score and 2 h accelerated diagnostic protocol

  2014influential reference
• Risks of mortality associated with common laboratory tests: a novel, simple and meaningful way to set decision limits from data available in the Electronic Medical Record

  2013influential reference
• HIV affected households in Western Kenya experience greater food insecurity

  2013cited by this paper
• Fairness, Efficiency, and Flexibility in Organ Allocation for Kidney Transplantation

  2013cited by this paper
• Cake cutting: not just child's play

  2013cited by this paper
• Surviving sepsis campaign : international guidelines for management of severe sepsis and septic shock

  2013cited by this paper
• Severity scoring in the critically ill: part 2: maximizing value from outcome prediction scoring systems.

  2012cited by this paper
• A hybrid approach to integrate genetic algorithm into dual scoring model in enhancing the performance of credit scoring model

  2012cited by this paper
• Direct Tests of Individual Preferences for Efficiency and Equity

  2012cited by this paper
• Microcredit in Theory and Practice: Using Randomized Credit Scoring for Impact Evaluation

  2011cited by this paper
• Fairness through awareness

  2011influential reference
• Support Vector Machines with the Ramp Loss and the Hard Margin Loss

  2011cited by this paper
• Self-Interest through Delegation: An Additional Rationale for the Principal-Agent Relationship

  2010influential reference
• Social Identity and Preferences.

  2010cited by this paper
• An Objective Multiattribute Analysis Approach for Allocation of Scarce Irrigation Water Resources 1

  2010cited by this paper
• Neural evidence for inequality-averse social preferences

  2010cited by this paper
• Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. 1992.

  2009cited by this paper
• Knowledge discovery on RFM model using Bernoulli sequence

  2009cited by this paper
• Severity scoring in the ICU: a review

  2008cited by this paper
• Do Women Pay More for Credit? Evidence from Italy

  2008cited by this paper
• PREDICTIVE LEARNING VIA RULE ENSEMBLES

  2008cited by this paper
• Chest pain in the emergency room: value of the HEART score

  2008cited by this paper

• No citing papers are available for this paper.