Taming the Triangle: On the Interplays Between Fairness, Interpretability, and Privacy in Machine Learning

Machine learning techniques are increasingly used for high‐stakes decision‐making, such as college admissions, loan attribution, or recidivism prediction. Thus, it is crucial to ensure that the models learnt can be audited or understood by human users, do not create or reproduce discrimination or bias and do not leak sensitive information regarding their training data. Indeed, interpretability, fairness, and privacy are key requirements for the development of responsible machine learning, and all three have been studied extensively during the last decade. However, they were mainly considered in isolation, while in practice they interplay with each other, either positively or negatively. In this survey paper, we review the literature on the interactions between these three desiderata. More precisely, for each pairwise interaction, we summarize the identified synergies and tensions. These findings highlight several fundamental theoretical and empirical conflicts, while also demonstrating that jointly considering these different requirements is challenging when one aims at preserving a high level of utility. To solve this issue, we also discuss possible conciliation mechanisms, showing that a careful design can enable to successfully handle these different concerns in practice.

• Publication year

  2025

• Venue

  International Conference on Climate Informatics

• Publication date

  2025-08-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1111/coin.70113
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• It's complicated. The relationship of algorithmic fairness and non-discrimination regulations in the EU AI Act

  2025cited by this paper
• Fairness and Sparsity within Rashomon sets: Enumeration-Free Exploration and Characterization

  2025cited by this paper
• Training Set Reconstruction from Differentially Private Forests: How Effective is DP?

  2025cited by this paper
• Be Intentional About Fairness!: Fairness, Size, and Multiplicity in the Rashomon Set

  2025cited by this paper
• Privacy-preserving explainable AI: a survey

  2024cited by this paper
• Trained Random Forests Completely Reveal your Dataset

  2024cited by this paper
• Fooling SHAP with Stealthily Biased Sampling

  2023cited by this paper
• (Local) Differential Privacy has NO Disparate Impact on Fairness

  2023cited by this paper
• How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy

  2023cited by this paper
• An Empirical Analysis of Fairness Notions under Differential Privacy

  2023cited by this paper
• Balancing Privacy Protection and Interpretability in Federated Learning

  2023cited by this paper
• FairDP: Achieving Fairness Certification with Differential Privacy

  2023cited by this paper
• Privacy-Preserving Algorithmic Recourse

  2023cited by this paper
• Probabilistic Dataset Reconstruction from Interpretable Models

  2023cited by this paper
• Fairness and Privacy-Preserving in Federated Learning: A Survey

  2023cited by this paper
• No Matter How You Slice It: Machine Unlearning with SISA Comes at the Expense of Minority Classes

  2023cited by this paper
• Having your Privacy Cake and Eating it Too: Platform-supported Auditing of Social Media Algorithms for Public Interest

  2022cited by this paper
• Position: Tensions Between the Proxies of Human Values in AI

  2022influential reference
• Learning Optimal Fair Decision Trees: Trade-offs Between Interpretability, Fairness, and Accuracy

  2022cited by this paper
• Differential Privacy has Bounded Impact on Fairness in Classification

  2022cited by this paper
• XRand: Differentially Private Defense against Explanation-Guided Attacks

  2022cited by this paper
• Feature Inference Attack on Shapley Values

  2022cited by this paper
• Exploiting Fairness to Enhance Sensitive Attributes Reconstruction

  2022cited by this paper
• Inferring Sensitive Attributes from Model Explanations

  2022cited by this paper
• Privacy Aware Experimentation over Sensitive Groups: A General Chi Square Approach

  2022cited by this paper
• Differentially Private Counterfactuals via Functional Mechanism

  2022cited by this paper
• Investigating Debiasing Effects on Classification and Explainability

  2022cited by this paper
• A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations

  2022cited by this paper
• Balancing utility and scalability in metric differential privacy

  2022cited by this paper
• DualCF: Efficient Model Extraction Attack from Counterfactual Explanations

  2022cited by this paper
• Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approaches

  2022cited by this paper
• The Road to Explainability is Paved with Bias: Measuring the Fairness of Explanations

  2022cited by this paper
• Balancing Learning Model Privacy, Fairness, and Accuracy With Early Stopping Criteria

  2021cited by this paper
• Adversarial XAI Methods in Cybersecurity

  2021cited by this paper
• A Fairness Analysis on Private Aggregation of Teacher Ensembles

  2021cited by this paper
• Removing Disparate Impact on Model Accuracy in Differentially Private Stochastic Gradient Descent

  2021cited by this paper
• MEGEX: Data-Free Model Extraction Attack Against Gradient-Based Explainable AI

  2021cited by this paper
• DP-SGD vs PATE: Which Has Less Disparate Impact on Model Accuracy?

  2021cited by this paper
• When Differential Privacy Meets Interpretability: A Case Study

  2021cited by this paper
• Feature Attributions and Counterfactual Explanations Can Be Manipulated

  2021cited by this paper
• Counterfactual Explanations Can Be Manipulated

  2021cited by this paper
• Exploiting Explanations for Model Inversion Attacks

  2021cited by this paper
• Interpretable Machine Learning: Fundamental Principles and 10 Grand Challenges

  2021cited by this paper
• On the Privacy Risks of Algorithmic Fairness

  2020cited by this paper
• Differentially Private and Fair Classification via Calibrated Functional Mechanism

  2020cited by this paper
• Problems with Shapley-value-based explanations as feature importance measures

  2020cited by this paper
• Fair Learning with Private Demographic Data

  2020cited by this paper
• You Shouldn't Trust Me: Learning Models Which Conceal Unfairness From Multiple Explanation Methods

  2020cited by this paper
• Ablation-CAM: Visual Explanations for Deep Convolutional Network via Gradient-free Localization

  2020cited by this paper
• Google COVID-19 Community Mobility Reports: Anonymization Process Description (version 1.0)

  2020cited by this paper
• A Survey on Differentially Private Machine Learning [Review Article]

  2020cited by this paper
• Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AI

  2020cited by this paper
• In Pursuit of Interpretable, Fair and Accurate Machine Learning for Criminal Recidivism Prediction

  2020cited by this paper
• Model Explanations with Differential Privacy

  2020cited by this paper
• A Survey of Privacy Attacks in Machine Learning

  2020cited by this paper
• Towards Formal Fairness in Machine Learning

  2020influential reference
• Neither Private Nor Fair: Impact of Data Imbalance on Utility and Fairness in Differential Privacy

  2020cited by this paper
• Differentially Private and Fair Deep Learning: A Lagrangian Dual Approach

  2020cited by this paper
• Fairness in Machine Learning: A Survey

  2020cited by this paper
• Chasing Your Long Tails: Differentially Private Prediction in Health Care Settings

  2020cited by this paper
• Explainability for fair machine learning

  2020cited by this paper
• Enforcing Interpretability and its Statistical Impacts: Trade-offs between Accuracy and Interpretability

  2020cited by this paper
• A Survey on the Explainability of Supervised Machine Learning

  2020cited by this paper
• Improving Fairness and Privacy in Selection Problems

  2020cited by this paper
• Trade-Offs between Fairness and Privacy in Machine Learning

  2020cited by this paper
• A Survey on Bias and Fairness in Machine Learning

  2019cited by this paper
• On the Privacy Risks of Model Explanations

  2019cited by this paper
• CERTIFAI: A Common Framework to Provide Explanations and Analyse the Fairness and Robustness of Black-box Models

  2019cited by this paper
• Interpretable and Differentially Private Predictions

  2019cited by this paper
• Achieving Differential Privacy and Fairness in Logistic Regression

  2019cited by this paper
• Fair decision making using privacy-protected data

  2019cited by this paper
• On the Compatibility of Privacy and Fairness

  2019cited by this paper
• Faithful and Customizable Explanations of Black Box Models

  2019cited by this paper
• Fooling Neural Network Interpretations via Adversarial Model Manipulation

  2019cited by this paper
• Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods

  2019cited by this paper
• "How do I fool you?": Manipulating User Trust via Misleading Black Box Explanations

  2019cited by this paper
• Explaining models: an empirical study of how explanations impact fairness judgment

  2019cited by this paper
• AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias

  2019cited by this paper
• The Bouncer Problem: Challenges to Remote Explainability

  2019cited by this paper
• Learning to Deceive with Attention-Based Explanations

  2019cited by this paper
• Differential Privacy Has Disparate Impact on Model Accuracy

  2019cited by this paper
• Equalizing Recourse across Groups

  2019cited by this paper
• Issues Encountered Deploying Differential Privacy

  2018cited by this paper
• The U.S. Census Bureau Adopts Differential Privacy

  2018cited by this paper
• Fairness Definitions Explained

  2018cited by this paper
• Blind Justice: Fairness with Encrypted Sensitive Attributes

  2018cited by this paper
• A comparative study of fairness-enhancing interventions in machine learning

  2018cited by this paper
• A Reductions Approach to Fair Classification

  2018cited by this paper
• Scalable Private Learning with PATE

  2018influential reference
• A Survey of Methods for Explaining Black Box Models

  2018cited by this paper
• Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead

  2018cited by this paper
• Interpretable Deep Learning under Fire

  2018cited by this paper
• Explainable Black-Box Attacks Against Model-based Authentication

  2018cited by this paper
• Simplicity Creates Inequity: Implications for Fairness, Stereotypes, and Interpretability

  2018cited by this paper
• Actionable Recourse in Linear Classification

  2018cited by this paper
• A Roadmap for a Rigorous Science of Interpretability

  2017cited by this paper
• SmoothGrad: removing noise by adding noise

  2017cited by this paper
• Understanding Black-box Predictions via Influence Functions

  2017cited by this paper
• On Fairness and Calibration

  2017cited by this paper
• Exposed! A Survey of Attacks on Private Data

  2017influential reference

• Trustworthy AI Must Account for Interactions

  2025cites this paper
• Engineering the Law-Machine Learning Translation Problem: Developing Legally Aligned Models

  2025cites this paper
• Novel Actionable Counterfactual Explanations for Intrusion Detection Using Diffusion Models

  2025cites this paper
• On the Interplay between Human Label Variation and Model Fairness

  2025cites this paper