Explanations Leak: Membership Inference with Differential Privacy and Active Learning Defense

Read full text
Authors: Fatima Ezzeddine, Osama Zammar, Silvia Giordano, Omran Ayoub
Cited by: 0

Abstract

Counterfactual explanations (CFs) are increasingly integrated into Machine Learning as a Service (MLaaS) systems to improve transparency; however, ML models deployed via APIs are already vulnerable to privacy attacks such as membership inference and model extraction, and the impact of explanations on this threat landscape remains insufficiently understood. In this work, we focus on the problem of how CFs expand the attack surface of MLaaS by strengthening membership inference attacks (MIAs), and on the need to design defense mechanisms that mitigate this emerging risk without undermining utility and explainability. First, we systematically analyze how exposing CFs through query-based APIs enables more effective shadow-based MIAs. Second, we propose a defense framework that integrates Differential Privacy (DP) with Active Learning (AL) to jointly reduce memorization and limit effective training data exposure. Finally, we conduct an extensive empirical evaluation to characterize the three-way trade-off between privacy leakage, predictive performance, and explanation quality. Our findings highlight the need to carefully balance transparency, utility, and privacy in the responsible deployment of explainable MLaaS systems.

Fields of Study & Subjects

Privacy-Preserving Technologies in Data Explainable Artificial Intelligence (XAI) Adversarial Robustness in Machine Learning

Publication details

Journal / source
International Joint Conference on Neural Networks (IJCNN)
Pages
1–8
Publication date
1 June 2026