Addressing Polarization and Unfairness in Performative Prediction

Read full text
Authors: Association for Artificial Intelligence 2026, Kun Jin, Yang Liu, Tian Xie, Xueru Zhang
Cited by: 0

Abstract

In many real-world applications of machine learning—such as recommendations, hiring, and lending—deployed models influence the data they are trained on, leading to feedback loops between predictions and data distribution. The performative prediction (PP) framework captures this phenomenon by modeling the data distribution as a function of the deployed model. While prior work has focused on finding performative stable (PS) solutions for robustness, their societal impacts, particularly regarding fairness, remain underexplored. We show that PS solutions can lead to severe polarization and prediction performance disparities, and that conventional fairness interventions in previous works often fail under model-dependent distribution shifts due to failing the PS criteria. To address these challenges in PP, we introduce novel fairness mechanisms that provably ensure both stability and fairness, validated by theoretical analysis and empirical results.

Fields of Study & Subjects

Ethics and Social Impacts of AI Explainable Artificial Intelligence (XAI) Privacy-Preserving Technologies in Data

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN