Data-driven psychophysical methods to diversify SIAs and address bias

Read full text
Authors: Valentina Gosetti, Rachael Elizabeth Jack
Cited by: 0
References: 95

Abstract

To realize their full potential, Socially Interactive Agents (SIAs) must effectively engage with human users from diverse individual, social, and cultural backgrounds. However, most current SIAs are grounded in White- and Western-centric assumptions, limiting their ability to express and interpret social cues appropriately across cultures. Here, we demonstrate how the data-driven psychophysical method of reverse correlation can help address these limitations by modeling users' perceptual expectations, preferences, and sociocultural norms and strategically integrating these insights into SIA design. Drawing on examples from our research group, we show how this method could enable SIAs to exhibit social signals that are psychologically grounded, culturally adaptive, and ethnically inclusive. By informing the design of SIA appearance and expressive behavior with empirically derived user models, our approach aims to improve user engagement and trust while contributing to broader efforts to mitigate algorithmic bias, reduce access inequality, and challenge real-world prejudice in both human-AI and human-human interaction contexts.

Fields of Study & Subjects

Social Robot Interaction and HRI Emotion and Mood Recognition Innovative Human-Technology Interaction

Publication details

Journal / source
Journal on Multimodal User Interfaces
Volume
20
Issue
1
Pages
1–11
Publication date
5 February 2026
Language
EN