PREFAB: PREFerence-based Affective Modeling for Low-Budget Self-Annotation

Read full text
Authors: JaeYoung Moon, Youjin Choi, Yucheon Park, Dávid Melhárt, Georgios N. Yannakakis, Kyung-Joong Kim
Cited by: 1
References: 68

Abstract

Self-annotation is the gold standard for collecting affective state labels in affective computing. Existing methods typically rely on full annotation, requiring users to continuously label affective states across entire sessions. While this process yields fine-grained data, it is time-consuming, cognitively demanding, and prone to fatigue and errors. To address these issues, we present PREFAB, a low-budget retrospective self-annotation method that targets affective inflection regions rather than full annotation. Grounded in the peak-end rule and ordinal representations of emotion, PREFAB employs a preference learning model to detect relative affective changes, directing annotators to label only selected segments while interpolating the remainder of the stimulus. We further introduce a preview mechanism that provides brief contextual cues to assist annotation. We evaluate PREFAB through a technical performance study and a 25-participant user study. Results show that PREFAB outperforms baselines in modeling affective inflections while mitigating workload (and conditionally mitigating temporal burden). Importantly, PREFAB improves annotator confidence without degrading annotation quality.

Fields of Study & Subjects

Emotion and Mood Recognition Sentiment Analysis and Opinion Mining Recommender Systems and Techniques

Publication details

Journal / source
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
Publisher
ACM
Pages
1–26
Publication date
13 April 2026
Language
EN