Locating Risk: Task Designers and the Challenge of Risk Disclosure in Crowdsourced RAI Content Work CSCW029

Read full text
Authors: Alice Qian, Ryland Shaw, Laura Dabbish, Jina Suh, Hong Shen
Cited by: 0

Abstract

As AI systems are increasingly tested and deployed in open-ended and high-stakes domains, crowdworkers are often tasked with responsible AI (RAI) content work. These tasks include labeling violent content, moderating disturbing text, or simulating harmful behavior for red teaming exercises to shape AI system behaviors. While prior research efforts have highlighted the risks to worker well-being associated with RAI content work, far less attention has been paid to how these risks are communicated to workers by task designers or individuals who design and post RAI tasks. Existing transparency frameworks and guidelines, such as model cards, datasheets, and crowdworksheets, focus on documenting model information and dataset collection processes, but they overlook an important aspect of disclosing well-being risks to workers. In the absence of standard workflows or clear guidance, the consistent application of content warnings, consent flows, or other forms of well-being risk disclosure remains unclear. This study investigates how task designers approach risk disclosure in crowdsourced RAI tasks. Drawing on interviews with 23 task designers across academic and industry sectors, we examine how well-being risk is recognized, interpreted, and communicated in practice. Our findings highlight the need to support task designers in identifying and communicating risks not only to support crowdworker well-being but also to strengthen the ethical integrity and technical efficacy of AI development pipelines.

Fields of Study & Subjects

Business Process Modeling and Analysis

Publication details

Journal / source
Proceedings of the ACM on Human-Computer Interaction
Volume
10
Issue
2
Pages
1–32
Publication date
30 April 2026
Language
EN