Making AI Agents Evaluate Misleading Charts without Nudging

Read full text
Authors: Swaroop Panda
Cited by: 0

Abstract

AI agents are increasingly used as low-cost proxies for early visualization evaluation. In an initial study of deliberately flawed charts, we test whether agents spontaneously penalise chart junk and misleading encodings without being prompted to look for errors. Using established scales (BeauVis and PREVis), the agent evaluated visualizations containing decorative clutter, manipulated axes, and distorted proportional cues. The ratings of aesthetic appeal and perceived readability often remained relatively high even when graphical integrity was compromised. These results suggest that un-nudged AI agent evaluation may underweight integrity-related defects unless such checks are explicitly elicited.

Fields of Study & Subjects

Data Visualization and Analytics Explainable Artificial Intelligence (XAI) Visual and Cognitive Learning Processes

Publication details

Journal / source
arXiv (Cornell University)
Publication date
5 February 2026
Document type
Preprint