Making AI Agents Evaluate Misleading Charts without Nudging
Abstract
AI agents are increasingly used as low-cost proxies for early visualization evaluation. In an initial study of deliberately flawed charts, we test whether agents spontaneously penalise chart junk and misleading encodings without being prompted to look for errors. Using established scales (BeauVis and PREVis), the agent evaluated visualizations containing decorative clutter, manipulated axes, and distorted proportional cues. The ratings of aesthetic appeal and perceived readability often remained relatively high even when graphical integrity was compromised. These results suggest that un-nudged AI agent evaluation may underweight integrity-related defects unless such checks are explicitly elicited.
Fields of Study & Subjects
Data Visualization and Analytics
Explainable Artificial Intelligence (XAI)
Visual and Cognitive Learning Processes
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 5 February 2026
- Document type
- Preprint