CAFES: A Collaborative Multi-Agent Framework for Multi-Granular Multimodal Essay Scoring

Read full text
Authors: Jiamin Su, Yibo Yan, Zhuoran Gao, Han Zhang, Xiang Liu, Huiyu Zhou, Xuming Hu
Cited by: 0

Abstract

Automated Essay Scoring (AES) is crucial for modern education, particularly with the increasing prevalence of multimodal assessments.However, traditional AES methods struggle with evaluation generalizability and multimodal perception, while even recent Multimodal Large Language Model (MLLM)-based approaches can produce hallucinated justifications and scores misaligned with human judgment.To address the limitations, we introduce CAFES, the first collaborative multiagent framework specifically designed for AES.It orchestrates three specialized agents: an Initial Scorer for rapid, trait-specific evaluations; a Feedback Pool Manager to aggregate detailed and evidence-grounded feedback; and a Reflective Scorer that iteratively refines scores based on this feedback to enhance human alignment.Extensive experiments, using widely adopted MLLMs, achieve an average relative improvement of 21% in Quadratic Weighted Kappa (QWK) against ground truth, with particularly strong gains in grammatical and lexical diversity.Our proposed CAFES paves the way for an intelligent multimodal AES system.

Fields of Study & Subjects

Natural Language Processing Techniques Multi-Agent Systems and Negotiation Speech and dialogue systems

Publication details

Journal / source
Proceedings of the 4th Workshop on Advances in Language and Vision Research (ALVR)
Publisher
Association for Computational Linguistics
Pages
115–138
Publication date
1 January 2026
Language
EN