AgentGraph: Trace-to-Graph Platform for Interactive Analysis and Robustness Testing in Agentic AI Systems

Read full text
Authors: Association for Artificial Intelligence 2026, Sahan Bulathwela, Seonglae Cho, Emre Kazim, Theo King, Adriano Koshiyama, Umar Mohammed, María Pérez‐Ortiz, CRISTIAN ENRIQUE MUNOZ VILLALOBOS, Zekun Wu
Cited by: 0

Abstract

Modern Agentic AI systems plan, reason, and act across multiple steps, creating execution patterns that are difficult to interpret. Existing observability platforms track prompt I/O and operational metrics but require manual inspection of traces to reconstruct structure and reasoning. We present AgentGraph, which converts execution logs into interactive knowledge graphs and actionable insights. Nodes represent agents, tasks, tools, data inputs/outputs, and humans, while typed edges capture relations such as inputs consumed, tasks delegated or sequenced, tools required or used, outputs produced and delivered, and interventions from agents or humans. Each graph element links to its exact trace span, ensuring verifiability. Building on this representation, AgentGraph enables two analyses: qualitative trace-grounded failure detection and optimisation recommendations, and quantitative robustness evaluation via perturbation testing and causal attribution.

Fields of Study & Subjects

Software System Performance and Reliability Scientific Computing and Data Management Software Testing and Debugging Techniques

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN