AIDev Breaking Change Analysis

Read full text
Authors: K M Ferdous, Dipayan Banik, Kowshik Chowdhury, Md Shazibul Islam Shamim
Cited by: 1

Abstract

We conduct a comparative analysis of AI Agent-generated PRs with human-authored PRs from Python repositories in the AIDev dataset (https://huggingface.co/datasets/hao-li/AIDev). We develop a tool that analyzes code changes in commits corresponding to the agentic PRs and leverages an abstract syntax tree (AST) based analysis to detect potential breaking changes.

Publication details

Journal / source
Figshare
Publication date
1 January 2026
Document type
Dataset