Generation of Web Apps with Agentic IDEs: An Empirical Assessment

Read full text Summarise with VIRAT
Authors: Anonymous
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Agentic IDEs are among the most significant innovations in software engineering, aiming to accelerate application development through LLM-based agents that can assist developers during development. However, their systematic evaluation in large-scale tasks, such as the end-to-end generation of applications, remains limited. To fill this gap, we propose a rigorous comparative analysis of three popular agentic IDEs (Copilot, Cursor, and Windsurf) in the generation of five full-stack Web applications from scratch. Results show high maturity in the generation of established patterns, such as CRUD operations and authentication features. In contrast, the generation of less common distributed architectures, such as a task queue architecture, produces significantly more errors. Overall, results show that Agentic IDEs cannot replace developersbut shift their role toward building software by orchestrating LLM-based agents through natural-language instructions and iterative refinement. Yet, each agentic IDE shows its peculiarities, although differences are narrow.

Fields of Study & Subjects

Software Engineering Research Software Engineering Techniques and Practices Advanced Software Engineering Methodologies

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
24 March 2026
Language
EN