Interleaving Natural Language Prompting with Code Editing for Solving Programming Tasks with Generative AI Models

Read full text
Authors: Victor-Alexandru Pădurean, Alkis Gotovos, Ahana Ghosh, Paul C. Denny, Juho Leinonen, Andrew Luxton-Reilly, James Prather, Adish Kumar Singla
Cited by: 0
References: 40

Abstract

Modern computing students often rely on both natural-language prompting and manual code editing to solve programming tasks. Yet we still lack a clear understanding of how these two modes are combined in practice, and how their usage varies with task complexity and student ability. In this paper, we investigate this through a large-scale study in an introductory programming course, collecting 13,305 interactions from 355 students during a three-day lab activity. Our analysis shows that students primarily use prompting to generate initial solutions, and then often enter short edit-run loops to refine their code following a failed execution. Student reflections confirm that prompting is helpful for structuring solutions, editing is effective for making targeted corrections, while both are useful for learning. We find that manual editing becomes more frequent as task complexity increases, but most edits remain concise, with many affecting a single line of code. Higher-performing students succeed with less reliance on editing and fewer overall interactions. These findings highlight the role of manual editing as a form of last-mile repair, complementing prompting in AI-assisted programming workflows.

Fields of Study & Subjects

Teaching and Learning Programming Software Engineering Research Scientific Computing and Data Management

Publication details

Journal / source
Proceedings of the 31st ACM Conference on Innovation and Technology in Computer Science Education V. 1
Publisher
ACM
Pages
273–279
Publication date
6 July 2026
Language
EN