Replication Package for "AI Solutions Applicable to Software Construction: A Rapid Multivocal Review"
Abstract
This is the replication package for the article "AI Solutions Applicable to Software Construction: A Rapid Multivocal Review" (Guimarães, Assis, Rocha, Feitosa, and Travassos; PESC/COPPE/UFRJ, Brazil). The review systematically maps Generative AI and Large Language Model solutions applicable to software construction, drawing on one academic source (Scopus) and three grey-literature channels (Google, GitHub, and Hugging Face Papers). From 408 retrieved records it catalogues 152 tools, characterising each one along eight research questions (availability, usage model, access and cost, limitations, maturity, documentation and community, target users, and industry validation). The package contains the multi-agent automation pipeline behind the review (search, plus title, abstract, and full-text screening), together with the exact LLM prompts, the protocol settings (research questions, PICOC search string, and inclusion/exclusion criteria), the per-source extracted data in JSON, the blind census-with-adjudication human-review spreadsheets, the reconciled residuals, and the screening-reliability metrics (precision, recall, F1, and inter-rater agreement). The pipeline is written in Python (managed with uv) and is executed per source and per step, so the automated screening can be audited and reproduced end to end. Full-text PDFs are omitted from the package: the Scopus ones are paywalled and copyrighted; the screened text is provided as Markdown instead. The method and artifacts are described in full in the accompanying technical report.
Fields of Study & Subjects
AI-based Problem Solving and Planning
Knowledge Management and Technology
Scientific Computing and Data Management
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 25 July 2026
- Language
- EN