Replication Data for: Can LLMs Substitute for Humans in Evaluating Conceptual Modeling Language Vocabularies? An Experimental Study
Abstract
This is a reproducibility package for paper titled "Can LLMs Substitute for Humans in Evaluating Conceptual Modeling Language Vocabularies? An Experimental Study" appearing in the proceedings of the ACM/IEEE 29th International Conference on Model Driven Engineering Languages and Systems (MODELS 2026). The package contains: - Anonymised (according to ethics protocol) data from experimental participants (and LLMs). - HTML and MD reports of the analysis - Scripts for reproducing the analysis using R To access the dataset: - Download the ZIP file and unzip locally. - Consult README.MD at the root directory for reproduction directions and for locating the data. Information is also available on github: https://github.com/cmg-yorku/MODELS2026/ (commit: 5bf168a84e245184c37feb9b9aa0b5997baacaea)
Publication details
- Journal / source
- Borealis
- Publication date
- 10 August 2026
- Document type
- Dataset