Evaluating Generative AI in Postgraduate Assessment Through Writing Quality, Accuracy and Pedagogical Implications
Abstract
Generative AI tools such as ChatGPT and Microsoft Copilot are increasingly used in student academic writing, raising questions about learning, integrity, and assessment standards. This paper presents an autoethnographic case study in which Microsoft Copilot was used to generate a 4,500-word draft for a postgraduate assignment on “pig-butchering” cryptocurrency scams and the effectiveness of UK law in addressing them. The draft was evaluated for writing quality, factual accuracy, legal analysis, and evidential support. The findings show that Copilot produced fluent, well-structured text at an appropriate academic level, but key limitations were identified: approximately one-third of references were fabricated or untraceable, several citations contained errors, and the analysis was often descriptive rather than critically engaged. Legal discussion identified relevant UK statutes but offered limited, weakly evidenced case examples. The study also reflects on how iterative prompting shaped outputs and the level of human verification required. Implications for pedagogy and assessment are discussed, with recommendations for embedding AI literacy and transparent, responsible AI use in higher-education curricula.
Fields of Study & Subjects
Artificial Intelligence in Education
Academic integrity and plagiarism
Artificial Intelligence in Healthcare and Education
Publication details
- Publication date
- 26 January 2026