LLM as a law professor: having a large language model write a commentary on freedom of assembly

Read full text
Authors: Christoph Engel, Johannes Kruse
Cited by: 0
References: 20

Abstract

Abstract In many jurisdictions, academia is at the service of legal practice. Law professors write commentaries that summarize the state of the art of doctrine, chiefly of jurisprudence. In the spirit of a proof of concept, using the guarantee of freedom of assembly in the European Convention on Human Rights, we show that this task can be completely outsourced to large language models. Using standard NLP metrics and an LLM as a judge approach, we develop an evaluation pipeline that works without costly human annotation. The commentaries fully written by GPT 4o, Gemini 2.5 flash or Kimi K2 Instruct are on par with their best human written competitor, the Guide provided by the Court itself.

Fields of Study & Subjects

Taxation and Legal Issues Comparative and International Law Studies European and International Law Studies

Publication details

Journal / source
Artificial Intelligence and Law
Publisher
Springer Science and Business Media LLC
Publication date
22 July 2026
Language
EN