Justify Your Prompts!
Abstract
Abstract When you use a large language model (LLM) in your research, you often need to formulate a prompt to elicit some relevant output from the LLM. This step is challenging since (1) LLMs are known to be brittle and their results may vary drastically between different prompts; and (2) for any given task, there are infinitely many possible prompts. Thus we end up with the following problem: If you cannot try out infinitely many prompts, how do you justify your selected prompt? This article discusses different ways in which authors may motivate their choices, and urges authors to consider how their prompting strategy might be justified.
Fields of Study & Subjects
Artificial Intelligence in Healthcare and Education
Topic Modeling
Text Readability and Simplification
Publication details
- Journal / source
- Computational Linguistics
- Publisher
- MIT Press
- Volume
- 52
- Issue
- 3
- Pages
- 1–13
- Publication date
- 15 April 2026
- Language
- EN