Thunder-KoNUBench: A Corpus-Aligned Benchmark for Korean Negation Understanding

Read full text
Authors: Sungmok Jung, Yeonkyoung So, Joonhak Lee, Sangho Kim, Yelim Ahn, Jaejin Lee
Cited by: 0

Abstract

Although negation is known to challenge large language models (LLMs), benchmarks for evaluating negation understanding-especially in Korean-are scarce. We conduct a corpus-based analysis of Korean negation and show that LLM performance degrades under negation. We then introduce Thunder-KoNUBench, a sentence-level negation understanding benchmark that reflects the empirical distribution of Korean negation phenomena. Evaluating 47 LLMs on Thunder-KoNUBench, we analyze the effects of model size and instruction tuning, and perform error analysis to better understand model behavior. We further show that fine-tuning on Thunder-KoNUBench improves negation understanding and broader contextual comprehension in Korean.

Fields of Study & Subjects

Topic Modeling Text Readability and Simplification Natural Language Processing Techniques

Publication details

Journal / source
arXiv (Cornell University)
Publication date
8 January 2026
Document type
Preprint