Synthetic dataset generation for theft event extraction in Italian
Abstract
Event extraction is the task of automatically identifying and extracting structured information about events from unstructured text. Despite Italian being a well-resourced language, it still lacks annotated datasets specifically designed for fine-grained event extraction. To address this gap, we propose a novel methodology for the generation of synthetic data suitable for fine-grained event extraction tasks. This work is motivated by the high cost and limited scalability of manual annotation. We introduce a controlled synthetic data generation pipeline that strictly adheres to a target annotation schema, providing a scalable alternative to extensive human labeling. The key methodological innovation is a two-phase, document-level generation framework that leverages Large Language Models, ensures structural consistency and mitigates generation biases, enabling the creation of high-quality datasets for complex event extraction scenarios. Using this methodology, we release SYNTH-ITA, the first collection of four medium-scale synthetic datasets for fine-grained Italian event extraction, generated from 10,000 structured crime scenarios each. Experiments conducted on event argument extraction using a QA formulation demonstrate that fine-tuning models on SYNTH-ITA leads to better or comparable performances to models fine-tuned on 200 manually annotated real news articles (+14% improvement with ELECTRA, -0.4% with BERT). Conversely, NER-based models for event argument extraction trained on synthetic data exhibit an 18% performance drop compared to those trained on manually annotated articles. • First medium-scale synthetic datasets for Italian event extraction. • A defined methodology and pipeline to ensure structured annotations and text alignment. • Expert validation and bias mitigation enhance data quality and fairness. • Synthetic data boosts Italian QA performance. • Public release of dataset/code supports Italian NLP tasks and reproducibility.
Fields of Study & Subjects
Data Quality and Management
Digital and Cyber Forensics
Anomaly Detection Techniques and Applications
Publication details
- Journal / source
- Information Processing & Management
- Publisher
- Elsevier BV
- Volume
- 63
- Issue
- 7
- Pages
- 104833–104833
- Publication date
- 6 May 2026
- Language
- EN