FloodSQL-Bench: A Retrieval-Augmented Benchmark for Geospatially-Grounded Text-to-SQL
Abstract
Existing Text-to-SQL benchmarks primarily focus on single-table queries or limited joins in general-purpose domains, and thus fail to reflect the complexity of domain-specific, multi-table and geospatial reasoning, To address this limitation, we introduce FloodSQL-Bench, a geospatially grounded benchmark for the flood management domain that integrates heterogeneous datasets through key-based, spatial, and hybrid joins. The benchmark captures realistic flood-related information needs by combining social, infrastructural, and hazard data layers. We systematically evaluate recent large language models with the same retrieval-augmented generation settings and measure their performance across difficulty tiers. By providing a unified, open benchmark grounded in real-world disaster management data, FloodSQL-Bench establishes a practical testbed for advancing Text-to-SQL research in high-stakes application domains.
Fields of Study & Subjects
Geographic Information Systems Studies
Semantic Web and Ontologies
Advanced Database Systems and Queries
Publication details
- Journal / source
- Proceedings of the AAAI Symposium Series
- Volume
- 9
- Issue
- 1
- Pages
- 83–90
- Publication date
- 23 June 2026
- Language
- EN