Bespoke OLAP: Synthesizing Workload-Specific One-Size-Fits-One Database Engines

Read full text
Authors: Johannes Wehrstein, Timo Eckmann, Matthias Jasny, Carsten Binnig
Cited by: 1
References: 17

Abstract

Modern OLAP engines support arbitrary analytical workloads, but this flexibility incurs overhead from runtime schema interpretation, generic data representations, and abstraction layers, even in compiled-query systems. Workload-specific engines can eliminate these costs and exploit specialized data structures and algorithms for higher performance, yet have historically been too expensive to build manually. Recent advances in LLM-based code synthesis challenge this tradeoff, but naive prompting does not produce correct or efficient engines due to deep architectural dependencies and the need for systematic refinement. We present Bespoke OLAP , a fully autonomous synthesis pipeline that constructs high-performance OLAP engines tailored to a target workload through iterative performance evaluation and automated validation. Bespoke OLAP generates engines from scratch within minutes to hours and achieves order-of-magnitude speedups over DuckDB and Umbra, demonstrating that the generality tax extends beyond query compilation to storage layout and algorithmic design.

Fields of Study & Subjects

Advanced Database Systems and Queries Cloud Computing and Resource Management Software System Performance and Reliability

Publication details

Journal / source
Proceedings of the VLDB Endowment
Publisher
Association for Computing Machinery (ACM)
Volume
19
Issue
11
Pages
3759–3771
Publication date
1 July 2026
Language
EN