Robust Predicate Transfer with Dynamic Execution

View at publisher
Authors: Yiming Qiao, Peter Boncz, Hailong Zhang
Cited by: 1
References: 2

Abstract

Efficient join query execution remains a key challenge in modern database systems. Although a recent method, Robust Predicate Transfer (RPT), improves robustness against suboptimal join orders, it introduces significant overhead from redundant filter creation and inefficient data scanning. We present RPT+ that addresses these issues through three key improvements. First, we propose asymmetric transfer plans to reduce redundant Bloom filter constructions. Second, we design cascade filters to improve data scanning efficiency by enabling both block-level skipping and tuple-level filtering. Third, we introduce dynamic pipelines to allow runtime filter creation and transfer plan adjustment. We implemented RPT+ in DuckDB (v1.3.0) and evaluated it across multiple benchmarks, including the Join Order Benchmark (JOB), SQLStorm, TPC-H, and Appian. Compared to the baseline DuckDB, RPT+ achieves speedups of 1.47× on JOB, 1.28× on SQLStorm, 1.17× on TPC-H, and 1.01× on Appian. Importantly, it avoids the significant performance regressions observed with the original RPT. These results demonstrate that RPT+ not only improves query performance but also maintains the robustness of RPT across diverse workloads.

Fields of Study & Subjects

Advanced Database Systems and Queries Data Quality and Management Caching and Content Delivery

Publication details

Journal / source
Proceedings of the VLDB Endowment
Publisher
Association for Computing Machinery (ACM)
Volume
19
Issue
6
Pages
1278–1290
Publication date
1 February 2026
Language
EN