Content-Addressed Storage with BLAKE3 for SQL Database Value Deduplication
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
We present a content-addressed storage (CAS) system integrated into a SQL database engine, using BLAKE3 cryptographic hashing for automatic deduplication of large text and binary column values. Values exceeding a configurable threshold (default 1,024 bytes) are stored in a dedicated CAS keyspace under their BLAKE3 hash, with the original row storing a lightweight CasRef pointer. Duplicate values across rows, tables, and copy-on-write branches share a single physical copy. The system is exposed via a SQL column attribute (STORAGE CONTENT_ADDRESSED) and operates transparently on INSERT/UPDATE/SELECT. While content-addressed storage is used in version control systems (Git: SHA-1/SHA-256) and distributed storage (IPFS: SHA-256, Dolt: prolly trees), no existing SQL database uses BLAKE3 for content-addressed value deduplication or exposes CAS as a declarative SQL column attribute.
Fields of Study & Subjects
Advanced Database Systems and Queries
Advanced Data Storage Technologies
Data Quality and Management
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 27 March 2026
- Language
- EN