Content-Addressed Storage with BLAKE3 for SQL Database Value Deduplication

Read full text Summarise with VIRAT
Authors: Daniel Moya Vaca
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

We present a content-addressed storage (CAS) system integrated into a SQL database engine, using BLAKE3 cryptographic hashing for automatic deduplication of large text and binary column values. Values exceeding a configurable threshold (default 1,024 bytes) are stored in a dedicated CAS keyspace under their BLAKE3 hash, with the original row storing a lightweight CasRef pointer. Duplicate values across rows, tables, and copy-on-write branches share a single physical copy. The system is exposed via a SQL column attribute (STORAGE CONTENT_ADDRESSED) and operates transparently on INSERT/UPDATE/SELECT. While content-addressed storage is used in version control systems (Git: SHA-1/SHA-256) and distributed storage (IPFS: SHA-256, Dolt: prolly trees), no existing SQL database uses BLAKE3 for content-addressed value deduplication or exposes CAS as a declarative SQL column attribute.

Fields of Study & Subjects

Advanced Database Systems and Queries Advanced Data Storage Technologies Data Quality and Management

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
27 March 2026
Language
EN