The Inter-Instance Compression Barrier: Domain-Specific Information Loss at the Natural Language Interface

Read full text
Authors: Jeremy McEntire
Cited by: 0

Abstract

Tests whether the NL compression bottleneck selectively drops domain-specific information. H1 not supported. Domain-specific fraction stable at ~1.4% (layer 10) and ~4.4% (layer 27) across all compression levels. The NL interface is a uniform lossy channel dropping ~80% proportionally. The concentration barrier is the sole constraint; the communication interface is innocent.

Fields of Study & Subjects

Topic Modeling Natural Language Processing Techniques Information Retrieval and Search Behavior

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
2 March 2026
Language
EN