Shallow Pass Budget Constraints and Structured Data Trade-offs in LLM Training Ingestion

Read full text
Authors: Joseph Mas
Cited by: 0

Abstract

This study is part of the AI Visibility research framework developed by Joseph Mas, which examines how information is structured, ingested, and recalled by large language models during training cycles rather than traditional search engine optimization. Earlier AI Visibility research positioned JSON-LD structured data as a critical transport layer for LLM ingestion, emphasizing its role in preserving semantic relationships and machine-readable context. This paper documents empirical observations that prompted a reassessment of that position. During controlled training cycle experiments, extensive JSON-LD structured data markup showed zero retention across multiple platforms despite being present on successfully crawled and ingested pages. Content positioned in early visible HTML sections demonstrated consistent cross-platform retention, while content positioned deeper in page structure - whether in semantic HTML or structured data markup - did not appear in post-training model responses. These observations suggest LLMs may operate under per-page budget constraints during initial shallow-pass processing, where structured data markup competes with or displaces semantic content from limited ingestion capacity. Three architectural models are examined to explain the behavior, along with a triple constraint framework covering character economy, content positioning, and signal quality. This represents iterative scientific refinement of the AI Visibility framework - not a retraction of earlier JSON work, but an evolution of understanding based on direct empirical observation across Claude, ChatGPT, Google Gemini, and Perplexity during the same Common Crawl training window documented in prior AI Visibility empirical research.

Fields of Study & Subjects

Information Retrieval and Search Behavior Topic Modeling Web Data Mining and Analysis

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
15 February 2026
Language
EN