The Vanishing Context: A Preliminary Content Analysis of Relational Context Loss in AI-Generated Bullet-Point Structuring of Public Subsidy Information Pages

Read full text
Authors: Mameta Edanari
Cited by: 6

Abstract

This Technical Note reports a preliminary content analysis of relational context loss in AI-generated bullet-point structuring. The study examines three Japanese public subsidy information pages and compares two conditions: normal bullet-point structuring and context-preserving bullet-point structuring. Unlike the previous Technical Note, The Vanishing Caveat, which examined changes in information units during repeated summarization, this note focuses on relational units: conditional links, exception relations, procedural order, correspondence between requirements and actions, and verification or contact-point relations. Across the three documents, the mean relational-unit preservation rate was 0.84 under the normal bullet-point condition and 1.00 under the context-preserving condition. However, the higher preservation rate in the context-preserving condition does not imply complete safety, because the model also tended to explicitly articulate relations that were inferable from the source text. These cases were treated as qualitative supplementation rather than simple preservation. The main observation is that bullet-point structuring may preserve individual information units while weakening the connections between them. This is especially relevant for practical documents such as public subsidy pages, where eligibility, exceptions, required documents, procedural order, and contact points are often connected across different parts of the text. This record includes the main Technical Note and three supplementary materials:1. Relational-unit extraction tables for S01–S032. B/C bullet-point outputs used for coding3. Coding and judgment rules for relational-unit preservation This is an exploratory N=3 observation and does not aim at statistical generalization.

Fields of Study & Subjects

Computational and Text Analysis Methods Ethics and Social Impacts of AI Reliability and Agreement in Measurement

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
14 May 2026
Language
JA