FBS: Modeling Native Parallel Reading inside a Transformer

Read full text
Authors: Tongxi Wang
Cited by: 0

Abstract

Large language models (LLMs) excel across many tasks, yet inference is still dominated by strictly token-by-token autoregression. Existing acceleration methods largely patch this pipeline and miss core human-reading ingredients: content-adaptive foresight, chunk-structure-aware compute allocation, and train-test consistency for preview/skimming. We propose the Fovea-Block-Skip Transformer (FBS), which injects a causal, trainable loop into Transformers via Parafovea-Attention Window (PAW), Chunk-Head (CH), and Skip-Gate (SG). Across diverse benchmarks, FBS improves the quality-efficiency trade-off without increasing parameters, and ablations show the three modules are complementary.

Fields of Study & Subjects

Topic Modeling Natural Language Processing Techniques Advanced Neural Network Applications

Publication details

Journal / source
arXiv (Cornell University)
Publication date
29 January 2026
Document type
Preprint