FBS: Modeling Native Parallel Reading inside a Transformer
Abstract
Large language models (LLMs) excel across many tasks, yet inference is still dominated by strictly token-by-token autoregression. Existing acceleration methods largely patch this pipeline and miss core human-reading ingredients: content-adaptive foresight, chunk-structure-aware compute allocation, and train-test consistency for preview/skimming. We propose the Fovea-Block-Skip Transformer (FBS), which injects a causal, trainable loop into Transformers via Parafovea-Attention Window (PAW), Chunk-Head (CH), and Skip-Gate (SG). Across diverse benchmarks, FBS improves the quality-efficiency trade-off without increasing parameters, and ablations show the three modules are complementary.
Fields of Study & Subjects
Topic Modeling
Natural Language Processing Techniques
Advanced Neural Network Applications
Publication details
- Journal / source
- arXiv (Cornell University)
- Publication date
- 29 January 2026
- Document type
- Preprint