Dripper: Token-Efficient Main HTML Extraction with a Lightweight LM

Read full text
Authors: Mengjie Liu, Jiahui Peng, Wenchang Ning, Pei‐Yi Chu, Jiantao Qiu, Runsheng Ma, He Zhu, Rui Min, Lu Lu, Linfeng Hou, Kaiwen Liu, Yuan Qu
+5 more Zhenxiang Li, Chao Xu, Zhongying Tu, Wentao Zhang, Conghui He
Cited by: 0

Abstract

High-quality main content extraction from web pages is a critical prerequisite for constructing large-scale training corpora. While traditional heuristic extractors are efficient, they lack the semantic reasoning required to handle the structural heterogeneity of the modern web. Conversely, well-pretrained generative Large Language Models (LLMs) offer superior document comprehension but remain impractical at web scale due to excessive computational costs, limited context windows, and hallucination risks. We present Dripper, a lightweight framework that resolves these bottlenecks through four contributions: (1) We reformulate extraction as a constrained sequence labeling task using SLMs (Small Language Models). This paradigm eliminates generative hallucinations and achieves exceptional efficiency, reaching a throughput of 3.08 pages per second on a single A100 GPU. (2) We construct WebMainBench, a rigorous benchmark of 7,809 human-annotated pages covering 5,434 unique domains and multiple languages. Evaluations show our Dripper-0.6B model outperforms heuristics like Trafilatura and rivals massive models like DeepSeek-V3.2 (685B), GPT-5, and Gemini-2.5-Pro, offering an optimal efficiency-accuracy trade-off. (3) We demonstrate infrastructural value by pre-training a 1B model on a Dripper-curated corpus (63B tokens). This model significantly outperforms baselines in downstream tasks, providing evidence for the critical role of extraction quality and the effectiveness of our framework. (4) We open-source the Dripper-0.6B weights and codebase to facilitate the construction of high-quality datasets.

Fields of Study & Subjects

Web Data Mining and Analysis Text Readability and Simplification Handwritten Text Recognition Techniques

Publication details

Pages
3258–3269
Publication date
7 August 2026