DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration

Read full text
Authors: Yanru Huo, Ziyue Jiang, Zuoli Tang, Qingyang Hong, Zhou Li Zhao
Cited by: 0

Abstract

While Diffusion Transformers (DiT) have advanced non-autoregressive (NAR) speech synthesis, their high computational demands remain a limitation.Existing DiT-based text-tospeech (TTS) model acceleration approaches mainly focus on reducing sampling steps through distillation techniques, yet they remain constrained by training costs.We introduce DiTReducio, a training-free acceleration framework that compresses computations in DiT-based TTS models via progressive calibration.We propose two compression methods, Temporal Skipping and Branch Skipping, to eliminate redundant computations during inference.Moreover, based on two characteristic attention patterns identified within DiT layers, we devise a pattern-guided strategy to selectively apply the compression methods.Our method allows flexible modulation between generation quality and computational efficiency through adjustable compression thresholds.Experimental evaluations conducted on F5-TTS and MegaTTS 3 demonstrate that DiTReducio achieves a 75.4% reduction in FLOPs and improves the Real-Time Factor (RTF) by 37.1%, while preserving generation quality.The code is available at https://github.com/ iHateTheWorld555/DiTReducio.

Fields of Study & Subjects

Neural Networks and Applications

Publication details

Journal / source
Findings of the Association for Computational Linguistics: ACL 2026
Publisher
Association for Computational Linguistics
Pages
23101–23116
Publication date
1 January 2026
Language
EN