🚀 dParallel: Learnable Parallel Decoding for dLLMs dParallel: Learnable Parallel Decoding for dLLMs Zigeng Chen, Gongfan Fang, Xinyin Ma, Ruonan Yu, Xinchao Wang xML Lab, National University of Singapore 💡 Introduction We introduce dParallel, a simple and effective method that unlocks the inherent parallelism of dLLMs for fast sampling. We identify that the key bottleneck to parallel decoding arises from the sequential certainty convergence for masked tokens. Building on this insight, we introduce the core of our approach: certainty forcing distillation, a novel training strategy that distills the model to follow its original sampling trajectories while enforcing it to achieve high certainty on masked tokens more rapidly and in parallel. Extensive experiments across various benchmarks demonstrate that our method can dramatically reduce the number of decoding steps while maintaining performance. When applied to the LLaDA 8B Instruct model, dParallel reduces decoding steps from 256 to 30 on GSM8K, achieving an 8.5x speedup without performance degradation. On the MBPP benchmark, it cuts decoding steps from 256 to 24, resulting in a 10.5x speedup while maintaining accuracy. Overview…
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy