How DeepSeek’s DSpark Makes LLMs 85% Faster Without Retraining

DeepSeek has introduced DSpark, an open-source speculative decoding method that accelerates LLM inference by up to 85% ...

DeepSeek open sources DSpark, a new framework to speed up LLM inference by up to 85%

DSpark can make decoding faster, but acceptance quality still determines how much speed the system actually realizes.
Tech Times

NVIDIA Diffusion LLM Hits 2.42x Throughput Without Retraining: Nemotron TwoTower Released

NVIDIA diffusion language model Nemotron TwoTower achieves 2.42x LLM inference throughput without a full retraining run, ...