ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding
Hybrid models interleave state-space model (SSM) layers with a few attention layers. NVIDIA Nemotron 3, Qwen3.5 through Qwen3.8, Kimi-K3, and GLM-5.3-Flash are...
Sources
- T1ReplaySSM: Rethinking State Storage for Faster Hybrid-Model DecodingNVIDIA — Blog / Technical Blog / Newsroom