TIDE: Temporal Incremental Draft Engine for Self-Improving LLM Inference

T1Covered by 1 source · first reported by arXiv at 25 Sept, 04:00 UTC

arXiv:2602.05145v2 Announce Type: replace-cross Abstract: Speculative decoding can substantially accelerate LLM inference, but realizing its benefits in practice is challenging due to evolving workloads. We present TIDE (Temporal Incremental Draft Engine), a serving-engine-native framework that…

aidevscience

Sources

• T1TIDE: Temporal Incremental Draft Engine for Self-Improving LLM InferencearXiv25 Sept, 04:00