turbo-attn 0.57.1

T1Covered by 1 source · first reported by PyPI / crates.io / RubyGems / Go index / NuGet at 24 Sept, 18:47 UTC

Optimized CUDAgraph-enabled kernels and attention backend for vLLM, SGLang and more based on TurboQuant near-lossless KV cache compression.

releases

Sources

• T1turbo-attn 0.57.1PyPI / crates.io / RubyGems / Go index / NuGet24 Sept, 18:47