VeloxQuant-MLX 0.91.4
Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods, from TurboQuant and KIVI to A2ATS, with Metal kernels
Sources
- T1VeloxQuant-MLX 0.91.4PyPI / crates.io / RubyGems / Go index / NuGet
Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods, from TurboQuant and KIVI to A2ATS, with Metal kernels