hip-quant 2.2.3.post215
High-performance GPU tensor quantization and inference engine for AMD ROCm. Native AOT GEMV (K-Quants & I-Quants), State Space Model (SSM/DeltaNet) kernels, FP8 WMMA WaveAttention, and portable HIP C++ kernels for RDNA4, RDNA3, and CDNA.
Sources
- T1hip-quant 2.2.3.post215PyPI / crates.io / RubyGems / Go index / NuGet