grouped-nf4-gemm 0.33.3

T1Covered by 1 source · first reported by PyPI / crates.io / RubyGems / Go index / NuGet at 24 Sept, 21:53 UTC

Triton kernels for 4-bit MoE inference: grouped NF4/MXFP4 GEMM, INT4 GEMV, FP8 paged attention, and CPU/NVMe expert streaming.

aihardwarereleases

Sources

• T1grouped-nf4-gemm 0.33.3PyPI / crates.io / RubyGems / Go index / NuGet24 Sept, 21:53