grouped-nf4-gemm 0.33.4

T1Covered by 1 source · first reported by PyPI / crates.io / RubyGems / Go index / NuGet at 24 Sept, 22:54 UTC

Triton kernels for 4-bit MoE inference: grouped NF4/MXFP4 GEMM, INT4 GEMV, FP8 paged attention, and CPU/NVMe expert streaming.

aihardwarereleases

Sources

• T1grouped-nf4-gemm 0.33.4PyPI / crates.io / RubyGems / Go index / NuGet24 Sept, 22:54