hugpy 0.2.2
Self-hosted LLM console and OpenAI-compatible API: model registry and downloads, streaming chat, on-site API keys, GPU worker fleet with cross-machine RPC sharding. Meta distribution: the hugpy/hpy commands and install profiles for the hugpy-* packages
Sources
- T1hugpy 0.2.2PyPI / crates.io / RubyGems / Go index / NuGet