hugpy-engine 0.2.2
Hugpy engine: model discovery and classification, allocation and eviction, native llama.cpp and GGUF runners, and the prompt-to-reply inference path with task and placement seams
Sources
- T1hugpy-engine 0.2.2PyPI / crates.io / RubyGems / Go index / NuGet