piper-offload 0.10.0rc9
Model-agnostic GPU/CPU memory management for PyTorch — host offloading, block streaming, and LRU model caching.
Sources
- T1piper-offload 0.10.0rc9PyPI / crates.io / RubyGems / Go index / NuGet
Model-agnostic GPU/CPU memory management for PyTorch — host offloading, block streaming, and LRU model caching.