Amazon SageMaker AI inference now supports GPU partitioning for real-time endpoints

T1Covered by 1 source · first reported by AWS — What's New / News Blog at 30 Oct, 08:00 UTC

Amazon SageMaker AI inference now supports GPU partitioning, enabling you to run several models on a single GPU instead of dedicating a whole accelerator to each one. Using NVIDIA Multi-Instance GPU (MIG) technology, SageMaker AI divides a GPU into as many as seven isolated partitions, each with…

aihardware

Sources

• T1Amazon SageMaker AI inference now supports GPU partitioning for real-time endpointsAWS — What's New / News Blog30 Oct, 08:00