OpenAI

Amazon SageMaker Adds Support for NVIDIA Multi-Instance GPU Partitioning

Amazon SageMaker Inference now supports NVIDIA Multi-Instance GPU (MIG) partitioning, allowing users to divide a single physical GPU into independent partitions. This feature enables organizations to host multiple models on one accelerator with hardware-enforced isolation, improving utilization and reducing inference costs.