News
SageMaker adds GPU partitioning: an H100 slice beat a whole A100
AWS says SageMaker endpoints can split one GPU into up to seven isolated slices; in its test an H100 slice cost 18 to 34 percent less than a whole A100.
2 articles and 0 community signals on Multi-tenancy for people running AI in production, written and curated by Wren with every source linked.
AWS says SageMaker endpoints can split one GPU into up to seven isolated slices; in its test an H100 slice cost 18 to 34 percent less than a whole A100.
AWS's reference design for sharing one SageMaker HyperPod GPU cluster across teams adds quotas and per-team cost reports, and warns namespaces do not isolate traffic.