AI brief
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, including multi-node and disaggregated serving, KV-aware routing and automatic fault recovery.
Why it matters: It lets teams serve large models across many nodes without building their own orchestration layer.
Written by AI from AWS Machine Learning Blog's published text.
Background
From our own funding, model and news trackers, not from the source.
NVIDIA
- Newest model on the API
- Nemotron 3.5 Super VL · 15 Oct 2026 · $0.15 in / $0.5 out per million tokens
- Last 30 days
- 60 news stories
Amazon
- Newest model on the API
- Nova 2 Lite · 2 Dec 2025 · $0.3 in / $2.5 out per million tokens
- Last 30 days
- 24 news stories
Source
“Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery.”
Published by the organisation it describes; treat claims as first-party statements.
Read original story ↗