Description
Learn how NVIDIA Dynamo’s OpenAI-compatible frontend handles inference requests and routes them to reuse KV cache.
In this beginner-friendly, four-minute episode of Dynamo in 5 Minutes, follow a curl request demo and see a model hot-swap in action.
Learn more: https://www.nvidia.com/en-us/ai/dynamo/
Technical blog: https://developer.nvidia.com/blog/tag/nvidia-dynamo/
Get started: https://github.com/ai-dynamo/dynamo
0:00 Intro
0:33 The Problem: Changing Infrastructure
1:02 What Is the Dynamo Frontend?
1:44 Use Case: Migrating at the API Boundary
2:36 Swapping Backend Engines
3:16 Why It Matters for KV Cache
3:38 Architecture Walkthrough
4:10 Takeaway: Use an OpenAI-Compatible API to Swap Backends and Enable KV Cache Reuse