PodcastIntel
Sign in Get Started Free
AI Engineer
AI Engineer

Operating Distributed Inference Systems at Scale — Nishant Gupta & Naman Ahuja, Meta

Sep 19, 2026 · 0:19:51
✨ AI Summary
  • Meta's inference traffic is growing exponentially, outpacing other workloads.
  • AI inference is following the cloud's path from VMs to orchestration.
  • Orchestration is emerging around routing, KV cache, and decode disaggregation.

Guests on This Episode

More from AI Engineer

View all episodes →

Get AI Summaries for Every New Episode

Subscribe to AI Engineer and get AI summaries, guest tracking, and email digests delivered automatically.

Sign Up Free →