✨
AI Summary
- Meta's inference traffic is growing exponentially, outpacing other workloads.
- AI inference is following the cloud's path from VMs to orchestration.
- Orchestration is emerging around routing, KV cache, and decode disaggregation.