AI Engineer

How Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs

Oct 12, 2026 · 0:22:47

Listen to Episode

✨ AI Summary

Daniel Kim and Michelle discussed accelerating AI inference speeds.
Techniques include runtime optimization and splitting models across GPUs.
Continuous batching and KV caching improve efficiency.

Guests on This Episode

researcher ORCID 0000-0001-5457-1966 · 1 podcast appearance

More from AI Engineer

Build a Research Agent with Claude Managed Agents (Part 2 of 4) — Anthropic

Oct 12, 2026 · 0:35:36

Decoupling the Brain from the Hands: Claude Managed Agents (Part 1 of 4) — Anthropic

Oct 12, 2026 · 0:17:40

Inside the AI Economy: What Stripe's Data Reveals — Nilofer Rajpurkar, Stripe

Oct 12, 2026 · 0:20:50

Building AIE: Open Q&A and Feedback Session with swyx

Oct 12, 2026 · 0:58:42

View all episodes →