✨
AI Summary
- Discusses training and serving advanced models like GPT-5 and Gemini at scale.
- Analyzes hardware constants dictating optimal batch sizes and sparsity ratios.
- Explains the 20ms rule and its implications for memory capacity.
Guests on This Episode
RP
Reiner Pope
3 podcast appearances