✨
AI Summary
- Felipe Blanes from Amazon AGI Lab highlighted the 'benchmark illusion'.
- Static benchmarks don't reflect real-world agent performance with unexpected inputs.
- An eval flywheel built around customer interactions is essential for reliability.
Guests on This Episode
FB
Felipe Blanes
1 podcast appearance