✨
AI Summary
- Jeff Dean and Noam Shazeer recount 25 years at Google developing transformative systems from PageRank to Gemini
- They invented/co-invented core LLM architectures including Transformer, Mixture of Experts, and Mesh Tensorflow
- Vision for Pathways framework as mutually-reinforcing hardware-algorithm loop potentially scaling Google into single massive MoE model