Episodes (Page 9)
✨
Documents the evolution of context window lengths from 84k tokens (MPT-7B) to current 1M+ token models, covering the competitive 'Context Extension Campaigns' between frontier labs
✨
Covers ICLR 2024's best papers on image generation, vision models, and transformer architectures featuring insights from Durk Kingma, Christian Szegedy, and Ilya Sutskever
Christian Szegedy
Durk Kingma
Ilya Sutskever
✨
Explores the understudied role of adult content in driving AI innovation, from image generation to fine-tuning techniques developed in niche online communities
Jesse Silver
✨
Introduces WebSim.ai, WorldSim, and simulative AI as next frontier beyond RAG, exploring how models can generate coherent multi-step simulations and alternate worlds
✨
Traces the evolution from prompt engineering hacks to structured output frameworks, with Instructor providing clean SDK solution for reliable AI outputs
✨
Covers Elicit's approach to supervising AI research processes through structured automation and verification methods
✨
Rapid-fire updates on the Four Wars framework with NLW covering Sora, Suno, and GPT-4 class landscape reshaping plus Open Source models (Llama 3, Mistral, Grok)
Harrison Chase
✨
Announces AI Engineer World's Fair (June 25-27) as the largest AI engineer conference of 2024 with 4 tracks daily and 500+ attendees expected
Sam Schillace
✨
David Luan (Adept co-founder, ex-OpenAI/Google) explains why Google failed to capitalize on LLM advances despite early leadership in AI research
✨
Mikey Shulman (Suno CEO) discusses evolution from text-to-speech and voice synthesis to music generation using transformer architectures
✨
January 2024 recap covering top research trends including notable advances in architecture and training methodologies across major labs
✨
Soumith Chintala (Meta AI Engineering Lead, PyTorch creator) discusses open source AI's importance for trustworthiness and accessibility
✨
Ben Firshman (Replicate co-founder) traces company's 5-year journey from 2017 arXiv Vanity project to 2M+ users and $40M Series B
✨
Erik Bernhardsson (Modal founder, ex-Spotify) presents serverless infrastructure specifically designed for AI engineers' compute and latency requirements
✨
Ce Zhang (CTO) and Vipul Ved Prakash (CEO) of Together AI discuss the company's evolution and ~$100M Series A at $360-565M valuation
✨
David Hsu (Retool CEO) discusses the 50% decline in StackOverflow usage and its implications for developer productivity in the AI era
✨
Introduces 'The Four Wars of the AI Stack' framework: Data Quality Wars, GPU Rich vs Poor, Multimodality Wars, and RAG/Ops War
✨
Hugo Laurençon and Leo Tronchon (HuggingFace M4) explain building open source multimodal models by combining existing LLMs and vision encoders with adapter layers
✨
Nathan Lambert provides deep dive into RLHF (Reinforcement Learning from Human Feedback), explaining how transformer models transition from next-token prediction to helpful, honest assistants
✨
Steve Ruiz discusses tldraw, an AI canvas tool enabling sketch-to-working-website generation using GPT-4V for coding visual designs