Episodes (Page 10)
✨
OpenAI released Functions API enabling structured JSON outputs and agent-like behavior with 75% embedding price drop and 4x context length
✨
Jeffrey Wang and Joe Reeve propose RLHB (Reinforcement Learning from Human Behavior) as alternative to RLHF, using implicit behavioral signals instead of explicit feedback
✨
Linus Lee from Notion AI discusses building AI × UX scenius and designing AI interfaces, emphasizing most knowledge work is not text generation
✨
Itamar Friedman from Codium AI discusses test generation IDE extension for Python/JS and vision of Code Integrity Agent for debugging software
✨
MosaicML's MPT-7B achieved SOTA in open-source with 84,000 token context length (vs GPT-3's 4,000), trained on 1 trillion tokens matching LLaMA-7B quality
✨
Shreya Rajpal of Guardrails AI addresses LLM output unpredictability and inability to follow requirements without extensive prompt engineering
✨
Sharif Shameem breaks podcast hiatus for exclusive interview on building Lexica (5B searches/day in 8 months, launched 24 hours after Stable Diffusion)
✨
Google's internal memo by Luke Sernau reveals panic over losing AI leadership to open source alternatives after Code Red declaration
Simon Willison
✨
Reza Shabani from Replit discusses open sourcing replit-code-v1-3b, beating OpenAI's Codex despite being 77% smaller when finetuned
✨
Mike Conover from Databricks discusses race for fully open source GPT-3/4-equivalent models addressing LLaMA's research-only license limitations
✨
Deedy Das from Glean discusses AI-powered enterprise search solving knowledge worker problem with Series C $1B valuation from Sequoia
✨
Joseph Nelson from Roboflow discusses Segment Anything Model and computer vision's role in 2023 multimodal AI wave
✨
New format inspired by Acquired.fm without guests focusing on benchmarks as subtle but critical ingredient in LLM development
✨
Shreya Shankar from UC Berkeley discusses MLOps/LLMOps principles after viral tweetstorm and career from Stanford through Google Brain to current role
✨
OpenAI announced ChatGPT Plugins representing app store moment as significant as iPhone App Store 2008 or Facebook Open Graph 2010
✨
Sarah Nagy from Seek.ai addresses Text to SQL as killer B2B use case for generative AI, democratizing data insights without SQL knowledge
✨
Varun Mohan from Codeium discusses achieving 90%+ cost reductions in AI inference through system-wide optimizations and infrastructure skills
✨
Logan Kilpatrick's first interview as OpenAI's first Developer Advocate covering path to OpenAI and ChatGPT versus GPT-3 API tradeoffs