PodcastIntel
Sign in Get Started Free
Latent Space: The AI Engineer Podcast
Latent Space: The AI Engineer Podcast

[NeurIPS Best Paper] 1000 Layer Networks for Self-Supervised RL — Kevin Wang et al, Princeton

Jan 2, 2026 · 28m
AI Summary
  • Kevin Wang et al. won NeurIPS 2025 Best Paper by scaling RL networks to 1,000 layers deep, defying decade-long conventional wisdom that depth fails in RL
  • Key insight: self-supervised RL using contrastive learning on state/action/future representations scales where value-based methods collapse; architecture matters (residual connections, layer norm)
  • Scaling depth proves more parameter-efficient than width (linear vs quadratic growth); shift from regression to classification objectives enabled breakthrough

More from Latent Space: The AI Engineer Podcast

View all episodes →

Get AI Summaries for Every New Episode

Subscribe to Latent Space: The AI Engineer Podcast and get AI summaries, guest tracking, and email digests delivered automatically.

Sign Up Free →