PodcastIntel
Sign in Get Started Free
Andrej Karpathy
Andrej Karpathy

Let's reproduce GPT-2 (124M)

Jun 9, 2024
Listen to Episode
✨ AI Summary
  • Reproduces the GPT-2 (124M) model from scratch.
  • Details network building, training optimization, and hyperparameter setup.
  • Showcases amusing model generations after training.

More from Andrej Karpathy

Andrej Karpathy
How I use LLMs
Feb 27, 2025
Andrej Karpathy
Deep Dive into LLMs like ChatGPT
Feb 5, 2025
Andrej Karpathy
Let's build the GPT Tokenizer
Feb 20, 2024
Andrej Karpathy
[1hr Talk] Intro to Large Language Models
Nov 23, 2023
View all episodes →

Get AI Summaries for Every New Episode

Subscribe to Andrej Karpathy and get AI summaries, guest tracking, and email digests delivered automatically.

Sign Up Free →