PodcastIntel
Sign in Get Started Free
Andrej Karpathy
Andrej Karpathy

Let's build GPT: from scratch, in code, spelled out.

Jan 17, 2023
Listen to Episode
✨ AI Summary
  • Builds a Generative Pretrained Transformer (GPT) from scratch.
  • Follows 'Attention is All You Need' and GPT papers.
  • Uses GitHub Copilot to assist in writing the GPT code.

More from Andrej Karpathy

Andrej Karpathy
How I use LLMs
Feb 27, 2025
Andrej Karpathy
Deep Dive into LLMs like ChatGPT
Feb 5, 2025
Andrej Karpathy
Let's reproduce GPT-2 (124M)
Jun 9, 2024
Andrej Karpathy
Let's build the GPT Tokenizer
Feb 20, 2024
View all episodes →

Get AI Summaries for Every New Episode

Subscribe to Andrej Karpathy and get AI summaries, guest tracking, and email digests delivered automatically.

Sign Up Free →