PodcastIntel
Sign in Get Started Free
Andrej Karpathy
Andrej Karpathy

Let's build GPT: from scratch, in code, spelled out.

Jan 17, 2023
AI Summary
  • Builds a Generative Pretrained Transformer (GPT) from scratch.
  • Follows 'Attention is All You Need' and GPT papers.
  • Uses GitHub Copilot to assist in writing the GPT code.

More from Andrej Karpathy

Andrej Karpathy
Feb 27, 2025
View all episodes →

Get AI Summaries for Every New Episode

Subscribe to Andrej Karpathy and get AI summaries, guest tracking, and email digests delivered automatically.

Sign Up Free →