PodcastIntel
Sign in Get Started Free
Andrej Karpathy
Andrej Karpathy

Let's build the GPT Tokenizer

Feb 20, 2024
Listen to Episode
✨ AI Summary
  • Explains the crucial role of tokenizers in LLMs.
  • Covers training algorithms like Byte Pair Encoding.
  • Builds a GPT tokenizer from scratch, including encode/decode functions.

More from Andrej Karpathy

Andrej Karpathy
How I use LLMs
Feb 27, 2025
Andrej Karpathy
Deep Dive into LLMs like ChatGPT
Feb 5, 2025
Andrej Karpathy
Let's reproduce GPT-2 (124M)
Jun 9, 2024
Andrej Karpathy
[1hr Talk] Intro to Large Language Models
Nov 23, 2023
View all episodes →

Get AI Summaries for Every New Episode

Subscribe to Andrej Karpathy and get AI summaries, guest tracking, and email digests delivered automatically.

Sign Up Free →