nano GPT
1 creator use or recommend it
Andrej Karpathy's minimalist implementation of GPT (Generative Pre-trained Transformer) for educational purposes.
Recently discussed in
What creators say
"I can also give an example from AI. I don't know if you know this nanoGPT benchmark they are running. It's basically asking you to retrain GPT-2, which when it just came out is a very expensive model to train... and right now people can train on a..."
More from Owen He →"We talk on the pod all the time about the nanoGPT speedrun world record collapsing... a collapse from like 60 or 70 seconds down to something like 40 seconds."
More from Alex Wissner-Gross →"In the form of Andrej Karpathy's nano GPT in particular — the Keller Jordan speedrun — a whole bunch of hackers and AI researchers who are continually trying to recreate GPT-2 faster and cheaper. They've been able to cut the original cost of creat..."
More from Alexander Wissner-Gross →"Andre was talking about nano GPT style kind of fine-tuning. Andre joined Anthropic and now he's working on pre-training automation — basically automation of automation."
More from Ramin Hasani →Keep exploring
About this data
- ✓44,000+ mentions extracted from real podcast transcripts
- ✓Every quote links to the source episode
- ✓Sponsored mentions are always labeled
- ✓Critical takes are shown, never filtered out