Chinchilla
DeepMind's influential scaling law research (published as a paper) showing optimal compute allocation between model size and training data for large language models.
Recently discussed in
What creators say
"You have to fit scaling laws. Those of you that are familiar with Chinchilla probably remember this — you predict the loss based off of the model size and the amount of data you've trained on and you fit it using these parameters. However, if you ..."
More from Shayne Longpre →Keep exploring
Topics
About this data
- ✓45,000+ mentions extracted from real podcast transcripts
- ✓Every quote links to the source episode
- ✓Sponsored mentions are always labeled
- ✓Critical takes are shown, never filtered out