Recursion Is The Next Scaling Law In AI
Y Combinator's François Chéard explains how recursive inference in small AI models can outperform much larger LLMs on reasoning tasks, based on two key 2025 papers.
The gist
-
Standard LLMs process everything in one forward pass, which makes true iterative reasoning impossible without workarounds that need human-labeled data.
-
A 7 million parameter recursive model hit 87% accuracy on ARC Prize tasks, beating models with over 100 billion parameters.
-
Weight sharing across recursion levels inside a single transformer layer cuts complexity while keeping strong reasoning ability.
-
Future AI designs may pair large models for understanding language with smaller recursive modules that handle the actual reasoning.
Y, Riley, Greg and Alex agree on 20 things
See what they all use, in their own words. Paid ads are left out.
See what they all swear by Or pick your own peopleRelated episodes
Episodes covering similar topics