Transformer
Neural network architecture that revolutionized natural language processing and forms the basis of modern LLMs
Recently discussed in
What creators say
"The Transformer, which sort of underpins everything, it's literally the T in ChatGPT, that came from Google Brain."
More from Astro Teller →"The theoretical idea behind LLMs — Transformers — the paper was there, but Google did nothing with it. Nobody realized the power."
More from Alexandre LeBrun →"If you think of like AlphaGo and reinforcement learning and of course transformers, these are all the key breakthroughs."
More from Demis Hassabis →"The word 'transformer' could still be known. I would guess that deep learning is definitely still known, but the transformer might be evolved away from in 100 years with AGI researchers everywhere."
More from Sebastian Raschka →Keep exploring
About this data
- ✓45,000+ mentions extracted from real podcast transcripts
- ✓Every quote links to the source episode
- ✓Sponsored mentions are always labeled
- ✓Critical takes are shown, never filtered out