← Back

GPT-2

software 2 mentions from 2 sources

OpenAI's earlier language model that was previously their last open-source release before gpt-oss-120b.

ai openai llm historical transformer
2

sources

Mentioned by

Sebastian Raschka Nathan Lambert

All mentions

Nathan Lambert mentioned ✓ High confidence
"When I was writing about OpenAI's open model release, they were like, 'Don't forget about GPT-2,' which I thought was really funny 'cause it's just such a different time."
From: State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI | Lex Fridman Podcast #490 • ▶ 29:26 • Jan 2026

Attribution: Nathan mentions GPT-2 in the context of OpenAI's history with open models, noting how different the landscape was then

Sebastian Raschka mentioned ✓ High confidence
"And then you start, let's say, with your GPT-2 model and add these things."
From: State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI | Lex Fridman Podcast #490 • ▶ 2:02:01 • Jan 2026

Attribution: Sebastian mentions GPT-2 as a starting point for building and understanding language models