← Back

YaRN

technique 1 mention from 1 sources

Yet another RoPE extensioN - a technique for extending the context length capabilities of models using rotary position embeddings.

ai embeddings context length rope
1

sources

Mentioned by

Sebastian Raschka

All mentions

Sebastian Raschka mentioned ✓ High confidence
"They had a YaRN extension and there was some custom scaling there, and I couldn't quite match these things."
From: State of AI in 2026: LLMs, Coding, Scaling Laws, China, Agents, GPUs, AGI | Lex Fridman Podcast #490 • ▶ 2:02:29 • Jan 2026

Attribution: Sebastian mentions YaRN as part of the technical implementation challenges in OLMo 3