Sebastian Raschka
FollowEverything Sebastian personally uses, recommends, or has created — plus things they don't recommend — sourced from their own show and appearances on other podcasts.
Created by Sebastian
Top picks
"I try Claude Code on the web every three to six months, which is just prompting a model to make an update to some GitHub repository that I have"
"So, I use the Codeium plugin for VS Code."
"Even back when I was a grad student, I was in a lab doing biophysical simulations, molecular dynamics, and we had a Tesla GPU back then just for the computations. It was about 15 years ago now."
"So, I use the Codeium plugin for VS Code. You know, it's very convenient. It's just like a plugin, and then it's a chat interface that has access to your repository."
"What I would recommend doing, or what I also do, is if I want to understand, for example, how OLMo is implemented, I would look at the weights in the model hub, the config file, and then you can see, 'Oh, they used so many layers.'"
"I can give you also a hands-on example. I was training the Qwen 3 base model with RLVR on MATH-500. The base model had an accuracy of about 15%. Just 50 steps, like in a few minutes with RLVR, the model went from 15% to 50% accuracy."
"Sometimes it takes me a day. With OLMo 3, the challenge was RoPE for the position embeddings. They had a YaRN extension and there was some custom scaling there, and I couldn't quite match these things."
"Exa is my preferred search provider"
All products
Products & gear
Software & tools
Techniques & practices
Recent episodes
All episodes →All recommendations
"I can give you also a hands-on example. I was training the Qwen 3 base model with RLVR on MATH-500. The base model had an accuracy of about 15%. Just 50 steps, like in a few minutes with RLVR, the model went from 15% to 50% accuracy."
"I was training the Qwen 3 base model with RLVR on MATH-500. The base model had an accuracy of about 15%."
"What I would recommend doing, or what I also do, is if I want to understand, for example, how OLMo is implemented, I would look at the weights in the model hub, the config file, and then you can see, 'Oh, they used so many layers.'"
"Exa is my preferred search provider"
"We had a Tesla GPU back then just for the computations. It was about 15 years ago now"
"So, I use the Codeium plugin for VS Code. You know, it's very convenient. It's just like a plugin, and then it's a chat interface that has access to your repository."
"Sometimes for pastime I play video games, like I like- Video games with puzzles, like Zelda and Metroid."
"Sometimes it takes me a day. With OLMo 3, the challenge was RoPE for the position embeddings. They had a YaRN extension and there was some custom scaling there, and I couldn't quite match these things."
"Sometimes for pastime I play video games, like I like- Video games with puzzles, like Zelda and Metroid."
"Even back when I was a grad student, I was in a lab doing biophysical simulations, molecular dynamics, and we had a Tesla GPU back then just for the computations. It was about 15 years ago now."
"So, I use the Codeium plugin for VS Code."
"I should say I use Composer a lot because one of the benefits it has is that it's fast"
"I used that feature before, and I always feel bad because it does that every day, and I rarely check it out"
"I try Claude Code on the web every three to six months, which is just prompting a model to make an update to some GitHub repository that I have"
"So I suggested, 'Hey, let's try ChatGPT.' We copied the text into ChatGPT, and it fixed them. Instead of two hours going from link to link fixing that, it made that type of work much more seamless."
"The Recursive Language Model paper, that is one of the papers that tries to kind of address the long context thing"
"For example, if you read a Substack article, I could maybe ask an LLM to give me opinions on that, but I wouldn't even know what to ask."
"We see this with TikTok. You open it... I don't use TikTok, but supposedly in five minutes the algorithm gets you. It's locked in."
"my wife the other day—she has a podcast for book discussions, a book club, and she was transferring the show notes from Spotify to YouTube, and then the links somehow broke."
"my wife the other day—she has a podcast for book discussions, a book club, and she was transferring the show notes from Spotify to YouTube, and then the links somehow broke."