Simon Mo

Mentioned in 1 episode

"Ion as the co-founder has always been thinking about open-source and how to support open-source better. Now with experience from Databricks and Anyscale and even Arena, his focus really stems from how do we build software that is being used by so many people on such a critical project."

Mentioned in 1 episode

"Maybe 2023 when GitHub Copilot and ChatGPT are where it is something that people just cannot live without anymore."

Mentioned in 1 episode

"Starting from even MiniMax — when they were releasing their M2.7 model, they had a term specifically focusing on usage."

Mentioned in 1 episode

"Every model release typically involves the model lab, involves a primary or secondary hardware vendors, involves us, involves Hugging Face who are the model format and model hub vendors."

Mentioned in 1 episode

"Probably BERT. For BERT, running it was like, wow, you have to run it on GPU to make it anything faster and efficient for any translation or any task. That was before 2020 even."

Mentioned in 1 episode

"This model is bringing an Opus 4.8 level model to our own infrastructure that I can use, I can run, I can fine-tune, I can understand exactly how many tokens I need, understand the exact performance profile. This is why I'm particularly excited about Kimi K3 not just from the cost perspective, but a lot more on bringing this level of intelligence to something people can own."

Mentioned in 1 episode

"When Mistral dropped their first model, they just dropped a torrent link, and then everybody was struggling and trying to get it up and running. And then we were working behind the scenes with the Mistral team trying to get the inference engines working in vLLM. This was probably the most exciting early weekend we were able to spend on this."

Mentioned in 1 episode

"Now with experience from Databricks and Anyscale and even Arena, his focus really stems from how do we build software that is being used by so many people on such a critical project."

Mentioned in 1 episode

"Before BERT it was ResNet for computation like images, computer vision classification. ResNet already needed to run on an Nvidia K80, which is kind of one of the first GPUs on AWS and other places. But even at this point, ResNet you could still kind of run on a commodity, even CPU devices — it's just very slow."