Open Models Change The Economics of AI
Jeffrey Morgan, CEO of Ollama, talks with Y Combinator about how open-source AI models are cutting enterprise costs and giving companies more control than closed alternatives.
The gist
-
Open models are expected to handle 80 to 90 percent of enterprise AI workloads, with frontier models reserved for the hardest tasks only.
-
Running easier tasks locally on consumer hardware while routing complex ones to the cloud can reduce costs to near zero per token.
-
Morgan says control and customization, not just cost savings, are what keep companies on open models once they make the switch.
-
The supporting infrastructure, such as knowledge retrieval and agent coordination, will likely split into separate specialist tools rather than one platform.
What they recommend · 2 picks
"We were one of the first people, along with Elon and a few others, to receive the DGX Spark as well, which sits on your desk and provides 128 GB of unified memory to run that ki..."
"Starting a company is a really lonely experience. Just having a set of peers — even though we did it during the pandemic — just talking to Jared and five other groups of founder..."
Also mentioned
Related episodes
Episodes covering similar topics