Google TPU

"We love TPUs, we're going to make TPUs work. Yes, we love Trainium, we're going to make Trainium work. Every chip has a comparative advantage; we have to find that advantage and then squeeze it in that direction."

"We came up with TPUs, which are very specialized for essentially low precision dense linear algebra, which is at the heart of nearly all of the modern machine learning algorithms we use today. That system produced a chip a couple years later that ..."

"It fundamentally is not existential for my company for this product to win. For Google with TPUs, their revenue comes from search. Google won't fail if TPUs fail."

"If Google has TPUs, Amazon have Trainium, while OpenAI now has Jalapeno."

Peter Diamandis

mentioned

"Those TPUs are I mean that that's the lynch pin. And if you know they're 2x the power efficiency, but they're they're in the hunt now competing vertically."

"You look at today where the latest Google TPU and where the Nvidia chipsets are at we're talking five petaflops"

"Google is dying to get more TPU wafer capacity"

"Those decisions made 10 years ago set up the TPU as the perfect inference engine for the reasoning tech steps I'm describing."

TBPN

mentioned

"the TPU was developed by the TPU team. DeepMind didn't realize how important it was going to be, how compute constrained they were going to be. So the TPU went and sold it to Anthropic"

"I don't think people realize that Alexa and Google Home and Apple Home are about to use this for real."

20VC with Harry Stebbings

mentioned

"Anthropic signed a deal for a million TPUs"

"Largely because the margin on NVIDIA chips is insane, and Google can develop everything from top to bottom to fit their stack and not have to pay this margin."