Mike Volpi on Why AI Infrastructure Will Outlast the Hype Cycle

a16z · · 56 min

Former Cisco executive Mike Volpi joins a16z to compare the late-1990s internet build-out with today's AI infrastructure boom, arguing the compute will be fully used even if many current owners don't survive.

Watch the episode 56 min · YouTube

The gist

  1. Volpi expects an economic correction, noting NVIDIA counts about 200 neoclouds with weak balance sheets, but says the assets will stay useful, like 1990s fiber.
  2. He says H100s, once rented at $1.82 per GPU hour with an assumed five-year life, now rent for $2.50 to $3 because chips are scarce.

a16z, Riley, Claire and Liam agree on 31 things

See what they all use, in their own words. Paid ads are left out.

See what they all swear by Or pick your own people

Also mentioned

5:26 Fireworks AI · "Even the providers of the open source models like Fireworks AI, Together... are definitely experiencing..."
5:26 Together AI · "Even the providers of the open source models like Fireworks AI, Together... are definitely experiencing..."
11:23 Nvidia H100 · "I remember back when people were excited about Hopper, H100s, right? They were like, okay, well maybe it..."
13:11 Nvidia Vera Rubin · "So the Hopper is going to be a lot worse than Blackwell is going to be a lot worse than Vera Rubin, right?..."
18:09 Melanox · "One, they've made some really clever acquisitions. You know, like Mellanox is the world's largest..."
18:17 Hugging Face · "Now they're making other acquisitions that sometimes I scratch my head. I'm not entirely sure what Hugging..."

What do a16z and experts like them all swear by?

31 things in common

See