← All episodes

The Early Days of Anthropic & How 21 of 22 VCs Rejected It | The Four Bottlenecks in AI | Anj Midha

| 22 products mentioned
Watch on YouTube frontier ai infrastructure compute allocation venture capital strategy geopolitical ai competition full-stack business models standardization in ai systems ai security and distillation attacks

Anj Midha, the prominent AI investor and founder of AMP, identifies the four critical bottlenecks limiting frontier AI progress: context feedback loops, compute, capital, and culture—arguing that culture is the most important because it attracts the talent that solves algorithmic innovation. Rather than a debate about AI alignment or capability ceilings, Midha contends the real problem is human misalignment: the failure of Silicon Valley and Washington to standardize how statistical AI systems should be procured and deployed differently from deterministic software, creating infrastructure waste and undermining Western competitiveness against China's coordinated, full-stack approach.

Key takeaways
  • The compute standardization crisis is the existential infrastructure problem: compute is non-fungible across chip types (H100s vs. GB200s), creating billions in stranded GPU capacity, and standardization following the electricity grid model is more urgent than AI safety debates
  • Frontier AI companies should be viewed as full-stack frontier systems businesses, not "foundation model companies"—they must own the entire loop from training data collection (e.g., physical labs for material science) through inference deployment to capture unique context feedback loops that competitors can't replicate
  • Vertical integration with proprietary data loops is the only defensible moat: companies like Periodic Labs (material science via physical verification loops) cannot be "claudified" because they control data generation at the point of deployment, unlike pure software models
  • Build ventures through deep partnership with scientists/founders rather than transactional check-writing—the Kleiner Perkins model of co-founding (e.g., Bob Swanson co-founding Genentech) beats the 2010s venture model where investors write checks and disappear
  • Sovereign compute infrastructure in Europe (e.g., Mistral) is competitively viable because regulatory constraints (Cloud Act) and geopolitical mission-critical workloads create genuine, defensible local demand that hyperscalers cannot serve
  • Western frontier labs need coordinated "Iron Dome" defense: a shared inference proxy that alerts all labs to distillation attacks, since China is systematically reverse-engineering U.S. models at scale via adversarial distillation and open-source bootstrapping

Recommendations (3)

Mistral
Mistral uses

"Arthur Mench who is a French scientist from DeepMind turned entrepreneur and starts a lab called Mistral"

Anj Midha · ▶ 12:11

Andreessen Horowitz

"When I got to a16z as a general partner, the first thing I did is I sat down with Mark and Ben"

Anj Midha · ▶ 23:31

Kleiner Perkins

"I got to apprentice in that mode of venture capital because when I got to Kleiner"

Anj Midha · ▶ 27:15

Mentioned (19)

Discord
Discord "Most of my net worth was tied up in Discord stock" ▶ 17:00
Claude
Claude "We started benchmarking these models, you know Claude, Gemini and so on and surprise they sucked" ▶ 5:55
Gemini
Gemini "We started benchmarking these models, you know Claude, Gemini and so on and surprise they sucked" ▶ 5:55
AWS
AWS "You can't run them on Amazon AWS, GCP or Azure" ▶ 12:47
GCP
GCP "You can't run them on Amazon AWS, GCP or Azure" ▶ 12:47
Azure
Azure "You can't run them on Amazon AWS, GCP or Azure" ▶ 12:47
GPT-3
GPT-3 "These are the guys who invented GPT-3. How much more proof do you want?" ▶ 17:23
OpenAI
OpenAI "OpenAI had raised, cuz by then I think OpenAI had raised a billion dollars" ▶ 17:57
REI
REI "REI is a public benefit corporation. They make billions of dollars in revenue and profit. Have th..." ▶ 19:59
Ben & Jerry's
Ben & Jerry's "Ben and Jerry's public benefit corporation. Have they been hauled up in front of Congress? No." ▶ 20:06
Stripe
Stripe "We use Stripe for payments" ▶ 24:58
Intel
Intel "Intel for example, right, was a very close partnership between a couple of scientists and a inves..." ▶ 26:45
Genentech
Genentech "Genentech which was incubated in the basement of Kleiner" ▶ 27:02
Apple
Apple "Mike Markel personal computing effectively the first CEO for the first year of Apple was Mike Markel" ▶ 29:02
Sequoia
Sequoia "They just raised $50M from Sequoia" ▶ 33:24
ChatGPT
ChatGPT "I opened ChatGPT and asked it to summarize" ▶ 40:23
Zero to One "I took this class that Peter taught called uh I think it was turned into this book called Zero to..." ▶ 48:40
Cursor
Cursor "You could look at a cursor and say well they've built their own vertical model end to end" ▶ 9:50
Robinhood Ventures "My friend Vlad who runs Robin Hood floated did recently this like venture fund thing on on Robin ..." ▶ 59:54