Solving the Hardest Problem in Robotics | Fei-Fei Li with a16z

a16z · · 42 min

Fei-Fei Li and Yunzhu Li discuss how simulation and spatial intelligence can solve robotics' biggest obstacle: the scarcity of real-world training data.

Watch the episode 42 min · YouTube

The gist

  1. The main bottleneck in robotics is not hardware but data, and simulation can generate training data far faster than real-world collection.
  2. World models need to stay geometrically consistent across viewpoints and interactions, because video-only models often make objects disappear or behave unrealistically.

Also mentioned

1:18 World Labs · "World Labs is a two-year-old startup. It's a frontier model lab. We are building the next frontier of AI..."
3:50 SceniX · "As Scenix, we are developing what we call a real-to-sim-to-real pipeline. We want to map the real..."
6:07 Marble · "Marble is the code name for the base model that World Labs has been training and iterating on. The..."

Follow a16z

Free email updates