RoboBoom
Invest Like The Best· March 31, 2026· 1:15:16

World's Top Researcher on AI, LLMs, and Robot Intelligence

Sergey Levine, co-founder and researcher at Physical Intelligence, discusses robotic foundation models, learning from experience, and the challenges of building useful general-purpose robots with Invest Like The Best host Patrick O’Shaughnessy.

In this talk

  1. 1:12

    A general model for many robots and tasks

    Levine says Physical Intelligence aims to build models that control different embodied systems across many tasks. The case for generality is that learning across tasks and robots could build shared physical understanding, much as language models draw on broad data. That foundation could let people create new robotic applications without building the full intelligence stack themselves.

  2. 9:48

    Learning physical skills and handling the unexpected

    Levine describes robotic learning as a decades-old idea, with early end-to-end driving systems in the 1980s and deep reinforcement learning in the 2010s as milestones. Physical Intelligence adapts language models into vision-language-action models using web, image, and robot data. The team uses intermediate reasoning to apply prior knowledge to unusual scenes, then reinforcement learning to improve practiced skills, as in its espresso-making demo.

  3. 20:52

    Generalization, data, and coaching robots

    Levine says the team’s robot uses three cameras and no touch or force sensors, and that learning can compensate for limited sensing. He expects useful robots to gather more data as they work, though the right data source may vary by domain. In one experiment, adding high-level language labels to a robot’s experience improved generalization without adding more teleoperation actions, suggesting people may be able to coach robots through instructions.

  4. 28:46

    Where robots may struggle, and how they could help

    Levine sees unpredictable home environments as a major technical challenge: robots must respond sensibly even when they cannot complete a task. He also expects care for children and older adults to be difficult because these jobs combine physical skill with sensitive human interaction. In workplaces, he anticipates robots working alongside people in ways similar to coding tools that increase software engineers’ productivity.

  5. 43:32

    Experimentation, deployment, and open questions

    Levine argues that accessible models could let many people prototype robotic applications, and says Physical Intelligence has open-sourced models and wants other companies to experiment with them. He is still uncertain how much deployment will rely on demonstrations, autonomous experience, or a combination, and says those choices affect how businesses should prepare. The team is currently studying how robots should represent and reason about scenes and tasks between high-level instructions and low-level actions.

Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.

More talks