University of Washington professor and NVIDIA Senior Director of Robotics Research Dieter Fox presents his lab’s work on robot manipulation at the University of Toronto Robotics Institute seminar.
Fox describes research aimed at robots that can handle complex tasks in unfamiliar settings, including homes, hospitals, and industrial workplaces. His team built a kitchen test environment to study challenges shared across these domains, using a mobile Franka Panda arm and overhead depth cameras.
Fox presents Pose RBPF, a particle-filtering approach that represents uncertainty across an object’s full 6D pose, including ambiguous orientations caused by symmetry or limited views. He also describes DART, which tracks articulated objects such as robot arms, people, cabinets, and drawers from depth data, assuming their models are known.
Riemannian Motion Policies combine local obstacle avoidance with motion toward a goal, producing fast reactions in the robot’s joint space. Fox shows how a planner can adapt when a person changes the scene, such as closing a drawer the robot needs open, and explains that these systems rely on models of the environment and objects.
Fox describes 6-DoF GraspNet, trained on simulated grasps, which proposes and scores grasps from an object point cloud. In clutter, the system can identify an obstructing object, move it, and retry the target grasp. He also discusses simulation for training and testing, while noting that creating accurate digital environments remains labor-intensive.
Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.
Dieter Fox, senior robotics research director at NVIDIA and professor at the University of Washington, reflects on robotics’ progress and the prospects for open-world robots, with the IEEE Robotics and Automation Society.
Dieter Fox, professor at the University of Washington and robotics research lead at NVIDIA, discusses where robotics stands relative to generative AI and how simulation could help train more capable robots, during a CMU Robotics Institute seminar.
Caelan Garrett, Ankit Goyal, and Iretiayo Akinola, research scientists at NVIDIA Research, present robotics work at the University of Washington Robotics Colloquium hosted by Dieter Fox.
Dieter Fox, senior research director at NVIDIA and professor at the University of Washington, discusses building reusable robot manipulation skills in a talk hosted by MIT Robotics.
Dieter Fox, a University of Washington professor who also leads robotics research at NVIDIA, presents joint work from those teams at GRASP Lab on robot manipulation, with host Dan.
