Solving touch: the last mile of robotics

In this talk

1. 1:09

   Why robots need touch

   Pedersen says tactile perception can help robots handle tasks that fixed industrial automation struggles with. A robot could use touch to judge grip force, detect slipping, and identify an object's texture. His approach combines a conformal, underactuated grasp with sensing so the fingers adapt to different shapes.

2. 4:38

   Sensing, reasoning, and underwater work

   Pedersen says collecting signals such as pressure, heat, and vibration is only part of the challenge; interpreting and combining them reliably also requires software and AI. Sarcos is developing the Starfish underwater hand with research partners Dr. Veronica Santos at UCLA and Professor Jonathan Posner at the University of Washington. The hand is intended to help with tasks in low-visibility water, including assessing and handling threats that naval divers now face.

3. 10:03

   Supervised autonomy for hazardous missions

   Pedersen says teleoperation can return detailed tactile feedback when the connection has enough bandwidth and low latency. Sarcos is also moving toward supervised autonomy, with the robot handling local control and an operator providing higher-level guidance. For mine countermeasure work, he describes a system intended to locate a threat and place a device to render it safe, while humans supervise and handle unfamiliar situations.

4. 13:48

   Robotics beyond the factory

   Pedersen expects more multidigit, conformal hands with sensing to support tasks beyond standard two-finger gripping. He describes a Department of Energy program with electric power companies and solar installation contractors, where robots could move photovoltaic panels weighing about 50 pounds, with future panels potentially reaching 100 pounds. Robotic handling could reduce worker fatigue and injury, and help prevent microcracks that lower panel efficiency.

5. 20:07

   Combining teams and robotics hubs

   Pedersen says RE2 joined Sarcos because their technologies and missions complemented each other, bringing together mobile manipulation, exoskeletons, and robotics talent. He describes Pittsburgh's robotics community growing from six companies in 2001 to more than 100 robotics organizations by the time he sold RE2. Sarcos also has a location in Salt Lake City, giving it access to talent in both regions.