RoboBoom
MIT Robotics· October 23, 2019· 1:04:45

MIT Robotics - Karen Liu - Simulating Realistic Human Motion for Robotics

Karen Liu, an associate professor of computer science at Stanford University, discusses physics-based human motion simulation and its use in robotics at an MIT Robotics talk.

In this talk

  1. 2:08

    Why realistic motion needs autonomy

    Liu contrasts photorealistic digital humans with realistic behavior: the Siren demo looks convincing, but a live actress supplies its movement through motion capture. She argues that virtual humans should generate their own movements in response to goals and changes in their environment.

  2. 9:39

    Making motion more human-like

    Liu’s lab uses anatomical models to make natural motion emerge from tasks and physics rather than copying reference trajectories. The team learns state-dependent joint torque limits and effort functions from OpenSim muscle simulations, then uses them in joint-level control. In examples such as jumping, conventional torque bounds let an agent adopt positions a real person could not use to generate force.

  3. 27:19

    Learning realistic constraints

    For reinforcement learning, the learned effort function shapes the reward, while learned torque limits constrain the agent’s actions. Liu also describes learned joint limits based on captured human poses; these make passive ragdoll motion more human-like and can prevent implausible poses and self-collisions in inverse kinematics.

  4. 34:28

    Adapting robot policies to reality

    Liu presents universal policies conditioned on dynamic model parameters, then adapts them using real-world trials. Rather than requiring the true physical parameters, the method searches for parameters that make the policy perform well. On a Darwin OP2 robot, about 20 walking sequences over 15 to 20 minutes improved forward motion, with some backward and sideways movement; later meta-learning work aimed to speed adaptation.

  5. 47:55

    Using virtual humans for assistance

    Liu describes simulated human partners for robot-assisted dressing, including models with weaker arms, tremors, or limited range of motion. Cloth simulation also provides training data to estimate pressure on limbs from the robot’s forces and torques. For exoskeleton fall prevention, virtual walking agents help train fall detectors and recovery policies, though the work shown remains in simulation.

Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.

More talks