RoboBoom
ROBOTIS· June 29, 2012· 6:10

ICRA2012 Challenge-Purdue-Dance Dance Revolution

A ROBOTIS presenter discusses a Darwin humanoid robot that plays Dance Dance Revolution and the vision-processing and motion constraints behind the demonstration.

In this talk

  1. 0:17

    Demonstrating the game

    Dance Dance Revolution asks players to follow on-screen arrows by stepping on a pad. The presenter runs a program that lets Darwin respond to the arrows, noting that the small laptop display affects the demonstration.

  2. 2:22

    Balancing the robot

    The project began with the goal of making Darwin dance on a custom-built pad. The original plan had the robot shift its weight and step without support, but that took too long and strained its motors, so the presenter added a bar for stability and quicker movement.

  3. 3:10

    Finding and timing arrows

    The program uses OpenCV's CBlob library to identify image regions matching the four stationary arrows at the bottom of the screen. It classifies falling arrows by direction, then estimates their speed and arrival time from their positions across successive images before scheduling a step on another thread.

  4. 4:16

    Speed limits and next steps

    Darwin's computing power limits how quickly the program can process the game. The robot can physically step in about 1.1 to 1.2 seconds, but computation makes roughly two seconds more realistic; the demonstrated version took about three seconds per step, while a 2.5-second version was less accurate. The presenter describes plans to avoid returning to a neutral stance after every step and to smooth processing across two image-processing threads on a single-core computer.

Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.

More talks