RoboBoom
RoboPapers· December 10, 2025· 53:50

Ep#51: Humanoid Everyday

Ria, a USC assistant professor, and her student coauthors discuss their Humanoid Everyday dataset and humanoid manipulation research with the RoboPapers hosts.

In this talk

  1. 2:10

    Building the dataset and collection pipeline

    The team collected more than 10,300 trajectories across 260 tasks, totaling over three million frames from Unitree G1 and H1 robots. They synchronized RGB, depth, LiDAR, tactile, and robot-state streams at 30 Hz, and built a viewer for exploring 50 example tasks. The dataset covers seven areas, including tool use, locomotion, and high-precision manipulation.

  2. 6:33

    Policy results and data quality

    The team evaluated imitation learning and vision-language-action policies on tasks such as folding a towel, inserting a flower into a vase, and handling a door. Pretrained VLA models generally did better than traditional imitation methods; GR00T N1.5 averaged 51% success, while the most difficult vase insertion reached only about 10% with OpenVLA. The team said roughly 20 to 30% of early recordings were discarded because of timing, frame, or camera-view problems.

  3. 10:46

    What it took to collect the data

    The project took nearly nine months, involved several students and additional data collectors, and resulted in two damaged G1 robots that Unitree helped repair. The published data contains about 30 hours of recordings, while the team estimated roughly 151 hours of teleoperation for the tasks alone, before counting planning, quality checks, and hardware repairs. Operators needed practice adapting to the robot’s fixed neck and narrow camera view.

  4. 25:28

    Training value and remote evaluation

    The researchers found that pretraining on Humanoid Everyday improved later task tuning: for one insertion task, π0.5 had no successes without that prior and four successes in ten trials with it. They also described a cloud evaluation platform that sends robot images and state to a researcher’s client and returns inferred actions. The team hopes to use it for controlled, comparable evaluations and possibly a challenge.

  5. 38:42

    Limits and future directions

    The current dataset mostly uses simple lower-body movements, and the team said VLA models struggle with more complex motions such as crouching or sitting. They want to explore whole-body policies, action tokenization, and human egocentric video as more scalable training data. The researchers also argued that teleoperation remains useful for aligning policies to robot actions, even if other data sources are needed to scale collection.

Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.

More talks