Ep#109: Enigma - Connecting 100 Robots To The Internet
Jonathan Jacobe of Enigma discusses foundation models and robot interfaces with the RoboPapers hosts, drawing on Enigma’s online deployment of more than 100 robots.
In this talk
- 0:13
Why put 100 robots online
Enigma set up a warehouse of tabletop robots so people could try real robots remotely, since few people have access to robots at home. The tables offered different activities, including painting, chemistry tasks, bomb-diffusing scenarios, and sword-fighting games. Jacobe said the project drew two million views and millions of interactions.
- 3:54
Interfaces shape robot use
The team customized SO-101 arms and paired different tables with different ways to interact. One let users tap objects and type instructions, such as asking a robot to pour from one container into another. Jacobe argued that interfaces should suit the task, and described game designers working with researchers to explore capabilities that could become possible through new interaction patterns.
- 19:31
Generalization and efficient models
Enigma’s goal is to build models that can handle new tasks and settings without fine-tuning each one. Jacobe said video pretraining supplied most of the learning, while work on encoders aimed to reduce data needs and speed inference. He also described research into latent representations, arguing that a few easily predicted features can dominate a representation and crowd out other useful information.
- 23:35
What live use revealed
Public interaction exposed operational and safety challenges: users caused chemical spills, broke dozens of robots, and wore down servos. The team used input and output filters, flagged problematic sessions, and ran dashboards and staff shifts to keep the setup working. Jacobe said messy tables, shifting objects, and unexpected requests showed why models need to generalize beyond carefully maintained conditions.
- 45:47
What comes next
Enigma plans further robot deployments that build on the project’s lessons, alongside technical research posts and tools for the robotics community. Jacobe mentioned hardware and firmware resources, including help with servo use at scale. He also said the team would share more about its model architecture and research.
Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.