Gemini Robotics 1.5: Using agentic capabilities
Google DeepMind’s Gemini Robotics team demonstrates how ALOHA and Apollo use agentic capabilities to complete household tasks by combining robot control with internet access.
In this talk
- 0:21
Sorting waste with local rules
ALOHA is asked to sort objects into compost, recycling, and trash using San Francisco guidelines. It identifies the green bin for compost, blue for recycling, and black for trash.
- 0:40
Combining web lookup and visual reasoning
The system looks up the disposal rules, examines the objects, and matches each object to a bin before completing the task. This example combines internet access with robot control.
- 0:59
Packing for a rainy trip
Apollo is asked to put a beanie in a travel bag for a trip to London. When asked about the weather, it predicts rain on several days the following week and adds an umbrella.
Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.