Ashok Elluswamy, who leads Tesla’s AI team, discusses end-to-end driving models, evaluation, and shared AI foundations for Tesla vehicles and Optimus at a Matroid event.
Elluswamy frames Tesla’s mission as making abundance more widely available through autonomous vehicles and humanoid robots. He describes the Austin robotaxi service and presents Optimus as a way to automate physical work using spaces designed for people.
Tesla’s driving network takes camera video, navigation, vehicle state, and audio, then predicts control actions. Elluswamy argues that separate perception, prediction, and planning modules can lose context, using a puddle and oncoming traffic to show why driving decisions depend on the whole scene. He also cites FSD examples where cars wait for chickens or move around geese based on their behavior.
Elluswamy describes the challenge of turning large streams of camera history into the right driving actions, and says Tesla’s fleet generates about 500 years of driving data daily. The team filters for unusual events, such as emergency vehicles or a car beginning to skid, so models can learn from rare situations and react early.
Tesla probes its end-to-end network with geometric and language-based reasoning, including 3D scene representations generated with Gaussian splatting. For evaluation, a learned world simulator recreates video from actions, allowing newer policies to replay past incidents or face modified scenarios. Elluswamy says the same modeling approach extends to Optimus scenes and manipulation tasks.
Elluswamy says Tesla trains driving and simulation networks on data shared across its robots, showing controllable indoor scenes and actions such as opening drawers. In the Q&A, he argues cameras provide enough information when AI can interpret them, says the system issues control commands 36 times per second, and discusses future voice control alongside safety concerns.
Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.
RoboStrategy head of research Scott Walter, an aerospace engineer and robotics-company co-founder, joins host Herbert to discuss Tesla Optimus V3’s design, production readiness, and remaining engineering challenges.
Scott Walter joins The Humanoid Hub host to analyze Tesla’s Optimus hand and production plans, Figure’s robot output, and humanoid robots’ performance in the Beijing half marathon.
Host speaks with Scott Walter, a roboticist known for humanoid hardware analysis, on The Humanoid Hub about Tesla Optimus hand patents and what they reveal about the hand’s design.
At GTC, NVIDIA Omniverse host and panelists Pras Velicodi (Agility Robotics), Ashok Elluswamy (Tesla), Chelsea (Physical Intelligence and Stanford), Arnaud Rubaire (Exon Robotics), Deepak Pathak (Scaled AI and Carnegie Mellon), and Russ discuss data, simulation, robot brains, and deploying humanoids at scale.
Kalil 4.0 discusses humanoid robots for homes, factories, retail, and companionship, comparing emerging companies and their plans across the United States, China, Europe, and elsewhere.