RoboBoom
PALRobotics· January 26, 2024· 4:41

PAL Robotics | EU Project OpenDR - Healthcare Demo

PAL Robotics presents the OpenDR healthcare demo, showing how TIAGo supports patient interaction and assists a doctor in a healthcare facility.

In this talk

  1. 0:05

    OpenDR’s healthcare goal

    OpenDR aims to provide an open toolkit of deep learning functions that help robots understand situations and make decisions. The project targets healthcare, agriculture, and production. PAL Robotics contributed by integrating algorithms for healthcare tasks.

  2. 0:45

    Recognizing and greeting a patient

    The demo combines human presence, activity, speech, gesture, and emotion recognition for person-centered interaction. TIAGo greets Anna, asks how she feels, and responds when she reports a stomach ache by offering to fetch the doctor.

  3. 1:55

    Bringing a drink from the doctor

    TIAGo navigates to the doctor and uses activity recognition to identify that the doctor is working at a computer. It detects three bottles, asks which one to take, then combines YOLOv5 object detection, 3D positioning, skeleton recognition, and PAL Robotics grasping software to pick the selected bottle.

  4. 3:19

    Using gestures and emotion recognition

    TIAGo brings Anna a drink and asks her to make an okay or thumbs-up sign so it can release the bottle. It also recognizes that she appears sad and offers to play music, demonstrating how gesture and emotion recognition shape its responses.

  5. 3:59

    Detecting a fall

    The demo describes TIAGo checking back on Anna and using fall detection while navigating. If it detects someone on the floor, it can alert an emergency contact and share the person's location.

Briefs summarise talks and interviews; timestamps open the video at that moment. Claims in a talk are the speaker's own.

More talks