Wearable multi-modal interface for human multi-robot interaction

Gromov, Boris and Gambardella, Luca Maria and Di Caro, Gianni A. (2016) Wearable multi-modal interface for human multi-robot interaction. In: 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), 23.10.2016-27.10.2016, Lausanne, Switzerland.

Full text not available from this repository.


A complete prototype for multi-modal interaction between humans and multi-robot systems is described. The application focus is on search and rescue missions. From the human-side, speech and arm and hand gestures are combined to select, localize, and communicate task requests and spatial information to one or more robots in the field. From the robot side, LEDs and vocal messages are used to provide feedback to the human. The robots also employ coordinated autonomy to implement group behaviors for mixed initiative interaction. The system has been tested with different robotic platforms based on a number of different useful interaction patterns.

Actions (login required)

View Item View Item