Multisensory perception

The aim of this work package is to define the sensors for perceiving the environment. This task is essential to enable the high-level controls to be able to work. Both the navigation and human-machine interaction, whether cognitive or physical, require information obtained from the sensors (task 3.1 on extractors), fusion of sensor information (task 3.2 and 3.3 for the fusion of the visuals with the audio and haptics) and enhancement on the basis of semantic knowledge (task 3.4 on semantic mapping) and knowledge of the robot's activity log (task 3.5 on memorisation).

On the basis of the information provided by the services developed in this sub-project, the interaction tasks for the following sub-projects will be possible.

Camera 3D

Stereo

Signal

Body picture: 
Camera 3D
Stereo
Signal