Prosody-Driven Robot Arm Gestures Generation in Human-Robot Interaction

Amir Aly (1) , Adriana Tapus (2)

1 RV - Robotique et Vision
2 U2IS - Unité d'Informatique et d'Ingénierie des Systèmes

In multimodal human-robot interaction (HRI), the process of communication can be established through verbal, non-verbal, and/or para-verbal cues. The linguistic literature shows that para-verbal and non-verbal communications are naturally synchronized. This research focuses on the relation between non-verbal and para-verbal communication by mapping prosody cues to the corresponding arm gestures. Our approach uses the coupled hidden Markov models (CHMMs), which could be seen as a collection of HMMs, one for the prosodic characteristics stream and six HMMs for the arm movements stream.

Domaines: Robotique [cs.RO]

Amir Aly, Adriana Tapus. Prosody-Driven Robot Arm Gestures Generation in Human-Robot Interaction. The 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Mar 2012, Boston, United States. ⟨hal-01265938⟩