Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience - ENSTA Paris - École nationale supérieure de techniques avancées Paris Accéder directement au contenu
Article Dans Une Revue Frontiers in Robotics and AI Année : 2016

Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience

Fabien Benureau
Pierre-Yves Oudeyer

Résumé

The production of behavioral diversity – producing a diversity of effects – is an essential strategy for robots exploring the world when facing situations where interaction possibilities are unknown or non-obvious. It allows to discover new aspects of the environment that cannot be inferred or deduced from available knowledge. However, creating behavioral diversity in situations where it is most crucial – new and unknown ones – is far from trivial. In particular in large and redundant sensorimotor spaces, only small areas are interesting to explore for any practical purpose. When the environment does not provide clues or gradient toward those areas, trying to discover those areas relies on chance. To address this problem, we introduce a method to create behavioral diversity in a new sensorimotor task by re-enacting actions that allowed to produce behavioral diversity in a previous task, along with a measure that quantifies this diversity. We show that our method can learn how to interact with an object by reusing experience from another, that it adapts to instances of morphological changes and of dissimilarity between tasks, and how scaffolding behaviors can emerge by simply switching the attention of the robot to different parts of the environment. Finally, we show that the method can robustly use simulated experiences and crude cognitive models to generate behavioral diversity in real robots.
Fichier principal
Vignette du fichier
frontiersBenureauOudeyer16.pdf (5.66 Mo) Télécharger le fichier
Origine : Publication financée par une institution

Dates et versions

hal-01404329 , version 1 (28-11-2016)

Licence

Paternité

Identifiants

Citer

Fabien Benureau, Pierre-Yves Oudeyer. Behavioral Diversity Generation in Autonomous Exploration through Reuse of Past Experience. Frontiers in Robotics and AI, 2016, 3 (8), ⟨10.3389/frobt.2016.00008⟩. ⟨hal-01404329⟩
182 Consultations
106 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More