Towards hierarchical curiosity-driven exploration of sensorimotor models - ENSTA Paris - École nationale supérieure de techniques avancées Paris Accéder directement au contenu
Poster De Conférence Année : 2015

Towards hierarchical curiosity-driven exploration of sensorimotor models

Résumé

Curiosity-driven exploration mechanisms have been proposed to allow robots to actively explore high dimensional sensorimotor spaces in an open-ended manner [1], [2]. In such setups, competence-based intrinsic motivations show better results than knowledge-based exploration mechanisms which only monitor the learner's prediction performance [2], [3]. With competence-based intrinsic motivations, the learner explores its sensor space with a bias toward regions which are predicted to yield a high competence progress. Also, throughout its life, a developmental robot has to incrementally explore skills that add up to the hierarchy of previously learned skills, with a constraint being the cost of experimentation. Thus, a hierarchical exploration architecture could allow to reuse the sensorimotor models previously explored and to combine them to explore more efficiently new complex sensorimotor models. Here, we rely more specifically on the R-IAC and SAGG-RIAC series of architectures [3]. These architectures allow the learning of a single mapping between a motor and a sensor space with a competence-based intrinsic motivation. We describe some ways to extend these architectures with different tasks spaces that can be explored in a hierarchical manner, and mechanisms to handle this hierarchy of sensorimotor models that all need to be explored with an adequate amount of trials. We also describe an interactive task to evaluate the hierarchical learning mechanisms, where a robot has to explore its motor space in order to push an object to different locations. The robot can first explore how to make movements with its hand and then reuse this skill to explore the task of pushing an object.
Fichier principal
Vignette du fichier
poster.pdf (2.71 Mo) Télécharger le fichier
abstract.pdf (204.61 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01250424 , version 1 (04-01-2016)

Identifiants

Citer

Sébastien Forestier, Pierre-Yves Oudeyer. Towards hierarchical curiosity-driven exploration of sensorimotor models. 5th International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), Aug 2015, Providence, RI USA, United States. , Proceedings of the 5th International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), 2015, ⟨10.1109/DEVLRN.2015.7346146⟩. ⟨hal-01250424⟩
214 Consultations
238 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More