B. Akgun, M. Cakmak, K. Jiang, and A. L. Thomaz, Keyframe-based Learning from Demonstration, International Journal of Social Robotics, vol.6, issue.2, pp.343-355, 2012.
DOI : 10.1007/s12369-012-0160-0

S. Amershi, M. Cakmak, W. B. Knox, and T. Kulesza, Power to the people: the role of humans in interactive machine learning, pp.105-120, 2014.

P. Andry, P. Gaussier, S. Moga, J. P. Banquet, and J. Nadel, Learning and communication via imitation: an autonomous robot perspective, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, vol.31, issue.5, pp.431-442, 2001.
DOI : 10.1109/3468.952717

C. G. Atkeson and S. Schaal, Robot learning from demonstration, ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning, pp.12-20, 1997.

A. Baranes and P. Oudeyer, Active learning of inverse models with intrinsically motivated goal exploration in robots, Robotics and Autonomous Systems, vol.61, issue.1, 2013.
DOI : 10.1016/j.robot.2012.05.008
URL : https://hal.archives-ouvertes.fr/hal-00788440

M. Beisert, N. Zmyj, R. Liepelt, F. Jung, W. Prinz et al., Rethinking rational imitationin 14-month-old infants: a perceptual distraction approach, PLoS ONE, vol.7, 2012.

A. Billard, S. Calinon, R. Dillmann, and S. Schaal, Robot Programming by Demonstration, Handbook of Robotics, pp.1371-1394, 2008.
DOI : 10.1007/978-3-540-30301-5_60

B. Blumberg, M. Downie, Y. Ivanov, M. Berlin, M. P. Johnson et al., Integrated learning for interactive synthetic characters, ACM Trans. Graph, vol.21566654, pp.417-426, 2002.

S. Boucenna, P. Gaussier, P. Andry, L. S. Hafemeister, P. Gaussier et al., A robot learns the facial expressions recognition and face/non-face discrimination through an imitation game Development of first social referencing skills: emotional interaction as a way to regulate robot behavior, Int. J. Soc. Robot. IEEE Trans. Auton. Ment. Dev, vol.6, issue.6, pp.633-652, 2014.

J. S. Bruner, Child's Talk: Learning to Use Language, Child Language Teaching and Therapy, vol.1, issue.1, 1983.
DOI : 10.1177/026565908500100113

M. Cakmak and A. L. Thomaz, Designing robot learners that ask good questions, Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction, HRI '12, pp.17-24, 2012.
DOI : 10.1145/2157689.2157693

S. Calinon and A. Billard, Teaching a Humanoid Robot to Recognize and Reproduce Social Cues, ROMAN 2006, The 15th IEEE International Symposium on Robot and Human Interactive Communication, pp.346-351, 2006.
DOI : 10.1109/ROMAN.2006.314458

S. Calinon and A. Billard, Incremental learning of gestures by imitation in a humanoid robot, Proceeding of the ACM/IEEE international conference on Human-robot interaction , HRI '07, pp.255-262, 2007.
DOI : 10.1145/1228716.1228751

S. Calinon, F. D-'halluin, E. L. Sauser, D. G. Caldwell, and A. G. Billard, Learning and Reproduction of Gestures by Imitation, IEEE Robotics & Automation Magazine, vol.17, issue.2, pp.44-54, 2010.
DOI : 10.1109/MRA.2010.936947

T. Cederborg and P. Oudeyer, From Language to Motor Gavagai: Unified Imitation Learning of Multiple Linguistic and Nonlinguistic Sensorimotor Skills, IEEE Transactions on Autonomous Mental Development, vol.5, issue.3, pp.222-239, 2013.
DOI : 10.1109/TAMD.2013.2279277
URL : https://hal.archives-ouvertes.fr/hal-00910982

H. H. Clark and S. E. Brennan, Grounding in communication., Perspectives on Socially Shared Cognition, pp.127-149, 1991.
DOI : 10.1037/10096-006

B. Clement, P. Oudeyer, D. Roy, and M. Lopes, Online optimization of teaching sequences with multi-armed bandits, 7th International Conference on Educational Data Mining, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01016428

H. Cuayáhuitl, Robot learning from verbal interaction: a brief survey, Proceedings of the AISB Workshop on New Frontiers in Human Robot Interaction, 2015.

H. Cuayáhuitl, S. Keizer, and O. Lemon, Strategic dialogue management via deep reinforcement learning, NIPS Deep Reinforcement Learning Workshop, 2015.

P. F. Dominey, Toward a construction-based account of shared intentions in social cognition Towards a construction-based framework for development of language, event perception and social cognition: insights from grounded robotics and simulation, Behav. Brain Sci. P. F. Neurocomputing, vol.28, issue.70, pp.696-696, 2005.

M. Gienger, M. Mühlig, and J. J. Steil, Imitating object movement skills with robotsa task-level approach exploiting generalization and invariance, IEEERSJ International Conference on Intelligent Robots and Systems (IROS), pp.1262-1269, 2010.

T. Gliga, C. , and G. , One-Year-Old Infants Appreciate the Referential Nature of Deictic Gestures and Words, Psychological Science, vol.30, issue.3, 2009.
DOI : 10.1111/j.1467-9280.2009.02295.x

J. Grizou, I. Iturrate, L. Montesano, P. Oudeyer, and M. Lopes, Interactive learning from unlabeled instructions, Proceedings of the Thirtieth Conference on Uncertainty in Artificial Intelligence (UAI). number EPFL-CONF-205138, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01007689

J. Grizou, M. Lopes, and P. Oudeyer, Robot learning simultaneously a task and how to interpret human instructions, 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL), pp.1-8, 2013.
DOI : 10.1109/DevLrn.2013.6652523
URL : https://hal.archives-ouvertes.fr/hal-00850703

D. H. Grollman and A. Billard, Donut as I do: Learning from failed demonstrations, 2011 IEEE International Conference on Robotics and Automation, pp.3804-3809, 2011.
DOI : 10.1109/ICRA.2011.5979757

A. J. Ijspeert, J. Nakanishi, and S. Schaal, Movement imitation with nonlinear dynamical systems in humanoid robots, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292), pp.1398-1403, 2002.
DOI : 10.1109/ROBOT.2002.1014739

C. Isbell, C. R. Shelton, M. Kearns, S. Singh, and P. Stone, A social reinforcement learning agent, Proceedings of the fifth international conference on Autonomous agents , AGENTS '01, pp.377-384, 2001.
DOI : 10.1145/375735.376334

F. Kaplan, P. Oudeyer, E. Kubinyi, and A. Miklósi, Robotic clicker training, Robotics and Autonomous Systems, vol.38, issue.3-4, pp.197-206, 2002.
DOI : 10.1016/S0921-8890(02)00168-9

P. Kormushev, S. Calinon, C. , and D. G. , Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic Input, Advanced Robotics, vol.16, issue.5, 2011.
DOI : 10.1163/016918611X558261

E. A. Koterba and J. M. Iverson, Investigating motionese: The effect of infant-directed action on infants??? attention and object exploration, Infant Behavior and Development, vol.32, issue.4, pp.437-444, 2009.
DOI : 10.1016/j.infbeh.2009.07.003

G. Kuhlmann, P. Stone, R. Mooney, and J. Shavlik, Guiding a reinforcement learner with natural language advice: initial results in robocup soccer, The AAAI-2004 Workshop on Supervisory Control of Learning and Adaptive Systems, 2004.

Y. Kuniyoshi, M. Inaba, and H. Inoue, Learning by watching: extracting reusable task knowledge from visual observation of human performance, IEEE Transactions on Robotics and Automation, vol.10, issue.6, pp.799-822, 1994.
DOI : 10.1109/70.338535

B. M. Lake, T. D. Ullman, J. B. Tenenbaum, and S. J. Gershman, Abstract, Center for Brains, Minds & Machines (CBMM) Memo No. 046, 2016.
DOI : 10.1017/S0140525X16001837

S. Lallée, E. Yoshida, A. Mallet, F. Nori, L. Natale et al., Human-Robot Cooperation Based on Interaction Learning, From Motor Learning to Interaction Learning in Robots, pp.491-536, 2010.
DOI : 10.1007/978-3-642-05181-4_21

S. Lauria, G. Bugmann, T. Kyriacou, and E. Klein, Mobile robot programming using natural language, Robotics and Autonomous Systems, vol.38, issue.3-4, pp.171-181, 2002.
DOI : 10.1016/S0921-8890(02)00166-5

D. Lee and C. Ott, Incremental kinesthetic teaching of motion primitives using the motion refinement tube, Autonomous Robots, vol.17, issue.12, pp.115-131, 2011.
DOI : 10.1007/s10514-011-9234-3

H. Lieberman, Your Wish Is My Command: Programming by Example, 2001.

A. Lockerd and C. Breazeal, Tutelage and socially guided robot learning, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), pp.3475-3480, 2004.
DOI : 10.1109/IROS.2004.1389954
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.84.2165

M. Lohse and H. Van-welbergen, Designing appropriate feedback for virtual agents and robots, " in Position paper at RO-MAN 2012 Workshop Robot Feedback in Human-Robot Interaction: How to Make a Robot Readable for a Human Interaction Partner, 2012.

M. Lopes, F. S. Melo, and L. Montesano, Affordance-based imitation learning in robots, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.1015-1021, 2007.
DOI : 10.1109/IROS.2007.4399517

M. Lopes and P. Oudeyer, The strategic student approach for lifelong exploration and learning, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL), pp.1-8, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00755216

I. Lütkebohle, F. Hegel, S. Schulz, M. Hackel, B. Wrede et al., The bielefeld anthropomorphic robot head " flobi, ICRA, pp.3384-3391, 2010.

D. Matthews, E. Lieven, and M. Tomasello, What's in a manner of speaking? Children's sensitivity to partner-specific referential precedents., Developmental Psychology, vol.46, issue.4, pp.749-759, 2010.
DOI : 10.1037/a0019657

L. Montesano, M. Lopes, A. Bernardino, S. , and J. , Modeling affordances using Bayesian networks, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp.4102-4107, 2007.
DOI : 10.1109/IROS.2007.4399511

R. Moore, K. Liebal, and M. Tomasello, Three-year-olds understand communicative intentions without language, gestures, or gaze, Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems, vol.14, issue.1, pp.62-80, 2013.
DOI : 10.1075/is.14.1.05moo

M. Mühlig, M. Gienger, and J. J. Steil, Interactive imitation learning of object movement skills, Autonomous Robots, vol.19, issue.9, pp.97-114, 2012.
DOI : 10.1007/s10514-011-9261-0

Y. Nagai, K. Hosoda, A. Morita, and M. Asada, A constructive model for the development of joint attention, Connection Science, vol.15, issue.4, pp.211-229, 2003.
DOI : 10.1023/A:1013298507114

K. Nelson, Young Minds in Social Worlds: Experience, Meaning, and Memory, 2009.
DOI : 10.4159/9780674041400

S. M. Nguyen, P. M. Oudeyer, and M. J. Mataric, Active choice of teachers, learning strategies and goals for a socially guided intrinsic motivation learner Task learning through imitation and human-robot interaction, Imitation and Social Learning in Robots, Humans and Animals: Behavioural, Social and Communicative Dimensions, pp.136-146, 2005.

J. Peltason and B. Wrede, Pamini: a framework for assembling mixed-initiative human-robot interaction from generic interaction patterns, Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp.229-232, 2010.

M. Petit, S. Lallée, J. Boucher, G. Pointeau, P. Cheminade et al., The Coordinating Role of Language in Real-Time Multimodal Learning of Cooperative Tasks, IEEE Transactions on Autonomous Mental Development, vol.5, issue.1, pp.3-17, 2013.
DOI : 10.1109/TAMD.2012.2209880

E. Pot, J. Monceaux, R. Gelin, and B. Maisonnier, Choregraphe: a graphical tool for humanoid robot programming, RO-MAN 2009, The 18th IEEE International Symposium on Robot and Human Interactive Communication, pp.46-51, 2009.
DOI : 10.1109/ROMAN.2009.5326209

K. J. Rohlfing, J. S. Poblete, and F. Joublin, Learning new words in unfamiliar frames from direct and indirect teaching, 17th Workshop on the Semantics and Pragmatics of Dialogue (SemDial), pp.121-130, 2013.

K. J. Rohlfing, B. Wrede, A. Vollmer, and P. Oudeyer, An Alternative to Mapping a Word onto a Concept in Language Acquisition: Pragmatic Frames, Frontiers in Psychology, vol.8, issue.e79659, 2016.
DOI : 10.1371/journal.pone.0079659
URL : https://hal.archives-ouvertes.fr/hal-01404385

L. M. Saksida, S. M. Raymond, and D. S. Touretzky, Shaping robot behavior using principles from instrumental conditioning, Robotics and Autonomous Systems, vol.22, issue.3-4, pp.231-249, 1997.
DOI : 10.1016/S0921-8890(97)00041-9

J. Salas-poblete, Learning Words: Comparing Two-Year-Olds Learning Success in Dyadic and Triadic Teaching Situations Embedded in Familiar and Unfamiliar Contexts, 2011.

M. Salem, S. Kopp, I. Wachsmuth, K. Rohlfing, and F. Joublin, Generation and Evaluation of Communicative Robot Gesture, International Journal of Social Robotics, vol.6, issue.4, pp.201-217, 2012.
DOI : 10.1007/s12369-011-0124-9

G. Sandini, G. Metta, and D. Vernon, The iCub??Cognitive Humanoid Robot: An Open-System Research Platform for Enactive Cognition, 50 Years of Artificial Intelligence, pp.358-369, 2007.
DOI : 10.1007/978-3-540-77296-5_32

J. Saunders, C. L. Nehaniv, and K. Dautenhahn, Teaching robots by moulding behavior and scaffolding the environment, Proceeding of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction , HRI '06, pp.118-125, 2006.
DOI : 10.1145/1121241.1121263

P. B. Schumacher, Content and context in incremental processing: ???the ham sandwich??? revisited, Philosophical Studies, vol.80, issue.2, pp.151-165, 2014.
DOI : 10.1007/s11098-013-0179-6

W. D. Smart and L. P. Kaelbling, Effective reinforcement learning for mobile robots, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292), pp.3404-3410, 2002.
DOI : 10.1109/ROBOT.2002.1014237

L. Steels, Language games for autonomous robots, IEEE Intelligent Systems, vol.16, issue.5, pp.16-22, 2001.
DOI : 10.1109/MIS.2001.956077

L. Steels and F. Kaplan, Aibos first words: the social learning of language and meaning, Evol. Commun, vol.4, 2002.

E. E. Thom and C. M. Sandhofer, More is more: The relationship between vocabulary size and word extension, Journal of Experimental Child Psychology, vol.104, issue.4, pp.466-473, 2009.
DOI : 10.1016/j.jecp.2009.07.004

A. L. Thomaz and C. Breazeal, Reinforcement learning with human teachers: evidence of feedback and guidance with implications for learning performance, AAAI, pp.1000-1005, 2006.

A. L. Thomaz and C. Breazeal, Transparency and socially guided machine learning, 5th Intl. Conf. on Development and Learning (ICDL), 2006.

A. L. Thomaz and M. Cakmak, Learning about objects with human teachers, Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, HRI '09, pp.15-22, 2009.
DOI : 10.1145/1514095.1514101
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.150.3845

N. G. Tsagarakis, Z. Li, J. Saglia, C. , and D. G. , The design of the lower body of the compliant humanoid robot cubb, IEEE International Conference on Robotics and Automation (ICRA), pp.2011-2035, 2011.

A. Vinciarelli, M. Pantic, D. Heylen, C. Pelachaud, I. Poggi et al., Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing, IEEE Transactions on Affective Computing, vol.3, issue.1, pp.69-87, 2011.
DOI : 10.1109/T-AFFC.2011.27

A. Vollmer, J. Grizou, M. Lopes, K. Rohlfing, and P. Oudeyer, Studying the co-construction of interaction protocols in collaborative tasks with humans, 4th International Conference on Development and Learning and on Epigenetic Robotics, pp.208-215, 2014.
DOI : 10.1109/DEVLRN.2014.6982983
URL : https://hal.archives-ouvertes.fr/hal-01090934

R. Voyles and P. Khosla, A multi-agent system for programming robotic agents by human demonstration, Proceedings of AI and Manufacturing Research Planning Workshop, pp.184-190, 1998.

L. Wittgenstein, Philosophical Investigations, 1953.

F. Xu and J. B. Tenenbaum, Word learning as Bayesian inference., Psychological Review, vol.114, issue.2, 2007.
DOI : 10.1037/0033-295X.114.2.245

Y. Yamashita, T. , and J. , Emergence of functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment, PLoS Comput. Biol, 2008.

M. Zinn, O. Khatib, B. Roth, and J. K. Salisbury, Playing it safe, IEEE Robotics & Automation Magazine, vol.11, issue.2, pp.12-21, 2004.
DOI : 10.1109/MRA.2004.1310938