Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-mlc7c Total loading time: 0 Render date: 2024-11-08T06:31:38.825Z Has data issue: false hasContentIssue false

31 - Curiosity-Driven Learning in Development

Computational Theories and Educational Applications

from Part III - Education and School-Learning Domains

Published online by Cambridge University Press:  24 February 2022

Olivier Houdé
Affiliation:
Université de Paris V
Grégoire Borst
Affiliation:
Université de Paris V
Get access

Summary

The timing and ordering of learning experience play a critical role in developmental processes. To make sense and learn skills out of the initial “buzzy blooming confusion,” multiple mechanisms interact to canalize the infant through such ordered and progressively more complex learning experiences, harnessing the complexity of the world.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2022

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Audibert, J.-Y., Munos, R., & Szepesvari, C. (2009). Exploration–exploitation tradeoff using variance estimates in multi-armed bandits. Theoretical Computer Science, 410, 18761902.CrossRefGoogle Scholar
Bakker, B., & Schmidhuber, J. (2004). Hierarchical reinforcement learning based on subgoal discovery and subpolicy specialization. Proceedings of the 8th Conference on Intelligent Autonomous Systems (pp. 438445). Amsterdam, Netherlands.Google Scholar
Baldassare, G., Mirolli, M. (2013). Intrinsically Motivated Learning in Natural and Artificial Systems. Berlin: Springer-Verlag.Google Scholar
Baranes, A., & Oudeyer, P. Y. (2013). Active learning of inverse models with intrinsically motivated goal exploration in robots. Robotics and Autonomous Systems, 61, 4973.Google Scholar
Barto, A. G. (2013). Intrinsic motivation and reinforcement learning. In Baldassarre, G., & Mirolli, M. (eds.), Intrinsically Motivated Learning in Natural and Artificial Systems (pp. 1747). Berlin: Springer.Google Scholar
Benureau, F. C. Y., & Oudeyer, P.-Y. (2016). Behavioral diversity generation in autonomous exploration through reuse of past experience. Frontiers in Robotics and AI, 3. CrossRefGoogle Scholar
Berlyne, D. (1960). Conflict, Arousal and Curiosity. New York: McGraw-Hill.Google Scholar
Berlyne, D. (1965). Structure and Direction in Thinking. New York: John Wiley and Sons, Inc.Google Scholar
Beuls, K. (2013). Towards an Agent-based Tutoring System for Spanish Verb Conjugation. PhD thesis, Vrije Universiteit, Brussel.Google Scholar
Beuls, K., & Loeckx, J. (2015). Steps towards intelligent MOOCs: A case study for learning counterpoint. In Steels, L. (ed.), Music Learning with Massive Open Online Courses (pp. 119144). Amsterdam: IOS Press.Google Scholar
Cangelosi, A., & Schlesinger, M. (2015). Developmental Robotics: From Babies to Robots. Cambridge, MA: MIT Press.Google Scholar
Cardoso-Leite, P., & Bavelier, D. (2014). Video game play, attention, and learning: How to shape the development of attention and influence learning? Current Opinion in Neurology, 27, 185191.Google Scholar
Clement, B., Roy, D., Oudeyer, P.-Y., & Lopes, M. (2015). Multi-armed bandits for intelligent tutoring systems. Journal of Educational Data Mining (JEDM), 7, 2048.Google Scholar
Cohn, D. A., Ghahramani, Z., & Jordan, M. I. (1996). Active learning with statistical models. Journal of Artificial Intelligence Research, 4, 129145.Google Scholar
Cordova, D. I., & Lepper, M. R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88, 715.Google Scholar
Csikszenthmihalyi, M. (1991). Flow-the Psychology of Optimal Experience. New York: Harper Perennial.Google Scholar
Deci, E. L., Koestner, R., & Ryan, R. M. (2001). Extrinsic rewards and intrinsic motivation in education: Reconsidered once again. Review of Educational Research, 71, 127.Google Scholar
Festinger, L. (1957). A Theory of Cognitive Dissonance. Evanston, IL: Row, Peterson.Google Scholar
Forestier, S., & Oudeyer, P.-Y. (2016). Curiosity-driven development of tool use precursors: A computational model. Proceedings of the 38th Annual Conference of the Cognitive Science Society (CogSci 2016) (pp. 18591864). August 2016, Philadelphia, PA.Google Scholar
Friston, K., Adams, R. A., Perrinet, L., & Breakspear, M. (2012). Perceptions as hypotheses: Saccades as experiments. Frontiers in Psychology, 3, 151.Google Scholar
Froebel, F. (1885). The Education of Man. New York: A. Lovell & Company.Google Scholar
Gottlieb, G. (1991). Experiential canalization of behavioral development: Theory. Developmental Psychology, 27, 413.Google Scholar
Gottlieb, J., & Oudeyer, P. Y. (2018). Towards a neuroscience of active sampling and curiosity. Nature Reviews Neuroscience, 19, 758770.Google Scholar
Gottlieb, J., Oudeyer, P.-Y., Lopes, M., & Baranes, A. (2013). Information seeking, curiosity and attention: Computational and neural mechanisms. Trends in Cognitive Science, 17, 585596.Google Scholar
Harlow, H. (1950). Learning and satiation of response in intrinsically motivated complex puzzle performances by monkeys. Journal of Comparative and Physiological Psychology, 43, 289294.Google Scholar
Houdé, O. (2015). Cognitive development during infancy and early childhood across cultures. In Wright, J. D. (ed.), International Encyclopedia of the Social and Behavioral Sciences (2nd ed., pp. 4350). Oxford: Elsevier Science.Google Scholar
Hull, C. L. (1943). Principles of Behavior: An Introduction to Behavior Theory. New-York: Appleton-Century-Croft.Google Scholar
Hunt, J. M. (1965). Intrinsic motivation and its role in psychological development. Nebraska Symposium on Motivation, 13, 189282.Google Scholar
Kagan, J. (1972). Motives and development. Journal of Personality and Social Psychology, 22, 5166.Google Scholar
Kang, M. J., Hsu, M., Krajbich, I. M., Loewenstein, G., McClure, S. M., Wang, J. T. Y., & Camerer, C. F. (2009). The wick in the candle of learning: Epistemic curiosity activates reward circuitry and enhances memory. Psychological Science, 20, 963973.Google Scholar
Kaplan, F., & Oudeyer, P.-Y. (2007a). The progress-drive hypothesis: An interpretation of early imitation. In Dautenhahn, K., & Nehaniv, C. (eds.), Models and Mechanisms of Imitation and Social Learning: Behavioural, Social and Communication Dimensions (pp. 361377). Cambridge: Cambridge University Press.Google Scholar
Kaplan, F., & Oudeyer, P.-Y. (2007b). In search of the neural circuits of intrinsic motivation. Frontiers in Neuroscience, 1, 225236.Google Scholar
Kidd, C., Piantadosi, S. T., & Aslin, R. N. (2012). The goldilocks effect: Human infants allocate attention to visual sequences that are neither too simple nor too complex. PLoS ONE, 7, e36399.CrossRefGoogle ScholarPubMed
Kulkarni, T. D., Narasimhan, K., Saeedi, A., & Tenenbaum, J. (2016). Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. In Jordan, M. I., LeCun, Y., & Solla, S. A. (eds.), Advances in Neural Information Processing Systems (pp. 36753683). Cambridge, MA: MIT Press.Google Scholar
Lapeyre, M., N’Guyen, S., Le Falher, A., & Oudeyer, P. Y. (2014). Rapid morphological exploration with the Poppy humanoid platform. 2014 IEEE-RAS International Conference on Humanoid Robots (pp. 959966). IEEE. November 18–20, 2014, Madrid, Spain.Google Scholar
Lehman, J., & Stanley, K. O. (2011). Abandoning objectives: Evolution through the search for novelty alone. Evolutionary Computation, 19, 189223.Google Scholar
Liyanagunawardena, T. R., Adams, A. A., & Williams, S. A. (2013). MOOCs: A systematic study of the published literature 2008-2012. The International Review of Research in Open and Distributed Learning, 14, 202227.Google Scholar
Lopes, M., Lang, T., Toussaint, M., & Oudeyer, P.-Y. (2012). Exploration in model-based reinforcement learning by empirically estimating learning progress. Neural Information Processing Systems (NIPS 2012). December 3–8, 2012, Tahoe, USA.Google Scholar
Lopes, M., & Oudeyer, P. Y. (2012). The strategic student approach for life-long exploration and learning. 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL) (pp. 1–8). IEEE. November 7–9, 2012, San Diego, CA.Google Scholar
Lowenstein, G. (1994). The psychology of curiosity: A review and reinterpretation. Psychological Bulletin, 116, 7598.Google Scholar
Malone, T. W. (1980). What makes things fun to learn? A study of intrinsically motivating computer games. Technical report. Xerox Palo Alto Research Center, Palo Alto, CA.Google Scholar
Merrick, K. E., & Maher, M. L. (2009). Motivated Reinforcement Learning: Curious Characters for Multiuser Games. Berlin: Springer Science & Business Media.Google Scholar
Montessori, M. (1948/2004). The Discovery of the Child. New Delhi: Aakar Books.Google Scholar
Montgomery, K. (1954). The role of exploratory drive in learning. Journal of Comparative and Physiological Psychology, 47, 6064.Google Scholar
Moulin-Frier, C., Nguyen, M., & Oudeyer, P.-Y. (2014). Self organization of early vocal development in infants and machines: The role of intrinsic motivation. Frontiers in Cognitive Science, 4, 1006.Google Scholar
Nguyen, M., & Oudeyer, P.-Y. (2013). Active choice of teachers, learning strategies and goals for a socially guided intrinsic motivation learner. Paladyn, Journal of Behavioural Robotics, 3, 136146.CrossRefGoogle Scholar
Nkambou, R., Mizoguchi, R., & Bourdeay, J. (2010). Advances in Intelligent Tutoring Systems (Vol. 308). Berlin: Springer.CrossRefGoogle Scholar
Oller, D. K. (2000). The Emergence of the Speech Capacity. Mahwah, NJ: Lawrence Erlbaum and Associates, Inc.Google Scholar
Oudeyer, P.-Y. (2011). Developmental Robotics, Encyclopedia of the Sciences of Learning, ed. Seel, N. M.. Springer Reference Series. Berlin: Springer.Google Scholar
Oudeyer, P.-Y., Gottlieb, J., & Lopes, M. (2016). Intrinsic motivation, curiosity, and learning: Theory and applications in educational technologies. In Waxman, S., Stein, D. G., Swaab, D., & Fields, H. (eds.), Progress in Brain Research (Vol. 229, pp. 257284). Amsterdam: Elsevier.Google Scholar
Oudeyer, P.-Y., & Kaplan, F. (2006). Discovering communication. Connection Science, 18, 189206.CrossRefGoogle Scholar
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. (2007). Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation, 11, 265286.Google Scholar
Oudeyer, P.-Y., & Smith, L. (2016). How evolution can work through curiosity-driven developmental process, Topics in Cognitive Science, 8, 492502.Google Scholar
Pachet, F. (2004). On the design of a musical flow machine. In Tokoro, M., & Steels, L. (eds.), A Learning Zone of One’s Own (pp. 111134). Amsterdam: IOS Press.Google Scholar
Papert, S. (1980). Mindstorms: Children, Computers, and Powerful Ideas. New York: Basic Books, Inc.Google Scholar
Piaget, J. (1952) The Origins of Intelligence in Children. New York: International University Press.Google Scholar
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., & Kafai, Y. (2009). Scratch: Programming for all. Communications of the ACM, 52, 6067.Google Scholar
Roy, D., Gerber, G., Magnenat, S., Riedo, F., Chevalier, M., Oudeyer, P. Y., & Mondada, F. (2015). IniRobot: A pedagogical kit to initiate children to concepts of robotics and computer science. Proceedings of the RIE 2015. May 20–22, 2015, Yverdon les bains, Switzerland.Google Scholar
Ryan, R., & Deci, E. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25, 5467.Google Scholar
Schmidhuber, J. (1991). Curious model-building control systems. IEEE International Joint Conference on Neural Networks (pp. 14581463). 18-November 21, 1991, Singapore.Google Scholar
Singh, S., Barto, A. G., & Chentanez, N. (2004). Intrinsically motivated reinforcement learning. NIPS'04: Proceedings of the 17th International Conference on Neural Information Processing Systems (pp. 12811288). December 2004, Vancouver, BC, Canada.Google Scholar
Singh, S., Lewis, R. L., Barto, A. G., & Sorg, J. (2010). Intrinsically motivated reinforcement learning: An evolutionary perspective. IEEE Transactions on Autonomous Mental Development, 2, 7082.CrossRefGoogle Scholar
Smith, L. B. (2013). It’s all connected: Pathways in visual object recognition and early noun learning. American Psychologist, 68, 618.CrossRefGoogle ScholarPubMed
Smith, L. B., & Breazeal, C. (2007). The dynamic lift of developmental process. Developmental Science, 10, 6168.Google Scholar
Stahl, A. E., & Feigenson, L. (2015). Observing the unexpected enhances infants’ learning and exploration. Science, 348, 9194.Google Scholar
Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., & Precup, D. (2011). Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2011) (Vol. 2, pp. 761768). May 2–6, 2011, Taipei, Taiwan.Google Scholar
Thelen, E. S., & Smith, L. B. (1996). Dynamic Systems Approach to the Development of Cognition and Action. Cambridge, MA: MIT Press.Google Scholar
Thomaz, A. L., & Breazeal, C. (2008) Experiments in socially guided exploration: Lessons learned in building robots that learn with and without human teachers. Connection Science, 20, 91110.Google Scholar
Twomey, K. E., & Westermann, G. (2018). Curiosity‐based learning in infants: A neurocomputational approach. Developmental Science, 21, e12629.Google Scholar
West, M. J., & King, A. P. (1987). Settling nature and nurture into an ontogenetic niche. Developmental Psychobiology, 20, 549562.Google Scholar
White, R. (1959). Motivation reconsidered: The concept of competence. Psychological Review, 66, 297333.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×