Skip to main content Accessibility help
×
Hostname: page-component-7479d7b7d-jwnkl Total loading time: 0 Render date: 2024-07-13T02:25:37.409Z Has data issue: false hasContentIssue false

8 - Autonomous visuomotor development for neuromorphic robots

from Part III - Brain-based robots: architectures and approaches

Published online by Cambridge University Press:  05 February 2012

Jeffrey L. Krichmar
Affiliation:
University of California, Irvine
Hiroaki Wagatsuma
Affiliation:
Kyushu Institute of Technology (KYUTECH), Japan
Get access

Summary

Introduction

It has been a huge challenge to program autonomous robots for unstructured and new environments. Various modules are difficult to program and so is the coordination among modules and motors. Existing neuroanatomical studies have suggested that the brain uses similar mechanisms to coordinate the different sensor modalities (e.g. visual and auditory) and the different motor modalities (e.g. arms, legs, and the vocal tract). Via sensorimotor interactions with the robot’s internal and external environments, autonomous mental development (AMD) in this chapter models the brain as not only an information processor (e.g. brain regions and their interconnections), but also the causality for its development (e.g. why each region does what it does). The mechanisms of AMD suggest that the function of each brain region is not preset statically before birth by the genome, but is instead the emergent consequence of its interconnections with other brain regions through the lifetime experience. The experience of interactions not only greatly shapes what each region does, but also how different regions cooperate. The latter seems harder to program than a static function. As a general-purpose model of sensorimotor systems, this chapter describes the developmental program for the visuomotor system of a developmental robot. Based on the brain-inspired mechanisms, the developmental program enables a network to wire itself and to adapt “on the fly” using bottom-up signals from sensors and top-down signals from externally supervised or self-supervised acting activities. These simple mechanisms are sufficient for the neuromorphic Where What Network 1 (WWN-1) to demonstrate small-scale but practical-grade performance for the two highly intertwined problems of vision – attention and recognition – in the presence of complex backgrounds.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aguirre, G. K.D’Esposito, M. 1997 Environmental knowledge is subserved by separable dorsal/ventral neural areasJournal of Neuroscience 17 2512CrossRefGoogle ScholarPubMed
Asada, M.Hosoda, K.Kuniyoshi, Y. 2009 Cognitive developmental robotics: a surveyIEEE Transactions on Autonomous Mental Development 1 12CrossRefGoogle Scholar
Backer, G.Mertsching, B.Bollmann, M. 2001 Data- and model-driven gaze control for an active-vision systemIEEE Transactions on Pattern Analysis and Machine Intelligence 23 1415CrossRefGoogle Scholar
Felleman, D. J.Van Essen, D. C. 1991 Distributed hierarchical processing in the primate cerebral cortexCerebral Cortex 1 1CrossRefGoogle ScholarPubMed
Hubel, D. H.Wiesel, T. N. 1959 Receptive fields of single neurons in the cat’s striate cortexJournal of Physiology 148 574CrossRefGoogle ScholarPubMed
Hubel, D. H.Wiesel, T. N. 1962 Receptive fields, binocular interaction and functional architecture in the cat’s visual cortexJournal of Physiology 160 107CrossRefGoogle ScholarPubMed
Itti, L.Koch, C.Niebur, E. 1998 A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence 20 1254CrossRefGoogle Scholar
Ji, Z.Weng, J. 2010
Ji, Z.Weng, J.Prokhorov, D. 2008
Koch, C.Ullman, S. 1985 Shifts in selective visual attention: towards the underlying neural circuitryHuman Neurobiology 4 219Google ScholarPubMed
Luciw, M.Weng, J. 2010
Lungarella, M.Metta, G.Pfeifer, R.Sandini, G. 2003 Developmental robotics: a surveyConnection Science 15 151CrossRefGoogle Scholar
Mishkin, M.Unterleider, L. G.Macko, K. A. 1983 Object vision and space vision: two cortical pathwaysTrends in Neuroscience 6 414CrossRefGoogle Scholar
Moghaddam, B.Pentland, A. 1995 (June). Maximum likelihood detection of faces and handsProceedings of the Workshop on Automatic Face- and Gesture-Recognition122Google Scholar
Mozer, M.Sitton, M. 1998 Pashler, H.AttentionLondonUCL Press341Google Scholar
Olshausen, B. A.Field, D. J. 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature 381 607CrossRefGoogle ScholarPubMed
Olshausen, B. AField, D. J. 1997 Sparse coding with an overcomplete basis set: a strategy used by V1?Vision Research 37 3311CrossRefGoogle Scholar
Olshausen, B. A.Anderson, C. H.Van Essen, D. C. 1993 A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of informationJournal of Neuroscience 13 4700CrossRefGoogle Scholar
Purves, W. K.Sadava, D.Orians, G. H.Heller, H. C. 2004 Life: The Science of BiologySunderland, MASinauerGoogle Scholar
Rao, R. P. N.Ballard, D. H. 2005 Itti, L.Rees, G.Tsotsos, J.Neurobiology of AttentionNew YorkAcademic PressGoogle Scholar
Schill, K.Umkehrer, E.Beinlich, S.Krieger, G.Zetzsche, C. 2001 Scene analysis with saccadic eye movements: top-down and bottom-up modelingJournal of Electronic Imaging 10 152CrossRefGoogle Scholar
Stark, L. W.Choi, Y. S. 1996 Zangemeister, W. H.Stiehl, H. S.Freska, C.Visual Attention and CognitionAmsterdamElsevier Science3CrossRefGoogle Scholar
Sur, M.Rubenstein, J. L. R. 2005 Patterning and plasticity of the cerebral cortexScience 310 805CrossRefGoogle ScholarPubMed
Tsotsos, J. K.Culhane, S. M.Wai, W. Y. K. 1995 Modeling visual attention via selective tuningArtificial Intelligence 78 507CrossRefGoogle Scholar
Viola, P.Jones, M. J. 2004 Robust real-time face detectionInternational Journal of Computer Vision 57 137CrossRefGoogle Scholar
Weng, J. 2004 Developmental robotics: theory and experimentsInternational Journal of Humanoid Robotics 1 199CrossRefGoogle Scholar
Weng, J. 2007 On developmental mental architecturesNeurocomputing 70 2303CrossRefGoogle Scholar
Weng, J. 2009 Task muddiness, intelligence metrics, and the necessity of autonomous mental developmentMinds and Machines 19 93CrossRefGoogle Scholar
Weng, J.Luciw, M. 2009 Dually optimal neuronal layers: lobe component analysisIEEE Transactions on Autonomous Mental Development 1 68CrossRefGoogle Scholar
Weng, J.Ahuja, N.Huang, T. S. 1997 Learning recognition and segmentation using the CresceptronInternational Journal of Computer Vision 25 109CrossRefGoogle Scholar
Weng, J.McClelland, J.Pentland, A. 2001 Autonomous mental development by robots and animalsScience 291 599CrossRefGoogle ScholarPubMed
Weng, J.Luwang, T.Lu, H.Xue, X. 2008 Multilayer in-place learning networks for modeling functional layers in the laminar cortexNeural Networks 21 150CrossRefGoogle ScholarPubMed
Yang, M.Kriegman, D. J.Ahuja, N. 2002 Detecting faces in images: a surveyIEEE Transactions on Pattern Analysis and Machine Intelligence 24 34CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×