Hostname: page-component-745bb68f8f-5r2nc Total loading time: 0 Render date: 2025-01-12T13:10:02.607Z Has data issue: false hasContentIssue false
  • English
  • Français

Vision, eye movements, and natural behavior

Published online by Cambridge University Press:  01 January 2009

MICHAEL F. LAND
MICHAEL F. LAND*
Affiliation:
Department of Biology and Environmental Science, University of Sussex, Brighton, UK
*
*Address correspondence and reprint requests to: Michael F. Land, Department of Biology and Environmental Science, University of Sussex, Brighton BN1 9QG, UK. E-mail: m.f.land@sussex.ac.uk
Get access Rights & Permissions [Opens in a new window]

Abstract

Historically, the principal function of vision has been to provide the information needed to support action. Visually mediated actions rely on three systems: the gaze system responsible for locating and fixating task-relevant objects, the motor system of the limbs to carry out the task, and the visual system to supply information to the other two. All three systems are under the control of a fourth system, the schema system, which specifies the current task and plans the overall sequence of actions. These four systems have separate but interconnected cortical representations. The way these systems interact in time and space is discussed here in relation to two studies of the gaze changes and manipulations made during two ordinary food preparation tasks. The main conclusions are that complex action sequences consist of a succession of individual object-related actions, each of which typically involve a turn toward the object (if needed), followed by fixation and finally manipulation monitored by vision. Gaze often moves on to the next object just before manipulation is complete. Task-irrelevant objects are hardly ever fixated, implying that the control of fixation comes principally from top-down instructions from the schema system, not bottom-up salience. Single fixations have identifiable functions (locating, directing, guiding, and checking) related to the action to be taken. Several variants of the basic object-related action scheme are discussed, including single-action events in ball sports involving only one anticipatory gaze shift, continuous production loops in text and music reading, and storage–action alternation in copying tasks such as portrait sketching.

Keywords

Gaze controlObject-related actionsExtended tasksSchemasAnticipatory saccades
Type
Natural Tasks
Information
Visual Neuroscience , Volume 26 , Issue 1 , January 2009 , pp. 51 - 62
Copyright
Copyright © Cambridge University Press 2009

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anstis, S.M. (1974). A chart demonstrating variations in acuity with retinal position. Vision Research 14, 589–592.CrossRefGoogle ScholarPubMed
Baddeley, A. (2007). Working Memory, Thought and Action. Oxford: Oxford University Press.CrossRefGoogle Scholar
Ballard, D.H., Hayhoe, M.M., Li, F. & Whitehead, S.D. (1992). Hand-eye coordination during sequential tasks. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 337, 331–339.Google ScholarPubMed
Ballard, D.H., Hayhoe, M.M. & Pelz, J.B. (1995). Memory representations in natural tasks. Journal of Cognitive Neuroscience 7, 66–80.CrossRefGoogle ScholarPubMed
Bargh, J.A. & Ferguson, M.J. (2000). Beyond behaviorism: On the automaticity of higher mental processes. Psychological Bulletin 126, 925–945.CrossRefGoogle ScholarPubMed
Buswell, G.T. (1920). An experimental study of the eye-voice span in reading. Supplementary Educational Monographs 17. University of Chicago Press.Google Scholar
Butsch, R.L.C. (1932). Eye movements and the eye-hand span in typewriting. Journal of Educational Psychology 23, 104–121.CrossRefGoogle Scholar
Droll, J.A., Hayhoe, M.M., Triesch, J. & Sullivan, B.T. (2005). Task demands control acquisition and storage of visual information. Journal of Experimental Psychology. Human Perception and Performance 31, 1416–1438.CrossRefGoogle ScholarPubMed
Einhäuser, W., Rutishauser, U. & Koch, C. (2008). Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. Journal of Vision 8(2): article 2, 1–19.CrossRefGoogle ScholarPubMed
Fleischer, A.G. (1986). Control of eye movements by working memory load. Biological Cybernetics 55, 227–238.CrossRefGoogle ScholarPubMed
Furneaux, S. & Land, M.F. (1999). The effects of skill on the eye-hand span during musical sight-reading. Proceedings of the Royal Society of London. Series B, Biological Sciences 266, 2453–2440.Google ScholarPubMed
Gilbert, S.J. & Burgess, P.W. (2008). Executive function. Current Biology 18, R110–R114.CrossRefGoogle ScholarPubMed
Hayhoe, M. (2000). Vision using routines: A functional account of vision. Visual Cognition 7, 43–64.CrossRefGoogle Scholar
Hayhoe, M., Mennie, N., Sullivan, B. & Gorgos, K. (2005). The role of internal models and prediction in catching balls. Proceedings of the American Association Artificial Intelligence (Fall).Google Scholar
Hayhoe, M.M., Shrivastava, A., Mruczek, R. & Pelz, J.B. (2003). Visual memory and motor planning in a natural task. Journal of Vision 3, 49–63.CrossRefGoogle Scholar
Itti, L. & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40, 1489–1506.CrossRefGoogle ScholarPubMed
Jeannerod, M. (1997). The Cognitive Neuroscience of Action. Oxford: Blackwell.Google Scholar
Johansson, R.S., Westling, G., Bäckström, A. & Flanagan, J.R. (2001). Eye-hand coordination in object manipulation. Journal of Neuroscience 21, 6917–6932.CrossRefGoogle ScholarPubMed
Land, M.F. (2003). Eye movements in daily life. In The Visual Neurosciences, ed. Chalupa, L.M. & Werner, J.S., pp. 1357–1368. Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Land, M.F. (2006). Eye movements and the control of actions in everyday life. Progress in Retinal and Eye Research 25, 296–324.CrossRefGoogle ScholarPubMed
Land, M.F. & Furneaux, S. (1997). The knowledge base of the oculomotor system. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 352, 1231–1239.CrossRefGoogle ScholarPubMed
Land, M.F. & Hayhoe, M. (2001). In what ways do eye movements contribute to everyday activities. Vision Research 41, 3559–3565.CrossRefGoogle ScholarPubMed
Land, M.F. & Lee, D.N. (1994). Where we look when we steer. Nature 369, 742–744.CrossRefGoogle ScholarPubMed
Land, M.F. & McLeod, P. (2000). From eye movements to actions: How batsmen hit the ball. Nature Neuroscience 3, 1340–1345.CrossRefGoogle ScholarPubMed
Land, M.F., Mennie, N. & Rusted, J. (1999). The roles of vision and eye movements in the control of activities of daily living. Perception 28, 1311–1328.CrossRefGoogle ScholarPubMed
McKinney, T., Chajka, K. & Hayhoe, M. (2008). Pro-active gaze control in squash. Journal of Vision 8(6): article 111, 111a.CrossRefGoogle Scholar
Mennie, N., Hayhoe, M. & Sullivan, B. (2007). Look-ahead fixations: Anticipatory eye movements in natural tasks. Experimental Brain Research 179, 427–442.CrossRefGoogle ScholarPubMed
Miller, E.K. & Cohen, J.D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience 24, 167–202.CrossRefGoogle ScholarPubMed
Norman, D.A. & Shallice, T. (1986). Attention to action: Willed and automatic control of behavior. In Consciousness and Self Regulation. Advances in Research and Theory, Vol. 4, ed. Davidson, R.J., Schwarts, G.E. & Shapiro, D., pp. 1–18. New York, NY: Plenum.Google Scholar
Patla, A.E. & Vickers, J.N. (2003). OHow far ahead do we look when required to step on specific locations in the travel path during locomotion. Exp. Brain Res. 148, 133–138.CrossRefGoogle Scholar
Pelz, J.B. & Canoza, R. (2001). Oculomotor behavior and perceptual categories in complex tasks. Vision Research 41, 3587–3596.CrossRefGoogle Scholar
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 372–422.CrossRefGoogle ScholarPubMed
Regan, D. (1992). Visual judgments and misjudgments in cricket, and the art of flight. Perception 21, 91–115.CrossRefGoogle Scholar
Ripoll, H., Fleurance, P. & Caseneuve, D. (1987). Analysis of visual patterns of table tennis players. In Eye Movements: From Physiology to Cognition, ed. O’Regan, J.K. & Levy-Schoen, A., pp. 616–617. Amsterdam, The Netherlands: North-Holland.CrossRefGoogle Scholar
Rizzolatti, G. & Luppino, G. (2001). The cortical motor system. Neuron 31, 889–901.CrossRefGoogle ScholarPubMed
Rothkopf, C., Ballard, D. & Hayhoe, M. (2007). Task and scene context determine where you look. Journal of Vision 7(14): article 16, 1–20.Google Scholar
Sailer, U., Flanagan, J.R. & Johansson, R.S. (2005). Eye-hand coordination during learning of a novel visuomotor task. Journal of Neuroscience 25, 8833–8842.CrossRefGoogle ScholarPubMed
Salvucci, D.D. & Gray, R. (2004). A two-point control model of steering. Perception 33, 1233–1248.CrossRefGoogle ScholarPubMed
Schwartz, M.F., Reed, E.S., Montgomery, M.W., Palmer, C. & Mayer, N.H. (1991). The quantitative description of action disorganisation after brain damage: A case study. Cognitive Neuropsychology 8, 381–414.CrossRefGoogle Scholar
Shallice, T. & Burgess, P.W. (1996). Domains of supervisory control and the temporal organisation of behaviour. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 351, 1405–1412.Google Scholar
Tchalenko, J.S. (2007). Eye movements in drawing simple lines. Perception 36, 1152–1167.CrossRefGoogle ScholarPubMed
Triesch, J., Ballard, D.H., Hayhoe, M.M. & Sullivan, B.T. (2003). What you see is what you need. Journal of Vision 3, 86–94.CrossRefGoogle ScholarPubMed
Wann, J.P. & Wilkie, R.M. (2004). How do we control high speed steering. In Optic Flow and Beyond, ed. Vaina, L.M., Beardsley, S.A. & Rushton, S.K., pp. 371–389. Dordrecht, The Netherlands: Kluwer Academic Publishers.Google Scholar
Weaver, H.E. (1943). A study of visual processes in reading differently constructed musical selections. Psychological Monographs 55, 1–30.Google Scholar
Wright, R.D. & Ward, L.M. (2008). Orienting of Attention. Oxford: Oxford University Press.CrossRefGoogle Scholar
Yarbus, A. (1967). Eye Movements and Vision. New York: Plenum Press.CrossRefGoogle Scholar