Abstract
Scientists from many different disciplines (including physiology, psychology, and engineering) have worked on modelling visual perception. However this field has been less extensively studied in the context of computer science, as most existing perception models work only for very specific domains such as menu searching or icon searching tasks. We are developing a perception model that works for any application. It takes a list of mouse events, a sequence of bitmap images of an interface and locations of different objects in the interface as input, and produces a sequence of eye-movements as output. We have identified a set of features to differentiate among different screen objects and using those features, our model has reproduced the results of previous experiments on visual perception in the context of HCI. It can also simulate the effects of different visual impairments on interaction. In this paper we discuss the design, implementation and two pilot studies to demonstrate the model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anderson, J.R., Lebiere, C.: The Atomic Components of Thought. Erlbaum, Hillsdale (1998)
Biswas, P., Robinson, P.: Automatic Evaluation of Assistive Interfaces. In: Proc. of the ACM Intl. Conf. on Intelligent User Interfaces (IUI), pp. 247–256 (2008)
Biswas, P., Robinson, P.: Simulation to Predict Performance of Assistive Interfaces. In: Proc. of the 9th Intl. ACM SIGACCESS Conf. on Computers & Accessibility (ASSETS 2007), pp. 827–828 (2007)
Byrne, M.D.: ACT-R/PM & Menu Selection: Applying A Cognitive Architecture To HCI. International Journal of Human Computer Studies 55 (2001)
Card, S., Moran, T., Newell, A.: The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates, Hillsdale (1983)
Fleetwood, M.F., Byrne, M.D.: Modeling icon search in ACT-R/PM. Cognitive Systems Research 3(1), 25–33 (2002)
Fleetwood, M.F., Byrne, M.D.: Modeling the Visual Search of Displays: A Revised ACT-R Model of Icon Search Based on Eye-Tracking Data. Human-Computer Interaction 21(2), 153–197 (2006)
Hampson, P., Moris, P.: Understanding Cognition. Blackwell Publishers Ltd, Oxford (1996)
Hornof, A. J. & Kieras, D. E., Cognitive Modeling Reveals Menu Search Is Both Random & Systematic. In: Proc. of the ACM/SIGCHI Conference on Human Factors in Computing Systems, pp. 107–115 (1997)
Itti, L., Koch, C.: Computational Modelling of Visual Attention. Nature Reviews, Neuroscience 2, 1–10 (2001)
Kieras, D., Meyer, D.E.: An Overview of The EPIC Architecture For Cognition & Performance With Application To Human-Computer Interaction. Human-Computer Interaction 14, 391–438 (1990)
Luck, S.J., et al.: Neural Mechanisms of Spatial Selective Attention In Areas V1, V2, & V4 of Macaque Visual Cortex. Journal of Neurophysiology 77, 24–42 (1997)
Marr, D.C.: Visual Information Processing: the structure & creation of visual representations. Philoso-phical Transactions of the Royal Society of London B 290, 199–218
Neisser, U.: Cognition & Reality. Freeman, San Francisco (1976)
Nilsen, E.L.: Perceptual-motor Control in Human-Computer Interaction (Technical Report No. 37), Ann Arbor, MI: The Cognitive Science & Machine Intelligence Laboratory, the Univ. of Michigan
Nixon, M., Aguado, A.: Feature Extraction & Image Processing, 1st edn. Elsevier, Oxford (2002)
Reynolds, J.H., Desimone, R.: The Role of Neural Mechanisms of Attention In Solving The Binding Problem. Neuron 24, 19–29, 111–145 (1999)
Rosandich, R.G.: Intelligent Visual Inspection using artificial neural networks, 1st edn. Chapman & Hall, London (1997)
Salvucci, D.D.: An integrated model of eye movements & visual encoding, Cognitive Systems Research (January 2001)
Shah, K., et al.: Connecting a Cognitive Model to Dynamic Gaming Environments: Architectural & Image Processing Issues. In: Proc. of the 5th Intl. Conf. on Cognitive Modeling, pp. 189–194 (2003)
Belongie, S., Malik, J., Puzicha, J.: Shape Matching & Object Recognition Using Shape Contexts. IEEE Transactions on Pattern Analysis & Machine Intelligence 24(24), 509–521 (2002)
Inclusive Design Toolkit (accessed in March 27, 2008), http://www-edc.eng.cam.ac.uk/betterdesign/downloads/visualsim.html
Vision Simulator (Accessed in March 27, 2008), http://www.my-vision-simulator.com/
Visual Impairment Simulator (Accessed in February 27, 2008), http://cita.rehab.uiuc.edu/software/vis/index.php
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Biswas, P., Sezgin, T.M., Robinson, P. (2008). Perception Model for People with Visual Impairments. In: Sebillo, M., Vitiello, G., Schaefer, G. (eds) Visual Information Systems. Web-Based Visual Information Search and Management. VISUAL 2008. Lecture Notes in Computer Science, vol 5188. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85891-1_31
Download citation
DOI: https://doi.org/10.1007/978-3-540-85891-1_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-85890-4
Online ISBN: 978-3-540-85891-1
eBook Packages: Computer ScienceComputer Science (R0)