article

Free access

Supporting cognitive models as users

Authors:

Frank E. Ritter,

Gordon D. Baxter,

Richard M. YoungAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 7, Issue 2

Pages 141 - 173

https://doi.org/10.1145/353485.353486

Published: 01 June 2000 Publication History

Abstract

Cognitive models are computer programs that simulate human performance of cognitive skills. They have been useful to HCI by predicting task times, by assisting users, and by acting as surrogate users. If cognitive models could interact with the same interfaces that users do, the models would be easier to develop and would be easier to apply as interface testers. This approach can be encapsulated as a cognitive model interface management system (CMIMS), which is analogous to and based on a user interface management system (UIMS). We present five case studies using three different UIMSes. These show how models can interact with interfaces using an interaction mechanism that is designed to apply to all interfaces generated within a UIMS. These interaction mechanisms start to support and constrain performance in the same ways that human performance is supported and constrained by interaction. Most existing UIMSes can and should be extended to create CMIMSes, and models can and should use CMIMSes to look at larger and more complex tasks. CMIMSes will help to further exploit the synergy between the disciplines of cognitive modeling and HCI by supporting cognitive models as users.

References

[1]

AASMAN, J. AND MICHON, J.A. 1992. Multitasking in driving. In Soar: A Cognitive Architecture in Perspective, J. A. Michon and A. Aky rek, Eds. Kluwer Academic, Dordrecht, Netherlands.

[2]

ALTMANN, E. M. 1996. Episodic memory for external information. Ph.D. thesis, Tech. Rep. CMU-CS-96-167. Computer Science Department, Carnegie Mellon University, Pittsburgh, PA.

[3]

ANDERSON, J. R. AND LEBmRE, C. 1998. The Atomic Components of Thought. Lawrence Erlbaum Associates, Inc., Mahwah, NJ.

[4]

ANDERSON, J. R., CORBETT, A. T., KOEDINGER, K. R., AND PELLETIER, R. 1995. Cognitive tutors: Lessons learned. J. Learn. Sci. 4, 2, 167-207.

[5]

BASS, E. J., BAXTER, G. D., AND RITTER, F. E. 1995. Creating cognitive models to control simulations of complex systems. AI Simul. Behav. Q. 93, 18-25.

[6]

BAUER, M. I. AND JOHN, B. E. 1995. Modeling time-constrained learning in a highly interactive task. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '95, Denver, CO, May 7-11), I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. ACM Press/Addison-Wesley Publ. Co., New York, NY, 19-26.

Digital Library

[7]

BAXTER, G. D. AND RITTER, F. E. 1996. Designing abstract visual perceptual and motor action capabilities for use by cognitive models. Tech. Rep. 36, ESRC CREDIT. Department of Psychology, University of Nottingham.

[8]

BAXTER, G. D. AND RITTER, F. E. 1997. Model-computer interaction: Implementing the action-preception loop for cognitive models. In Proceedings of the 1st International Conference on Engineering Psychology and Cognitive Ergonomics, Vol. 2, D. Harris, Ed. Ashgate Publishing Company, Brookfield, VT, 215-223.

[9]

BEAMAN, C. P. AND MORTON, J. 1998. Modelling memory-updating characteristics of 3- and 4-year olds. In Proceedings of the 2nd European Conference on Cognitive Modelling, Nottinghmam University Press, Nottingham, UK, 30-35.

[10]

BUSETTA, P., R NNQUIST, R., HODGSON, A., AND LUCAS, A. 1999. JACK intelligent agentscomponents for intelligent agents in JAVA. AgentLink News Lett. 2 (Jan.). Available at http://www, agent-software, com/white-paper.pdf.

[11]

BYRNE, M. D. 1999. ACT-R perceptual-motor (ACT-R/PM) version 1.0b.5: A users manual. Psychology Department, Rice University, Houston, TX.

[12]

BRYNE, M. D. AND ANDERSON, J. R. 1998. Perception and action. In The Atomic Components of Thought, J. R. Anderson and C. Lebiere Lawrence Erlbaum Associates, Inc., Mahwah, NJ.

[13]

BYRNE, M. D. AND ANDERSON, J. R. 1999. Serial modules in parallel: The psychological refractory period and perfect time-sharing. Submitted for publication.

[14]

BYRNE, M. D., WOOD, S. D., FOLEY, J. D., KIERAS, D. E., AND SUKAVmIYA, P. N. 1994. Automating interface evaluation. In Proceedings of the ACM Conference on Human Factors in Computing Systems: "Celebrating Interdependence" (CHI '94, Boston, MA, Apr. 24-28), ACM Press, New York, NY, 232-237.

Digital Library

[15]

CARD, S. K., MORAN, T. P., AND NEWELL, A. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates Inc., Hillsdale, NJ.

Digital Library

[16]

CHAPMAN, T., RITTER, F. E., AND BAUMANN, M. 1996. Electronic warfare task manual. Working Paper WP-R3BAIA005/013, Cognitive Modeling Unit. Department of Psychology, University of Nottingham.

[17]

CHONG, R. S. AND LAmD, J. E. 1997. Identifying dual-task executive process knowledge using EPIC-Soar. In Proceedings of the 19th Annual Conference of the Cognitive Science Society, Lawrence Erlbaum Associates Inc., Hillsdale, NJ, 107-112.

[18]

CORKER, K. M. AND SMITH, B. R. 1993. An architecture and model for cognitive engineering simulation simulation analysis: Application to advanced aviation automation. In Proceedings of the AAIA Computing in Aerospace 9 Conference, American Association for Information Architects.

[19]

FREED, M. AND REMINGTON, a. 1998. A conceptual framework for predicting error in complex human-machine environments. In Proceedings of the 20th Annual Conference of the Cognitive Science Society, M. A. Gernsbacker and S. J. Derry, Eds. 356-361.

[20]

GRAY, W., Ed. 1999. Proceedings of the ACT-R Workshop. Human Factors and Applied Cognition. George Mason University, Fairfax, VA. Available at http://hfac.gmu.edu/actr99/.

[21]

GRAY, W. D. 2000. The nature of processing and errors in interactive behavior. Cogn. Sci. 24. To be published.

[22]

GRAY, W. D., JOHN, B. E., AND ATWOOD, M. E. 1993. Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world performance. Human-Comput. Interact. 8, 3, 237-309.

Digital Library

[23]

GRAY, W. D., SCHOELLES, M., AND FU, W.-T. 1998. When milliseconds matter: Implementing microstrategies in ACT-R/PM. In Proceedings of the 5th ACT-R Workshop, Carnegie Mellon University, Pittsburgh, PA.

[24]

HARRIS, B. 1999. PracTCL: An application for routinely tying cognitive models to interfaces to create interactive cognitive user models. Department of Psychology, University of Nottingham. Bachelor's of Science thesis.

[25]

HOROWITZ, T. S. AND WOLFE, J. M. 1998. Visual search has no memory. Nature 357, 575-577.

[26]

HOWES, A. AND YOUNG, a. M. 1996. Learning consistent, interactive, and meaningful task-action mappings: A computational modelYoun. Cogn. Sci. 20, 3, 301-356.

[27]

JOHN, B. E. 1998. Cognitive modeling in human-computer interaction. In Proceedings of Graphics Interface '98, 161-167.

[28]

JOHN, B. E. AND KIERAS, D. E. 1996. Using GOMS for user interface design and evaluation: which technique?. ACM Trans. Comput. Hum. Interact. 3, 4, 287-319.

Digital Library

[29]

JOHN, B. E., VERA, A. H., AND NEWELL, A. 1994. Towards real-time GOMS: A model of expert behavior in a highly interactive task. Behav. Inf. Tech. 13, 255-267.

[30]

JONES, G. 1999. Testing mechanisms of development within a computational framework. Ph.D. Dissertation. University of Nottingham, Nottingham, UK.

[31]

JONES, G. AND RITTER, F. E. 1998. Initial explorations of simulating cognitive and perceptual development by modifying architectures. In Proceedings of the 20th Annual Conference of the Cognitive Science Society, M. A. Gernsbacker and S. J. Derry, Eds. 543-548.

[32]

JONES, G., RITTER, F. E., AND WOOD, D. J. 2000. Using a cognitive architecture to examine what develops. Psychological Science 11, 2, 1-8.

[33]

JONES, R. M., LAmD, J. E., NIELSEN, P. E., COULTER, K. J., KENNY, P., AND KOSS, F. V. 1999. Automated intelligent pilots for combat flight simulation. AI Mag. 20, 1, 27-41.

Digital Library

[34]

KmRAS, D. E. 1997. A guide to GOMS model usability evaluation using NGOMSL. In Handbook of Human-Computer Interaction, M. G. Helander, T. K. Landauer, and V. Prabhu, Eds. Elsevier Science Publishers Ltd., Essex, UK, 391-438.

[35]

KIERAS, D. E. AND MEYER, D. E. 1997. An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Comput. Interact. 12, 391-438.

Digital Library

[36]

KmRAS, D. E., WOOD, S. D., AND MEYER, D. E. 1997. Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task. ACM Trans. Comput. Hum. Interact. 4, 3, 230-275.

Digital Library

[37]

LAmD, J. E., NEWELL, A., AND ROSENBLOOM, P. S. 1987. SOAR: an architecture for general intelligence. Artif. Intell. 33, I (Sept. 1987), 1-64.

Digital Library

[38]

LOHSE, G. L. 1997. Models of graphical perception. In Handbook of Human-Computer Interaction, M. G. Helander, T. K. Landauer, and V. Prabhu, Eds. Elsevier Science Publishers Ltd., Essex, UK, 107-135.

[39]

LONSDALE, P. R. 1999. Extending PracTCL to provide a more functional eye and hand for the Soar cognitive modelling architecture. Department of Psychology, University of Nottingham. Master's of Science thesis.

[40]

MYERS, B.A. 1995. User interface software tools. ACM Trans. Comput. Hum. Interact. 2, 1 (Mar. 1995), 64-103.

Digital Library

[41]

MYERS, B. A., GIUSE, D. A., DANNENBERC-, R. B., KOSBIE, D. S., PERVIN, E., MICKISH, A., ZANDEN, B. V., AND MARCHAL, P. 1990. Garnet: Comprehensive support for graphical, highly interactive user interfaces. IEEE Computer 23, 11 (Nov. 1990), 71-85.

Digital Library

[42]

NEISSER, U. 1976. Cognition and Reality. W. H. Freeman and Co., New York, NY.

[43]

NEWELL, A. 1990. Unified Theories of Cognition. Harvard University Press, Cambridge, MA.

Digital Library

[44]

NEWELL, A. AND SIMON, H.A. 1972. Human Problem Solving. Prentice-Hall, Englewood Cliffs, NJ.

Digital Library

[45]

OLSEN, D. R., JR., FOLEY, J., HUDSON, S., MILLER, J., AND MYERS, B. 1993. Research directions for user interface software tools. Behav. Inf. Tech. 12, 2, 80-97.

[46]

ONG, R. 1994. Mechanisms for routinely tying cognitive models to interactive simulations. Tech. Rep. 21. University of Nottingham, Nottingham, UK. Available as ftp://ftp.nottingham .ac. uk/pub/lp z fr/mongsu-2.1, tar. Z.

[47]

OPEN UNIVERSITY. 1990. A Guide to Usability. Open University Press, Milton Keynes, UK. In association with the Department for Trade and Industry.

[48]

OUSTERHOU% J. K. 1994. Tcl and the Tk Toolkit. Addison-Wesley Professional Computing Series. Addison-Wesley Longman Publ. Co., Inc., Reading, MA.

Digital Library

[49]

PECK, V. A. AND JOHN, B. E. 1992. Browser-Soar: a computational model of a highly interactive task. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '92, Monterey, CA, May 3-7), P. Bauersfeld, J. Bennett, and G. Lynch, Eds. ACM Press, New York, NY, 165-172.

Digital Library

[50]

PEW, R. W. AND MAVOR, A. S., Eds. 1998. Modeling Human and Organizations Behavior: Application to Military Simulations. National Academy Press, Washington, DC. http ://books.nap. edu/catalog/6173.html.

[51]

PYLYSHYN, Z. 1999. Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. Behav. Brain Sci. 22, 3, 341-365.

[52]

RAMSAY, A. F. 1995. OOPSDG modelling environment for the centre for human sciences. Rep. DRA/CIS/(SS5)/1026/9/2. DRA Portsdown.

[53]

RASSOULI, J. 1995. Steps towards a process model of mouse-based interaction. Department of Psychology, University of Nottingham. Master's of Science thesis.

[54]

RmMAN, J., YOUNG, R. M., AND HOWES, A. 1996. A dual-space model of iteratively deepening exploratory learning. Int. J. Hum.-Comput. Stud. 44, 6, 743-775.

Digital Library

[55]

RITTER, F. E. AND LARKIN, J. H. 1994. Using process models to summarize sequences of human actions. Hum. Comput. Interact. 9, 3, 345-383.

Digital Library

[56]

RITTER, F. E. AND MAJOR, N. P. 1995. Useful mechanisms for developing simulations for cognitive models. AI Simul. Behav. Q. 91 (Spring), 7-18.

[57]

RITTER, F. E., JONES, R. M., AND BAXTER, G. D. 1998. Reusable models and graphics interfaces: Realising the potential of a unified theory of cognition. In Mind Modeling--A Cognitive Science Approach to Reasoning, Learning and Discovery, U. Schmid, J. Krems, and F. Wysotzki, Eds. Pabst Scientific Publishing, Lengerich, Germany, 83-109.

[58]

RITTER, F. E., NERB, J., AND KINDSM LLER, M. 1994. Steps towards a series of models for a developmental task. In Proceedings of the EuroSoar 8 Workshop, K. Hurts and K. van Putten, Eds. University of Leiden, Leiden, 95-99.

[59]

SEARS, A. 1993. Layout appropriateness: A metric for evaluating user interface widget layouts. IEEE Trans. Softw. Eng. 19, 7 (July), 707-719.

Digital Library

[60]

SHERmLL-LUmNSKI CORPORATION. 1994. SL-GMS Technical Overview. Sherrill-Lubinski Corporation, Corte Madera, CA.

[61]

SZEKELY, P., Luo, P., AND NECHES, R. 1993. Beyond interface builders: Model-based interface tools. In Proceedings of the ACM Conference on Human Factors in Computing (INTERCHI '93, Amsterdam, The Netherlands, Apr. 24-29), S. Ashlund, A. Henderson, E. Hollnagel, K. Mullet, and T. White, Eds. ACM Press, New York, NY, 383-390.

Digital Library

[62]

T~TGEN, N.A. 1998. Explicit learning in ACT-R. In Mind Modeling--A Cognitive Science Approach to Reasoning, Learning and Discovery, U. Schmid, J. Krems, and F. Wysotzki, Eds. Pabst Scientific Publishing, Lengerich, Germany, 233-252.

[63]

VERA, A. H., LEWIS, R. L., AND LERCH, F.J. 1993. Situated decision-making and recognitionbased learning: Applying symbolic theories to interactive tasks. In Proceedings of the 15th Annual Conference of the Cognitive Science Society, Lawrence Erlbaum Associates Inc., Hillsdale, NJ, 84-95.

[64]

WOOD, D. AND MIDDLETON, D. 1975. A study of assisted problem solving. Br. J. Psychol. 66, 2, 181-191.

[65]

ZETTLEMOYER, L. S. AND ST. AMANT, R. 1999. A visual medium for programmatic control of interacive applications. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '99, Pittsburgh, PA, May), ACM Press, New York, NY, 199-206.

Digital Library

Cited By

Tehranchi FBagherzadeh ARitter F(2024)A user model to directly compare two unmodified interfaces: a study of including errors and error corrections in a cognitive user modelArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042300015X37Online publication date: 2-Jan-2024
https://doi.org/10.1017/S089006042300015X
Fisher CMorris MStevens CSwan G(2024)The role of individual differences in human-automated vehicle interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103225185:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103225
Heine C(2021)Towards Modeling Visualization Processes as Dynamic Bayesian NetworksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303039527:2(1000-1010)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030395
Show More Cited By

Index Terms

Supporting cognitive models as users

Recommendations

Human-computer interaction: introduction and overview
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing Systems

The objective of this special introductory seminar is to provide newcomers to Human-Computer Interaction (HCI) with an introduction and overview of the field. The material will begin with a brief history of the field, followed by presentation and ...
Human-computer interaction: introduction and overview
CHI EA '97: CHI '97 Extended Abstracts on Human Factors in Computing Systems

The objective of this special introductory seminar is to provide newcomers to Human-Computer Interaction (HCI) with an introduction and overview of the field. The material will begin with a brief history of the field, followed by presentation and ...
The GOMS SIG: troubleshooting, lessons learned, novel applications, teaching techniques & future research
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing Systems

GOMS is many things to many people, It is the only validated analytic usability evaluation method (UEM) in the field of human-computer interaction. It is being used by practitioners at some of the world's largest and some of the smallest software ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 7, Issue 2

Special issue on human-computer interaction in the new millennium, Part 2

June 2000

140 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/353485

Editor:
Jonathan Grudin
Microsoft Research

Issue’s Table of Contents

Copyright © 2000 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2000

Published in TOCHI Volume 7, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
3,125
Total Downloads

Downloads (Last 12 months)164
Downloads (Last 6 weeks)37

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tehranchi FBagherzadeh ARitter F(2024)A user model to directly compare two unmodified interfaces: a study of including errors and error corrections in a cognitive user modelArtificial Intelligence for Engineering Design, Analysis and Manufacturing10.1017/S089006042300015X37Online publication date: 2-Jan-2024
https://doi.org/10.1017/S089006042300015X
Fisher CMorris MStevens CSwan G(2024)The role of individual differences in human-automated vehicle interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103225185:COnline publication date: 25-Jun-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103225
Heine C(2021)Towards Modeling Visualization Processes as Dynamic Bayesian NetworksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303039527:2(1000-1010)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030395
Miraz MAli MExcell P(2021)Adaptive user interfaces and universal usability through plasticity of user interface designComputer Science Review10.1016/j.cosrev.2021.10036340:COnline publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.cosrev.2021.100363
Pitikoe SBiswalo P(2021)Logged In or Locked Out of the Twenty-First Century? Implications for Adult Learners with Special NeedsDigital Literacy and Socio-Cultural Acceptance of ICT in Developing Countries10.1007/978-3-030-61089-0_12(199-210)Online publication date: 1-Jun-2021
https://doi.org/10.1007/978-3-030-61089-0_12
Venkata Achyuth Rao SKumar SAcharyulu G(2021)Cognitive Behavior: Different Human‐Computer Interaction TypesCognitive Behavior and Human Computer Interaction Based on Machine Learning Algorithm10.1002/9781119792109.ch1(1-22)Online publication date: 26-Nov-2021
https://doi.org/10.1002/9781119792109.ch1
Ritter FTehranchi FDancy CKase S(2020)Some futures for cognitive modeling and architectures: design patterns for including better interaction with the world, moderators, and improved model to data fits (and so can you)Computational & Mathematical Organization Theory10.1007/s10588-020-09308-726:3(278-306)Online publication date: 1-Sep-2020
https://dl.acm.org/doi/10.1007/s10588-020-09308-7
Yuan HLi SRusconi PYuan HLi SRusconi P(2020)Cognitive Approaches to Human Computer InteractionCognitive Modeling for Automated Human Performance Evaluation at Scale10.1007/978-3-030-45704-4_2(5-15)Online publication date: 17-Sep-2020
https://doi.org/10.1007/978-3-030-45704-4_2
Rehman UCao SMacGregor C(2019)Using an Integrated Cognitive Architecture to Model the Effect of Environmental Complexity on Drivers’ Situation AwarenessProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131963131363:1(812-816)Online publication date: 20-Nov-2019
https://doi.org/10.1177/1071181319631313
Martínez-García MZhang YGordon T(2019)Memory Pattern Identification for Feedback Tracking Control in Human–Machine SystemsHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/001872081988100863:2(210-226)Online publication date: 24-Oct-2019
https://doi.org/10.1177/0018720819881008
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents