Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Widening the Evaluation Net

  • Conference paper
Intelligent Virtual Agents (IVA 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5773))

Included in the following conference series:

  • 2363 Accesses

Abstract

Intelligent Virtual Agent (IVA) systems are notoriously difficult to evaluate, particularly due to the subjectivity involved. From the various efforts to develop standard evaluation schemes for IVA systems the scheme proposed by Isbister & Doyle, which evaluates systems across five categories, seems particularly appropriate. To examine how these categories are being used, the evaluations presented in the proceedings of IVA ’07 and IVA ’08 are summarised and the extent to which the five categories in the Isbister & Doyle scheme are used is highlighted.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Similar content being viewed by others

References

  1. Isbister, K., Doyle, P.: Design and evaluation of embodied conversational agents: A proposed taxonomy. In: Proceedings of the 1st International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2002) -Conference Workshop: Embodied Conversational Agents -Let‘s Specify and Evaluate Them (2002)

    Google Scholar 

  2. Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.): IVA 2007. LNCS (LNAI), vol. 4722. Springer, Heidelberg (2007)

    Google Scholar 

  3. Prendinger, H., Lester, J., Ishizuka, M. (eds.): 8th International Conference on Intelligent Virtual Agents. LNCS (LNAI), vol. 5208. Springer, Heidelberg (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DIT AI Group, Dublin Institute of Technology, Dublin, Ireland

    Brian Mac Namee & Mark Dunne

Authors
  1. Brian Mac Namee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mark Dunne
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Human Media Interaction (HMI), University of Twente, EWI (Zilverling), P.O.Box 217, 7500, Enschede, AE, The Netherlands

    Zsófia Ruttkay

  2. Deutsches Forschungszentrum für künstliche Intelligenz (DFKI), Campus D3.2, 66123, Saarbrücken, Germany

    Michael Kipp

  3. Human Media Interaction Group,Dept. of Computer Science, University of Twente, P.O. Box 217, 7500, Enschede, AE, The Netherlands

    Anton Nijholt

  4. Center for Analysis and Design of Intelligent Agents, CADIA, School of Computer Science, Reykjavik University, Kringlan 1, 103, Reykjavik, Iceland

    Hannes Högni Vilhjálmsson

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mac Namee, B., Dunne, M. (2009). Widening the Evaluation Net. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds) Intelligent Virtual Agents. IVA 2009. Lecture Notes in Computer Science(), vol 5773. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04380-2_74

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04380-2_74

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04379-6

  • Online ISBN: 978-3-642-04380-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation