Article

A PROMISE for experimental evaluation

Authors:

Giuseppe SantucciAuthors Info & Claims

CLEF'10: Proceedings of the 2010 international conference on Multilingual and multimodal information access evaluation: cross-language evaluation forum

Pages 140 - 144

Published: 20 September 2010 Publication History

Abstract

Participative Research laboratory for Multimedia and Multilingual Information Systems Evaluation (PROMISE) is a Network of Excellence, starting in conjunction with this first independent CLEF 2010 conference, and designed to support and develop the evaluation of multilingual and multimedia information access systems, largely through the activities taking place in Cross-Language Evaluation Forum (CLEF) today, and taking it forward in important new ways.

PROMISE is coordinated by the University of Padua, and comprises 10 partners: the Swedish Institute for Computer Science, the University of Amsterdam, Sapienza University of Rome, University of Applied Sciences of Western Switzerland, the Information Retrieval Facility, the Zurich University of Applied Sciences, the Humboldt University of Berlin, the Evaluation and Language Resources Distribution Agency, and the Centre for the Evaluation of Language Communication Technologies.

The single most important step forward for multilingual and multimedia information access which PROMISE will work towards is to provide an open evaluation infrastructure in order to support automation and collaboration in the evaluation process.

References

[1]

Agosti, M., Ferro, N.: Towards an Evaluation Infrastructure for DL Performance Evaluation. In: Tsakonas, G., Papatheodorou, C. (eds.) Evaluation of Digital Libraries: An insight into useful applications and methods, pp. 93-120. Chandos Publishing, Oxford (2009).

Google Scholar

[2]

Commission of the European Communities. Multilingualism: an asset for Europe and a shared commitment. COMM (2008) 566 Final (September 2008).

Google Scholar

[3]

Ferro, N.: CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum. In: Kando, N., Kishida, K. (eds.) Proc. 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering and Cross-Lingual Information Access, pp. 2-12. National Institute of Informatics, Tokyo (2010).

Google Scholar

[4]

Keim, D.A., Mansmann, F., Schneidewind, J., Ziegler, H.: Challenges in Visual Data Analysis. In: Banissi, E. (ed.) Proc. of the 10th International Conference on Information Visualization (IV 2006), pp. 9-16. IEEE Computer Society, Los Alamitos (2006).

Digital Library

Google Scholar

Cited By

View all

Agosti MBerendsen RBogers TBraschler MBuitelaar PChoukri KMaria Di Nunzio GFerro NForner PHanbury AHeppin KHansen PJärvelin ALarsen BLupu MMasiero IMüller HPeruzzo SPetras VPiroi Fde Rijke MSantucci GSilvello GToms E(2012)PROMISE retreat report prospects and opportunities for information access evaluationACM SIGIR Forum10.1145/2422256.242226546:2(60-84)Online publication date: 21-Dec-2012
https://dl.acm.org/doi/10.1145/2422256.2422265
Santucci G(2012)Visual analytics and information retrievalProceedings of the 2012 international conference on Information Retrieval Meets Information Visualization10.1007/978-3-642-36415-0_8(116-131)Online publication date: 23-Jan-2012
https://dl.acm.org/doi/10.1007/978-3-642-36415-0_8

Recommendations

Nouvelles applications du principe d'inversion dans le calcul analogique experimental

L'article rappelle une methode d'application du principe de l'inversion dans le procede analogique de representation de champs laplaciens sur cuves rheoelectriques permettant d'agrandir la partie la plus interessante du domaine etudie et de faire subir ...
Performance Evaluation of Cyclist’s Position Using a Depth Camera-Based Motion Capture System
Évaluation d'un Système pour le Résumé Automatique de Documents Électroniques
AI '01: Proceedings of the 14th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence

Cet article prÉsente une Évaluation de la fonction de rÉsumÉ du système Extractor. Quatre attributs de qualitÉ ont ÉtÉ considÉrÉs, soit la cohÉrence et la balance des rÉsumÉs produits ainsi que la polyvalence et la performance du système. Notre dÉmarche ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CLEF'10: Proceedings of the 2010 international conference on Multilingual and multimodal information access evaluation: cross-language evaluation forum

September 2010

145 pages

ISBN:3642159974

Editors:
Maristella Agosti
University of Padua, Italy
,
Nicola Ferro
University of Padua, Italy
,
Carol Peters
ISTI, CNR, Pisa, Italy
,
Maarten de Rijke
University of Amsterdam, The Netherlands
,
Alan Smeaton
Dublin City University, Ireland

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 20 September 2010

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Agosti MBerendsen RBogers TBraschler MBuitelaar PChoukri KMaria Di Nunzio GFerro NForner PHanbury AHeppin KHansen PJärvelin ALarsen BLupu MMasiero IMüller HPeruzzo SPetras VPiroi Fde Rijke MSantucci GSilvello GToms E(2012)PROMISE retreat report prospects and opportunities for information access evaluationACM SIGIR Forum10.1145/2422256.242226546:2(60-84)Online publication date: 21-Dec-2012
https://dl.acm.org/doi/10.1145/2422256.2422265
Santucci G(2012)Visual analytics and information retrievalProceedings of the 2012 international conference on Information Retrieval Meets Information Visualization10.1007/978-3-642-36415-0_8(116-131)Online publication date: 23-Jan-2012
https://dl.acm.org/doi/10.1007/978-3-642-36415-0_8

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Nouvelles applications du principe d'inversion dans le calcul analogique experimental

Performance Evaluation of Cyclist’s Position Using a Depth Camera-Based Motion Capture System

Évaluation d'un Système pour le Résumé Automatique de Documents Électroniques