research-article

Exquisitor at the Lifelog Search Challenge 2021: Relationships Between Semantic Classifiers

Authors:

Marcel WorringAuthors Info & Claims

LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

Pages 3 - 6

https://doi.org/10.1145/3463948.3469255

Published: 21 August 2021 Publication History

Get Access

Abstract

Exquisitor is a scalable media exploration system based on interactive learning. To satisfy a user's information need, the system asks the user for feedback on media items and uses that feedback to interactively construct a classifier, that is in turn used to identify the next potentially relevant set of media items. To facilitate effective exploration of a collection, the system offers filters to narrow the scope of exploration, search functionality for finding good examples for the classifier, and support for timeline browsing of videos or image sequences. For this year's Lifelog Search Challenge, we have enhanced Exquisitor to better support tasks with a temporal component, by adding features that allow the user to build multiple classifiers and merge the classifier results, using both traditional set operators and advanced temporal operators.

References

[1]

Gylfi Þór Guðmundsson, Björn Þór Jónsson, and Laurent Amsaleg. 2010. A Large-scale Performance Study of Cluster-based High-dimensional Indexing. In Proc. International Workshop on Very-large-scale Multimedia Corpus, Mining and Retrieval (VLS-MCMR). ACM, Firenze, Italy, 31--36.

Digital Library

Google Scholar

[2]

Cathal Gurrin, Björn Þór Jónsson, Klaus Schöffmann, Duc-Tien Dang-Nguyen, Jakub Lokoc, Minh-Triet Tran, Wolfgang Hürst, Luca Rossetto, and Graham Healy. 2021. Introduction to the Fourth Annual Lifelog Search Challenge, LSC'21. In Proc. International Conference on Multimedia Retrieval (ICMR'21). ACM, Taipei, Taiwan.

Digital Library

Google Scholar

[3]

Björn Þór Jónsson, Omar Shahbaz Khan, Hanna Ragnarsdóttir, Þórhildur Þorleiksdóttir, Jan Zahálka, Stevan Rudinac, Gylfi Þór Guðmundsson, Laurent Amsaleg, and Marcel Worring. 2019. Exquisitor: Interactive Learning at Large. arXiv:1904.08689.

Google Scholar

[4]

Omar Shahbaz Khan, Björn Þór Jónsson, Stevan Rudinac, Jan Zahálka, Hanna Ragnarsdóttir, Þórhildur Þorleiksdóttir, Gylfi Þór Guðmundsson, Laurent Amsaleg, and Marcel Worring. 2020 a. Interactive Learning for Multimedia at Large. In Proceedings of the European Conference on Information Retrieval (ECIR). Springer, Lisboa, Portugal, 16.

Digital Library

Google Scholar

[5]

Omar Shahbaz Khan, Björn Þór Jónsson, Jan Zahálka, Stevan Rudinac, and Marcel Worring. 2019. Exquisitor at the Lifelog Search Challenge 2019. In Proceedings of the ACM Workshop on Lifelog Search Challenge, LSC 2019. ACM, Ottawa, ON, Canada, 7--11.

Digital Library

Google Scholar

[6]

Omar Shahbaz Khan, Mathias Dybkjær Larsen, Liam Alex Sonto Poulsen, Björn Þór Jónsson, Jan Zahálka, Stevan Rudinac, Dennis Koelma, and Marcel Worring. 2020 b. Exquisitor at the Lifelog Search Challenge 2020. In Proceedings of the Third Annual Workshop on Lifelog Search Challenge. ACM.

Digital Library

Google Scholar

[7]

Ionut Mironica, Bogdan Ionescu, Jasper Uijlings, and Nicu Sebe. 2016. Fisher Kernel Temporal Variation-based Relevance Feedback for video retrieval. Computer Vision and Image Understanding, Vol. 143 (2016), 38 -- 51. https://doi.org/10.1016/j.cviu.2015.10.005 Inference and Learning of Graphical Models: Theory and Applications in Computer Vision and Image Analysis.

Digital Library

Google Scholar

[8]

Sudheendra Vijayanarasimhan, Prateek Jain, and Kristen Grauman. 2014. Hashing Hyperplane Queries to Near Points with Applications to Large-Scale Active Learning. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 36, 2 (2014), 276--288.

Digital Library

Google Scholar

[9]

Jan Zahálka, Stevan Rudinac, Björn Þór Jónsson, Dennis C. Koelma, and Marcel Worring. 2018. Blackthorn: Large-Scale Interactive Multimodal Learning. IEEE Transactions on Multimedia, Vol. 20, 3 (2018), 687--698.

Digital Library

Google Scholar

Cited By

View all

Khan OSharma UZhu HRudinac SJónsson B(2024)Exquisitor at the Lifelog Search Challenge 2024: Blending Conversational Search with User Relevance FeedbackProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661132(117-121)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661132
Rossetto LKyriakou ALange SRuosch FWang RWardatzky KBernstein A(2024)LifeGraph 4 - Lifelog Retrieval using Multimodal Knowledge Graphs and Vision-Language ModelsProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661127(88-92)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661127
Khan OJónsson B(2023)User Relevance Feedback and Novices: Anecdotes from Exquisitor's Participation in Interactive Retrieval CompetitionsProceedings of the 20th International Conference on Content-based Multimedia Indexing10.1145/3617233.3617275(173-177)Online publication date: 20-Sep-2023
https://dl.acm.org/doi/10.1145/3617233.3617275
Show More Cited By

Index Terms

Exquisitor at the Lifelog Search Challenge 2021: Relationships Between Semantic Classifiers
1. Information systems
  1. Information retrieval
    1. Specialized information retrieval
      1. Multimedia and multimodal retrieval
    2. Users and interactive retrieval
      1. Task models
  2. Information systems applications
    1. Multimedia information systems
      1. Multimedia databases

Recommendations

Exquisitor at the Lifelog Search Challenge 2020
LSC '20: Proceedings of the Third Annual Workshop on Lifelog Search Challenge

We present an enhanced version of Exquisitor, our interactive and scalable media exploration system. At its core, Exquisitor is an interactive learning system using relevance feedback on media items to build a model of the users' information need. ...
Exquisitor at the Video Browser Showdown 2021: Relationships Between Semantic Classifiers
MultiMedia Modeling
Abstract
Exquisitor is a scalable media exploration system based on interactive learning, which first took part in VBS in 2020. This paper presents an extension to Exquisitor, which supports operations on semantic classifiers to solve VBS tasks with ...
lifeXplore at the Lifelog Search Challenge 2018
LSC '18: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge

With the growing hype for wearable devices recording biometric data comes the readiness to capture and combine even more personal information as a form of digital diary - lifelogging today is practiced ever more and can be categorized anywhere between ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

August 2021

102 pages

ISBN:9781450385336

DOI:10.1145/3463948

General Chairs:
Cathal Gurrin
Dublin City University, Ireland
,
Klaus Schoeffmann
Klagenfurt University, Austria
,
Björn Jónsson
IT University of Copenhagen, Denmark
,
Duc-Tien Dang-Nguyen
University of Bergen, Norway
,
Jakub Lokoč
Charles University, Czech Republic
,
Minh-Triet Tran
HCM University of Science, Vietnam
,
Wolfgang Hürst
Utrecht University, Netherlands
,
Luca Rossetto
University of Zurich, Switzerland
,
Graham Healy
Dublin City University, Ireland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 August 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Regional Development Fund
MCSA-IF

Conference

ICMR '21

Sponsor:

SIGMM

ICMR '21: International Conference on Multimedia Retrieval

August 21, 2021

Taipei, Taiwan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
113
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Khan OSharma UZhu HRudinac SJónsson B(2024)Exquisitor at the Lifelog Search Challenge 2024: Blending Conversational Search with User Relevance FeedbackProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661132(117-121)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661132
Rossetto LKyriakou ALange SRuosch FWang RWardatzky KBernstein A(2024)LifeGraph 4 - Lifelog Retrieval using Multimodal Knowledge Graphs and Vision-Language ModelsProceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661127(88-92)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661127
Khan OJónsson B(2023)User Relevance Feedback and Novices: Anecdotes from Exquisitor's Participation in Interactive Retrieval CompetitionsProceedings of the 20th International Conference on Content-based Multimedia Indexing10.1145/3617233.3617275(173-177)Online publication date: 20-Sep-2023
https://dl.acm.org/doi/10.1145/3617233.3617275
Schoeffmann K(2023)lifeXplore at the Lifelog Search Challenge 2023Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593105(53-58)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593105
Tran LNguyen MDang-Nguyen DHeller SSpiess FLokoč JPeška LNguyen TKhan ODuane AJónsson BRossetto LYen AAlateeq AAlam NTran MHealy GSchoeffmann KGurrin C(2023)Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021IEEE Access10.1109/ACCESS.2023.324828411(30982-30995)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3248284
Tran LNguyen MNguyen BLee HZhou LGurrin CGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)E-Myscéal: Embedding-based Interactive Lifelog Retrieval System for LSC'22Proceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533012(32-37)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533012
Ribiero RTrifan ANeves AGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)MEMORIA: A Memory Enhancement and MOment RetrIeval Application for LSC 2022Proceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533011(8-13)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533011
Alateeq ARoantree MGurrin CGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)Voxento 3.0: A Prototype Voice-Controlled Interactive Search Engine for LifelogProceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533009(43-47)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533009

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Exquisitor at the Lifelog Search Challenge 2020

Exquisitor at the Video Browser Showdown 2021: Relationships Between Semantic Classifiers

lifeXplore at the Lifelog Search Challenge 2018