research-article

VIRET Tool with Advanced Visual Browsing and Feedback

Authors:

Gregor Kovalčík,

Tomáš Souček,

Jakub LokočAuthors Info & Claims

LSC '20: Proceedings of the Third Annual Workshop on Lifelog Search Challenge

Pages 63 - 66

https://doi.org/10.1145/3379172.3391725

Published: 09 June 2020 Publication History

Abstract

VIRET is a video retrieval system that performed competitively in several recent interactive multimedia search competitions. For the Lifelog Search Challenge 2020, we implement several new features that focus on result set presentation based on dynamically computed self-organized maps, as well as additional feedback about the distribution of relevance scores for a query. The latter feature provides users with more insight to assess input queries and could help with the design of new ranking models in the future.

References

[1]

Kai Uwe Barthel and Nico Hezel. 2019. Visually exploring millions of images using image maps and graphs. In Big Data Analytics for Large-scale Multimedia Search, Benoit Huet, Stefanos Vrochidis, and Edward Chang (Eds.). John Wiley and Sons Inc., 251--275.

[2]

Kai Uwe Barthel, Nico Hezel, and Klaus Jung. 2018. Fusing Keyword Search and Visual Exploration for Untagged Videos. In MultiMedia Modeling, Klaus Schoeffmann, Thanarat H. Chalidabhongse, Chong Wah Ngo, Supavadee Aramvith, Noel E. O'Connor, Yo-Sung Ho, Moncef Gabbouj, and Ahmed Elgammal (Eds.). Springer International Publishing, Cham, 413--418.

[3]

Kai Uwe Barthel, Nico Hezel, and Radek Mackowiak. 2015. ImageMap - Visually Browsing Millions of Images. In MultiMedia Modeling - 21st International Conference, MMM 2015, Sydney, NSW, Australia, January 5--7, 2015, Proceedings, Part II. 287--290. https://doi.org/10.1007/978--3--319--14442--9_30

[4]

Adam Blavz ek, Jakub Lokovc, and Tomávs Skopal. 2014. Video Retrieval with Feature Signature Sketches. In Similarity Search and Applications, Agma Juci Machado Traina, Caetano Traina, and Robson Leonardo Ferreira Cordeiro (Eds.). Springer International Publishing, Cham, 25--36.

[5]

Cathal Gurrin, Tu-Khiem Le, Van-Tu Ninh, Duc-Tien Dang-Nguyen, Björn Þór Jónsson, Jakub Lokoc, Wolfgang Hurst, Minh-Triet Tran, and Klaus Schoeffmann. 2020. An Introduction to the Third Annual Lifelog Search Challenge, LSC'20. In ICMR '20, The 2020 International Conference on Multimedia Retrieval. ACM, Dublin, Ireland.

Digital Library

[6]

Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Andreas Leibetseder, Liting Zhou, Aaron Duane, Duc-Tien Dang-Nguyen, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Lokovc, and Wolfgang Hürst. 2019. [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018). ITE Transactions on Media Technology and Applications, Vol. 7, 2 (2019), 46--59. https://doi.org/10.3169/mta.7.46

[7]

Teuvo Kohonen. 1998. The self-organizing map. Neurocomputing, Vol. 21, 1--3 (1998), 1--6.

[8]

Miroslav Kratochvíl, Patrik Veselý, Frantivs ek Mejzlík, and Jakub Lokovc. 2020. SOM-Hunter: Video Browsing with Relevance-to-SOM Feedback Loop. In MultiMedia Modeling, Yong Man Ro, Wen-Huang Cheng, Junmo Kim, Wei-Ta Chu, Peng Cui, Jung-Woo Choi, Min-Chun Hu, and Wesley De Neve (Eds.). Springer International Publishing, Cham, 790--795.

[9]

Xirong Li, Chaoxi Xu, Gang Yang, Zhineng Chen, and Jianfeng Dong. 2019. W2VV

[10]

: Fully Deep Learning for Ad-Hoc Video Search. In Proceedings of the 27th ACM International Conference on Multimedia (Nice, France) (MM '19). Association for Computing Machinery, New York, NY, USA, 1786--1794. https://doi.org/10.1145/3343031.3350906

Digital Library

[11]

Jakub Lokovc, Gregor Kovalvcik, Bernd Münzer, Klaus Schöffmann, Werner Bailer, Ralph Gasser, Stefanos Vrochidis, Phuong Anh Nguyen, Sitapa Rujikietgumjorn, and Kai Uwe Barthel. 2019 a. Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018. ACM Trans. Multimedia Comput. Commun. Appl., Vol. 15, 1, Article 29 (Feb. 2019), 18 pages. https://doi.org/10.1145/3295663

Digital Library

[12]

Jakub Lokovc, Gregor Kovalvcik, Tomás Souvcek, Jaroslav Moravec, and Premysl vCech. 2019 b. A framework for effective known-item search in video. In In Proceedings of the 27th ACM International Conference on Multimedia (MM'19), October 21--25, 2019, Nice, France. 1--9. https://doi.org/10.1145/3343031.3351046

Digital Library

[13]

Jakub Lokovc, Gregor Kovalvcik, Tomás Soucek, Jaroslav Moravec, and Pvremysl vCech. 2019 c. VIRET: A Video Retrieval Tool for Interactive Known-item Search. In Proceedings of the 2019 on International Conference on Multimedia Retrieval (Ottawa ON, Canada) (ICMR '19). ACM, New York, NY, USA, 177--181. https://doi.org/10.1145/3323873.3325034

Digital Library

[14]

Jakub Lokovc, Tomás Soucek, and Gregor Kovalcik. 2018. Using an Interactive Video Retrieval Tool for LifeLog Data. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge, LSC@ICMR 2018, Yokohama, Japan, June 11, 2018. 15--19. https://doi.org/10.1145/3210539.3210543

Digital Library

[15]

Jakub Lokovc, Tomás Soucek, Premysl Cech, and Gregor Kovalcik. 2019 d. Enhanced VIRET Tool for Lifelog Data. In Proceedings of the ACM Workshop on Lifelog Search Challenge (Ottawa ON, Canada) (LSC '19). Association for Computing Machinery, New York, NY, USA, 25--26. https://doi.org/10.1145/3326460.3329159

Digital Library

[16]

Pascal Mettes, Dennis C. Koelma, and Cees G.M. Snoek. 2016. The ImageNet Shuffle: Reorganized Pre-training for Video Event Detection. In Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval (New York, New York, USA) (ICMR '16). ACM, New York, NY, USA, 175--182. https://doi.org/10.1145/2911996.2912036

Digital Library

[17]

Klaus Schoeffmann, Bernd Münzer, Andreas Leibetseder, Jürgen Primus, and Sabrina Kletz. 2019. Autopiloting Feature Maps: The Deep Interactive Video Exploration (diveXplore) System at VBS2019. In MultiMedia Modeling - 25th International Conference, MMM 2019, Thessaloniki, Greece, January 8--11, 2019, Proceedings, Part II. 585--590. https://doi.org/10.1007/978--3-030-05716--9_50

[18]

Barret Zoph, Vijay Vasudevan, Jonathon Shlens, and Quoc V. Le. 2017. Learning Transferable Architectures for Scalable Image Recognition. CoRR, Vol. abs/1707.07012 (2017). arxiv: 1707.07012 http://arxiv.org/abs/1707.07012

Cited By

Tran LNguyen MNguyen BZhou L(2023)Myscéal: a deeper analysis of an interactive lifelog search engineMultimedia Tools and Applications10.1007/s11042-023-15078-682:24(37789-37806)Online publication date: 22-Mar-2023
https://doi.org/10.1007/s11042-023-15078-6
Alam NGraham Y(2023)Memento: a prototype search engine for LSC 2021Multimedia Tools and Applications10.1007/s11042-023-15067-982:24(37807-37828)Online publication date: 1-Apr-2023
https://doi.org/10.1007/s11042-023-15067-9
Ribeiro RTrifan ANeves A(2022)Lifelog Retrieval From Daily Digital Data: Narrative ReviewJMIR mHealth and uHealth10.2196/3051710:5(e30517)Online publication date: 2-May-2022
https://doi.org/10.2196/30517
Show More Cited By

Index Terms

VIRET Tool with Advanced Visual Browsing and Feedback
1. Information systems
  1. Information retrieval

Recommendations

VIRET: A Video Retrieval Tool for Interactive Known-item Search
ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval

Known-item search in large video collections still represents a challenging task for current video retrieval systems that have to rely both on state-of-the-art ranking models and interactive means of retrieval. We present a general overview of the ...
Enhanced VIRET Tool for Lifelog Data
LSC '19: Proceedings of the ACM Workshop on Lifelog Search Challenge

We present an enhanced version of the VIRET tool, an interactive video retrieval system for known-item and ad-hoc search tasks. The new features for the Lifelog Search Challenge comprise attribute-based filtering using lifelog specific modalities like ...
Filter Image Browsing: Interactive Image Retrieval by Using Database Overviews

Human-computer interaction is a decisive factor in effective content-based access to large image repositories. In current image retrieval systems the user refines his query by selecting example images from a relevance ranking. Since the top ranked ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

LSC '20: Proceedings of the Third Annual Workshop on Lifelog Search Challenge

June 2020

89 pages

ISBN:9781450371360

DOI:10.1145/3379172

General Chairs:
Cathal Gurrin
Dublin City University, Ireland
,
Klaus Schoeffmann
Klagenfurt University, Austria
,
Björn Þór Jónsson
IT University of Copenhagen, Denmark
,
Duc-Tien Dang-Nguyen
University of Bergen, Norway
,
Jakub Lokoč
Charles University, Czech Republic
,
Minh-Triet Tran
HCM University of Science, Vietnam
,
Wolfgang Hürst
Utrecht University, Netherlands

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Charles University
Czech Science Foundation
Charles University Grant Agency (GA UK)

Conference

ICMR '20

Sponsor:

SIGMM

ICMR '20: International Conference on Multimedia Retrieval

June 9, 2020

Dublin, Ireland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
115
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tran LNguyen MNguyen BZhou L(2023)Myscéal: a deeper analysis of an interactive lifelog search engineMultimedia Tools and Applications10.1007/s11042-023-15078-682:24(37789-37806)Online publication date: 22-Mar-2023
https://doi.org/10.1007/s11042-023-15078-6
Alam NGraham Y(2023)Memento: a prototype search engine for LSC 2021Multimedia Tools and Applications10.1007/s11042-023-15067-982:24(37807-37828)Online publication date: 1-Apr-2023
https://doi.org/10.1007/s11042-023-15067-9
Ribeiro RTrifan ANeves A(2022)Lifelog Retrieval From Daily Digital Data: Narrative ReviewJMIR mHealth and uHealth10.2196/3051710:5(e30517)Online publication date: 2-May-2022
https://doi.org/10.2196/30517
Tran LAlam NGraham YVo LDiep NNguyen BZhou LGurrin C(2022)An Exploration into the Benefits of the CLIP model for Lifelog RetrievalProceedings of the 19th International Conference on Content-based Multimedia Indexing10.1145/3549555.3549593(15-22)Online publication date: 14-Sep-2022
https://dl.acm.org/doi/10.1145/3549555.3549593
Jónsson BDuane AMertz N(2022)Relational Database Performance for Multimedia: A Case StudyProceedings of the 19th International Conference on Content-based Multimedia Indexing10.1145/3549555.3549558(186-190)Online publication date: 14-Sep-2022
https://dl.acm.org/doi/10.1145/3549555.3549558
de Jesus Oliveira VRottermanner GGrößbacher SBoucher MJudmaier P(2022)Requirements and Concepts for Interactive Media Retrieval User InterfacesNordic Human-Computer Interaction Conference10.1145/3546155.3546701(1-10)Online publication date: 8-Oct-2022
https://dl.acm.org/doi/10.1145/3546155.3546701
Lokoč JMejzlik FVeselý PSouček TGurrin CSchoeffmann KJónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LHealy G(2021)Enhanced SOMHunter for Known-item Search in Lifelog DataProceedings of the 4th Annual on Lifelog Search Challenge10.1145/3463948.3469074(71-73)Online publication date: 21-Aug-2021
https://dl.acm.org/doi/10.1145/3463948.3469074
Shin JWaldau ADuane AJónsson BGurrin CSchoeffmann KJónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LHealy G(2021)PhotoCube at the Lifelog Search Challenge 2021Proceedings of the 4th Annual on Lifelog Search Challenge10.1145/3463948.3469073(59-63)Online publication date: 21-Aug-2021
https://dl.acm.org/doi/10.1145/3463948.3469073
Trang-Trung HLe TTran MNinh VLe TGurrin CTran MGurrin CSchoeffmann KJónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LHealy G(2021)Flexible Interactive Retrieval SysTem 2.0 for Visual Lifelog Exploration at LSC 2021Proceedings of the 4th Annual on Lifelog Search Challenge10.1145/3463948.3469072(81-87)Online publication date: 21-Aug-2021
https://dl.acm.org/doi/10.1145/3463948.3469072
Alam NGraham YGurrin CGurrin CSchoeffmann KJónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LHealy G(2021)Memento: A Prototype Lifelog Search Engine for LSC'21Proceedings of the 4th Annual on Lifelog Search Challenge10.1145/3463948.3469069(53-58)Online publication date: 21-Aug-2021
https://dl.acm.org/doi/10.1145/3463948.3469069
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents