research-article

LifeSeeker: Interactive Lifelog Search Engine at LSC 2019

Authors:

Duc-Tien Dang-Nguyen,

Minh-Triet Tran,

Cathal GurrinAuthors Info & Claims

LSC '19: Proceedings of the ACM Workshop on Lifelog Search Challenge

Pages 37 - 40

https://doi.org/10.1145/3326460.3329162

Published: 05 June 2019 Publication History

Abstract

In this paper we present a first version of the LifeSeeker interactive lifelog retrieval engine that is under development at Dublin City University. This retrieval engine has been designed as a platform onto which future lifelog annotation and retrieval engines will be built. The first implementation of LifeSeeker has been designed for the LSC'19 comparative benchmarking challenge and it takes the form of a faceted search and browsing interface with the addition of query expansion to help solve the lexical-gap between novice users and the concept annotation tools employed for annotating the collection.

References

[1]

Gabriel De Oliveira-Barra, X Giró-i Nieto, Alejandro Cartas-Ayala, and Petia Radeva. 2015. LEMoRe: A Lifelog Engine for Moments Retrieval at the NTCIR-Lifelog LSAT Task.The 12th NTCIR Conference, Evaluation of Information Access Technologies(2015), 0--5.

[2]

Aiden R. Doherty, Katalin Pauly-Takacs, Niamh Caprani, Cathal Gurrin, Chris J. a. Moulin, Noel E. O'Connor, and Alan F. Smeaton. 2012. Experiences of Aiding Autobiographical Memory Using the SenseCam. Human-Computer Interaction 27, 1--2 (2012), 151--174.

[3]

Aaron Duane, Cathal Gurrin, and Wolfgang Hürst. 2018. Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018. In Proceedings of the 2018ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY,USA, 20--23.

Digital Library

[4]

Roger Gemmell, Jim; Bell, Gordon; Lueder. 2006. My lifebits: a personal database for everything. Commun. ACM 49, 1 (2006), 88--95.

Digital Library

[5]

Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, and Rami Albatal.2016. Overview of NTCIR-12 Lifelog Task. (2016), 354--360. http://eprints.gla.ac.uk/131460/ The authors acknowledge the financial support of Science Foundation Ireland (SFI) under grant number SFI/12/RC/2289 and the input of theDCU ethics committee and the risk & compliance officer. We acknowledge financial support by the European Science Foundation via its Research Network Programme? Evaluating Information Access Systems?.

[6]

Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Bernd Munzer, Rami Albatal, Frank Hopfgartner, Liting Zhou, and Duc-Tien Dang-Nguyen. 2019. A Test Collection for Interactive Lifelog Retrieval. In MultiMedia Modeling, Ioannis Kompatsiaris, Benoit Huet, Vasileios Mezaris, Cathal Gurrin, Wen-Huang Cheng, and Stefanos Vrochidis (Eds.). Springer International Publishing, 312--324.

[7]

Cathal Gurrin, Klaus Schoeffmann, Hideo Joho, Liting Zhou, Aaron Duane, Andreas Leibetseder, Michael Riegler, Luca Piras, Minh-Triet Tran, Jakub Loko?, and Wolfgang Hürst. 2019. Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge ( LSC2018 ). ITE Transactions on Media Technology and Applications7, 2 (2019), 46--59.

[8]

Steve Hodges, Lyndsay Williams, Emma Berry, James Srinivasan, Gavin Smyth,Narinder Kapur, and Ken Woodberry. 2006. SenseCam: A Retrospective Memory Aid. In Proceedings of the 8th International Conference of Ubiquitous Computing(UbiComp 2006)(proceedings of the 8th international conference of ubiquitous computing (ubicomp 2006) ed.). Springer Verlag, 177--193. https://www.microsoft.com/en-us/research/publication/sensecam-a-retrospective-memory-aid/

Digital Library

[9]

Diane Kelly. 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users.Foundations and TrendsÂ? in Information Retrieval3, 1--2(2009), 1--224.

Digital Library

[10]

Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and Evaluation of a User Experience Questionnaire. In HCI and Usability for Education and Work, Andreas Holzinger (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg,63--76.

[11]

Tsung-Yi Lin, Michael Maire, Serge J. Belongie, Lubomir D. Bourdev, Ross B. Girshick, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common Objects in Context. CoRRabs/1405.0312(2014). arXiv:1405.0312 http://arxiv.org/abs/1405.0312

[12]

Jakub Lokoc, Gregor Kovalcík, Bernd Münzer, Klaus Schöffmann, Werner Bailer,Ralph Gasser, Stefanos Vrochidis, Phuong Anh Nguyen, Sitapa Rujikietgumjorn,and Kai Uwe Barthel. 2019. Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018. ACM Trans. Multimedia Comput. Commun. Appl.15, 1, Article 29 (Feb. 2019), 18 pages.

Digital Library

[13]

Jakub Lokoc, Tomás Soucek, and Gregor Kovalcik. 2018. Using an Interactive Video Retrieval Tool for LifeLog Data. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY, USA, 15--19.

Digital Library

[14]

David G. Lowe. 2004. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vision 60, 2 (Nov. 2004), 91--110.

Digital Library

[15]

Bernd Münzer, Andreas Leibetseder, Sabrina Kletz, Manfred Jürgen Primus, and Klaus Schoeffmann. 2018. lifeXplore at the Lifelog Search Challenge 2018. In Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge (LSC '18). ACM, New York, NY, USA, 3--8.

Digital Library

[16]

Van-Tu Ninh, Tu-Khiem Le, Liting Zhou, Graham Healy, Minh-Triet Tran, Duc-Tien Dang-Nguyen, Sinead Smyth, and Cathal Gurrin. 2019. A Baseline Interactive Retrieval Engine for the NTICR-14 Lifelog-3 Semantic Access Task. In The Fourteenth NTCIR conference (NTCIR-14).

[17]

S. E. Robertson and K. Sparck Jones. 1997. Simple, Proven Approaches to Text Retrieval. Technical Report.

[18]

Bharat Singh and Larry S Davis. 2018. An analysis of scale in variance in object detection-snip. CVPR(2018).

[19]

Bharat Singh, Mahyar Najibi, and Larry S Davis. 2018. SNIPER: Efficient Multi-Scale Training. NIPS(2018).

Digital Library

[20]

Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. 2017. Places: A 10 million Image Database for Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence(2017).

[21]

Guido Zuccon, Bevan Koopman, Peter Bruza, and Leif Azzopardi. 2015. Integrating and Evaluating Neural Word Embeddings in Information Retrieval. In Proceedings of the 20th Australasian Document Computing Symposium (ADCS '15). ACM,New York, NY, USA, Article 12, 8 pages.

Digital Library

Cited By

Le HNguyen TLe TTran MNguyen TNinh VZhou LGurrin C(2024)LifeSeeker 6.0: Leveraging the linguistic aspect of the lifelog system in LSC'24Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661121(53-57)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661121
Nguyen-Dang TThai XVuong GHo VTran MNinh VPham MLe THealy G(2023)LifeInsight: An Interactive Lifelog Retrieval System with Comprehensive Spatial Insights and Query AssistanceProceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593106(59-64)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593106
Nguyen TLe TNinh VGurrin CTran MNguyen THealy GCaputo ASmyth S(2023)E-LifeSeeker: An Interactive Lifelog Search Engine for LSC’23Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593098(13-17)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593098
Show More Cited By

Index Terms

LifeSeeker: Interactive Lifelog Search Engine at LSC 2019
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

LifeSeeker 3.0: An Interactive Lifelog Search Engine for LSC'21
LSC '21: Proceedings of the 4th Annual on Lifelog Search Challenge

In this paper, we present the interactive lifelog retrieval engine developed for the LSC'21 comparative benchmarking challenge. The LifeSeeker 3.0 interactive lifelog retrieval engine is an enhanced version of our previous system participating in LSC'20 ...
LifeSeeker 2.0: Interactive Lifelog Search Engine at LSC 2020
LSC '20: Proceedings of the Third Annual Workshop on Lifelog Search Challenge

In this paper we present our interactive lifelog retrieval engine in the LSC'20 comparative benchmarking challenge. The LifeSeeker2.0 interactive lifelog retrieval engine is developed by both Dublin City University and Ho Chi Minh University of Science, ...
E-LifeSeeker: An Interactive Lifelog Search Engine for LSC’23
LSC '23: Proceedings of the 6th Annual ACM Lifelog Search Challenge

Lifelogging is referred to as the process of automatically capturing the everyday activities of an individual to ultimately create a digital diary for further sharing, which can be challenging to manage and retrieve due to its multimodal nature. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

LSC '19: Proceedings of the ACM Workshop on Lifelog Search Challenge

June 2019

51 pages

ISBN:9781450367813

DOI:10.1145/3326460

Program Chairs:
Cathal Gurrin
Dublin City University, Ireland
,
Klaus Schoeffmann
Klagenfurt University, Austria
,
Hideo Joho
University of Tsukuba, Japan
,
Duc-Tien Dang-Nguyen
Dublin City University, Ireland
,
Michael Riegler
Oslo Metropolitan University, Norway
,
Luca Piras
University of Cagliari, Italy

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Science Foundation Ireland

Conference

ICMR '19

Sponsor:

SIGMM

ICMR '19: International Conference on Multimedia Retrieval

June 10 - 13, 2019

Ottawa ON, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
223
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Le HNguyen TLe TTran MNguyen TNinh VZhou LGurrin C(2024)LifeSeeker 6.0: Leveraging the linguistic aspect of the lifelog system in LSC'24Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge10.1145/3643489.3661121(53-57)Online publication date: 10-Jun-2024
https://dl.acm.org/doi/10.1145/3643489.3661121
Nguyen-Dang TThai XVuong GHo VTran MNinh VPham MLe THealy G(2023)LifeInsight: An Interactive Lifelog Retrieval System with Comprehensive Spatial Insights and Query AssistanceProceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593106(59-64)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593106
Nguyen TLe TNinh VGurrin CTran MNguyen THealy GCaputo ASmyth S(2023)E-LifeSeeker: An Interactive Lifelog Search Engine for LSC’23Proceedings of the 6th Annual ACM Lifelog Search Challenge10.1145/3592573.3593098(13-17)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3592573.3593098
Tran LNguyen MDang-Nguyen DHeller SSpiess FLokoč JPeška LNguyen TKhan ODuane AJónsson BRossetto LYen AAlateeq AAlam NTran MHealy GSchoeffmann KGurrin C(2023)Comparing Interactive Retrieval Approaches at the Lifelog Search Challenge 2021IEEE Access10.1109/ACCESS.2023.324828411(30982-30995)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3248284
Nguyen TLe TNinh VCaputo AHealy GSmyth STran MBinh N(2023)LifeSeeker: an interactive concept-based retrieval system for lifelog dataMultimedia Tools and Applications10.1007/s11042-023-15317-w82:24(37855-37876)Online publication date: 1-Aug-2023
https://doi.org/10.1007/s11042-023-15317-w
Nguyen TLe TNinh VTran MNguyen THealy GSmyth SCaputo AGurrin CGurrin CHealy GZhou LÞór Jónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LSchoeffmann K(2022)LifeSeeker 4.0: An Interactive Lifelog Search Engine for LSC'22Proceedings of the 5th Annual on Lifelog Search Challenge10.1145/3512729.3533014(14-19)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512729.3533014
Le TNinh VTran MHealy GGurrin CTran M(2022)AVSeeker: An Active Video Retrieval Engine at VBS2022MultiMedia Modeling10.1007/978-3-030-98355-0_51(537-542)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-030-98355-0_51
Mahdi MAhmad ANatiq HSubhi MQassim Q(2021)Comprehensive Review and Future Research Directions on Dynamic Faceted SearchApplied Sciences10.3390/app1117811311:17(8113)Online publication date: 31-Aug-2021
https://doi.org/10.3390/app11178113
Nguyen TLe TNinh VTran MThanh Binh NHealy GCaputo AGurrin CGurrin CSchoeffmann KJónsson BDang-Nguyen DLokoč JTran MHürst WRossetto LHealy G(2021)LifeSeeker 3.0: An Interactive Lifelog Search Engine for LSC'21Proceedings of the 4th Annual on Lifelog Search Challenge10.1145/3463948.3469065(41-46)Online publication date: 21-Aug-2021
https://dl.acm.org/doi/10.1145/3463948.3469065
Ksibi AAlluhaidan ASalhi AEl-Rahman S(2021)Overview of Lifelogging: Current Challenges and AdvancesIEEE Access10.1109/ACCESS.2021.30734699(62630-62641)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3073469
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents