Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Supporting exploratory video retrieval tasks with grouping and recommendation

Published: 01 November 2014 Publication History

Abstract

Combine grouping of video search results with recommendation techniques to assist video retrieval.Evaluate grouping and recommendation techniques in separate evaluations to assess impact.Different recommendation approaches are relevant to the users at different stages of their search.Organisational and recommendation functionalities can result in a significant improvement on the users' search performance. In this paper, we present ViGOR (Video Grouping, Organisation and Recommendation), an exploratory video retrieval system. Exploratory video retrieval tasks are hampered by the lack of semantics associated to video and the overwhelming amount of video items stored in these types of collections (e.g. YouTube, MSN video, etc.). In order to help facilitate these exploratory video search tasks we present a system that utilises two complementary approaches: the first a new search paradigm that allows the semantic grouping of videos and the second the exploitation of past usage history in order to provide video recommendations. We present two types of recommendation techniques adapted to the grouping search paradigm: the first is a global recommendation, which couples the multi-faceted nature of explorative video retrieval tasks with the current user need of information in order to provide recommendations, and second is a local recommendation, which exploits the organisational features of ViGOR in order to provide more localised recommendations based on a specific aspect of the user task. Two user evaluations were carried out in order to (1) validate the new search paradigm provided by ViGOR, characterised by the grouping functionalities and (2) evaluate the usefulness of the proposed recommendation approaches when integrated into ViGOR. The results of our evaluations show (1) that the grouping, organisational and recommendation functionalities can result in an improvement in the users' search performance without adversely impacting their perceptions of the system and (2) that both recommendation approaches are relevant to the users at different stages of their search, showing the importance of using multi-faceted recommendations for video retrieval systems and also illustrating the many uses of collaborative recommendations for exploratory video search tasks.

References

[1]
Bauer, T., & Leake, D. B. (2001). Real time user context modeling for information retrieval agents. In Proceedings of the tenth international conference on information and knowledge management. CIKM '01 (pp. 568-570).
[2]
P. Borlund, The IIR evaluation model: A framework for evaluation of interactive information retrieval systems, Information Research, 8 (2003).
[3]
K. Bystrom, K. Jarvelin, Task complexity affects information seeking and use, Information Processing and Management, 31 (1995) 191-213.
[4]
I. Campbell, Interactive evaluation of the ostensive model using a new test collection of images with multiple relevance assessments, Information Retrieval, 2 (2000) 89-114.
[5]
Christel, M., & Conescu, R. (2006). Mining novice user activity with trecvid interactive retrieval tasks. In TRECVID interactive retrieval track (pp. 21-30).
[6]
Christel, M. G. (2007). Establishing the utility of non-text search for news video retrieval with real world users. In Proceedings of the 15th international conference on multimedia. MULTIMEDIA '07 (pp. 707-716).
[7]
Craswell, N., & Szummer, M. (2007). Random walks on the click graph. In Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval. SIGIR '07 (pp. 239-246).
[8]
Dou, Z., Song, R., & Wen, J. (2007). A large-scale evaluation and analysis of personalized search strategies. In Proceedings of the 16th international World Wide Web conference. WWW2007 (pp. 572-581).
[9]
Fass, A. M., Bier, E. A., & Adar E., (2000). Picturepiper: Using a re-configurable pipeline to find images on the web. In Proceedings of the 13th annual ACM symposium on user interface software and technology. UIST '00 (pp. 51-62).
[10]
Fogarty, J., Tan, D., Kapoor, A., & Winder, S. (2008). Cueflik: Interactive concept learning in image search. In Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems. CHI '08 (pp. 29-38).
[11]
Girgensohn, A., Shipman, F., Wilcox, L., Turner, T., & Cooper, M. (2009). MediaGLOW: Organizing photos in a graph-based workspace. In Proceedings of the 13th international conference on intelligent user interfaces. IUI '09 (pp. 419-424).
[12]
M. Guy, E. Tonkin, Folksonomies, Tidying up tags?, D-Lib Magazine, 12 (2006).
[13]
Halvey, M. J., & Keane, M. T. (2007). Analysis of online video search and sharing. In Proceedings of the 18th conference on hypertext and hypermedia. HT '07 (pp. 217-226).
[14]
Halvey, M., Vallet, D., Hannah, D., & Jose, J. M. (2009). ViGOR: A grouping oriented interface for search and retrieval in video libraries. In Proceedings of the 9th ACM/IEEE-CS joint conference on digital libraries. JCDL (pp. 87-96).
[15]
Hauptmann, A. G., & Christel, M. G. (2004). Successful approaches in the trec video retrieval evaluations. In Proceedings of the 12th annual ACM international conference on multimedia. MULTIMEDIA '04 (pp. 668-675).
[16]
Hauptmann, A. G., Lin, W. H., Yan, R., Yang, J., & Chen, M. Y. (2006). Extreme video retrieval: Joint maximization of human and computer performance. In Proceedings of the 14th annual ACM international conference on multimedia. MULTIMEDIA '06 (pp. 385-394).
[17]
F. Hopfgartner, Understanding video retrieval, VDM Verlag, 2007.
[18]
Hopfgartner, F., Urban, J., Villa, R., & Jose, J. (2007). Simulated testing of an adaptive multimedia information retrieval system. In International workshop on content-based multimedia indexing. CBMI 2007 (pp. 328-335).
[19]
Hopfgartner, F., Vallet, D., Vallet, & Jose, J. M. (2008). Search trails using user feedback to improve video search. In Proceeding of the 16th ACM international conference on multimedia. MULTIMEDIA '08 (pp. 339-348).
[20]
M. Nakazato, L. Manola, T.S. Huang, Imagegrouper: A group-oriented user interface for content-based image retrieval and digital image arrangement, Journal of Visual Languages & Computing, 14 (2003) 363-386.
[21]
M. Naphade, J.R. Smith, J. Tesic, S.F. Chang, W. Hsu, L. Kennedy, Large-scale concept ontology for multimedia, IEEE Multimedia, 13 (2006) 86-91.
[22]
De Rooij, O., Snoek, C. G. M., & Worring, M. (2008). Mediamill: Fast and effective video search using the forkbrowser. In Proceedings of the 2008 international conference on Content-based image and video retrieval. CIVR '08 (pp. 561-562).
[23]
Singla, A., White, R., & Huang, J. (2010). Studying trailfinding algorithms for enhanced web search. In Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval. (SIGIR '10) (pp. 443-450).
[24]
A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, R. Jain, Content-based image retrieval at the end of the early years, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22 (2002) 1349-1380.
[25]
C. Snoek, M. Worring, D. Koelma, A. Smeulders, Learned lexicon-driven interactive video retrieval, Image and Video Retrieval, 4071 (2006) 11-20.
[26]
Sun, J. T., Zeng, H. J., Liu, H., Lu, Y., & Chen, Z. (2005). Cubesvd: A novel approach to personalized web search. In Proceedings of the 14th international conference on World Wide Web. WWW '05 (pp. 382-390).
[27]
J. Urban, J.M. Jose, Ego: A personalised multimedia management and retrieval tool, International Journal of Intelligent Systems (Special issue on "Intelligent Multimedia Retrieval"), 21 (2006) 725-745.
[28]
D. Vallet, F. Hopfgartner, J.M. Jose, P. Castells, Effects of usage-based feedback on video retrieval: A simulation-based study, ACM Transaction on Information Systems, 29 (2011) 11-32.
[29]
Villa, R., Gildea, N., & Jose, J. M. (2008). A faceted interface for multimedia search. In Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval. SIGIR '08 (pp. 775-776).
[30]
White, R. W., Bilenko, M., & Cucerzan, S. (2007) Studying the use of popular destinations to enhance web search interaction. In Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval. SIGIR '07 (pp. 159-166).
[31]
White, R. W. & Huang, J. (2010). Assessing the scenic route: Measuring the value of search trails in web logs. In Proceeding of the 33rd international ACM SIGIR conference on research and development in information retrieval. SIGIR'10 (pp. 587-594).

Cited By

View all
  • (2022)Mitigating sensitive data exposure with adversarial learning for fairness recommendation systemsNeural Computing and Applications10.1007/s00521-022-07373-434:20(18097-18111)Online publication date: 1-Oct-2022
  • (2021)MIRRE approach: nonlinear and multimodal exploration of MIR aggregated search resultsMultimedia Tools and Applications10.1007/s11042-021-10603-x80:13(20217-20253)Online publication date: 1-May-2021
  • (2018)A knowledge-based multi-criteria collaborative filtering approach for discovering services in mobile cloud computing platformsJournal of Intelligent Information Systems10.1007/s10844-018-0527-254:1(179-203)Online publication date: 10-Sep-2018
  • Show More Cited By

Index Terms

  1. Supporting exploratory video retrieval tasks with grouping and recommendation

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Information Processing and Management: an International Journal
    Information Processing and Management: an International Journal  Volume 50, Issue 6
    November 2014
    104 pages

    Publisher

    Pergamon Press, Inc.

    United States

    Publication History

    Published: 01 November 2014

    Author Tags

    1. Collaborative
    2. Feedback
    3. Implicit
    4. Interface
    5. Search
    6. Video

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 22 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Mitigating sensitive data exposure with adversarial learning for fairness recommendation systemsNeural Computing and Applications10.1007/s00521-022-07373-434:20(18097-18111)Online publication date: 1-Oct-2022
    • (2021)MIRRE approach: nonlinear and multimodal exploration of MIR aggregated search resultsMultimedia Tools and Applications10.1007/s11042-021-10603-x80:13(20217-20253)Online publication date: 1-May-2021
    • (2018)A knowledge-based multi-criteria collaborative filtering approach for discovering services in mobile cloud computing platformsJournal of Intelligent Information Systems10.1007/s10844-018-0527-254:1(179-203)Online publication date: 10-Sep-2018
    • (2016)An adaptive fuzzy recommender system based on learning automataElectronic Commerce Research and Applications10.1016/j.elerap.2016.10.00220:C(105-115)Online publication date: 1-Nov-2016

    View Options

    View options

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media