research-article

Personalized online document, image and video recommendation via commodity eye-tracking

Authors:

Francis C.M. LauAuthors Info & Claims

RecSys '08: Proceedings of the 2008 ACM conference on Recommender systems

Pages 83 - 90

https://doi.org/10.1145/1454008.1454023

Published: 23 October 2008 Publication History

Abstract

We propose a new recommendation algorithm for online documents, images and videos, which is personalized. Our idea is to rely on the attention time of individual users captured through commodity eye-tracking as the essential clue. The prediction of user interest over a certain online item (a document, image or video) is based on the user's attention time acquired using vision-based commodity eye-tracking during his previous reading, browsing or video watching sessions over the same type of online materials. After acquiring a user's attention times over a collection of online materials, our algorithm can predict the user's probable attention time over a new online item through data mining. Based on our proposed algorithm, we have developed a new online content recommender system for documents, images and videos. The recommendation results produced by our algorithm are evaluated by comparing with those manually labeled by users as well as by commercial search engines including Google (Web) Search, Google Image Search and YouTube.

References

[1]

T. Darrell, N. Checka, A. Oh, and L. Morency. Exploring vision-based interfaces: How to use your head in dual pointing tasks. MIT AI Memo 2002-001, 2002.

[2]

F. Dirfaux. Key frame selection to represent a video. In ICIP '00: Proceedings of IEEE International Conference on Image Processing, volume 2, pages 275--278, 2000.

[3]

Z. Dou, R. Song, and J.-R. Wen. A large-scale evaluation and analysis of personalized search strategies. In WWW '07: Proceedings of International Conference on World Wide Web, pages 581---590, New York, NY, USA, 2007. ACM.

Digital Library

[4]

G. Dupret, V. Murdock, and B. Piwowarski. Web search engine evaluation using clickthrough data and a user model. In Query Log Analysis: Social And Technological Challenges. A Workshop at the 16th International World Wide Web Conference(WWW 2007), Banff, Canada, 2007.

[5]

S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve web search. ACM Transactions on Information Systems, 23(2):147--168, 2005.

Digital Library

[6]

X. Fu. Evaluating sources of implicit feedback in web searches. In RecSys '07: Proceedings of ACM Conference on Recommender Systems, pages 191--194, New York, NY, USA, 2007. ACM.

Digital Library

[7]

D. Gorodnichy. Perceptual cursor - a solution to the broken loop problem in vision-based hands-free computer control devices. National Research Council Canada Publication, NRC-48472:1--23, 2006.

[8]

L. A. Granka, T. Joachims, and G. Gay. Eye-tracking analysis of user behavior in www search. In SIGIR '04: Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval, pages 478--479, New York, NY, USA, 2004. ACM.

Digital Library

[9]

Z. Guan and E. Cutrell. An eye tracking study of the effect of target rank on web search. In CHI '07: Proceedings of SIGCHI Conference on Human Factors in Computing Systems, pages 417--420, New York, NY, USA, 2007. ACM.

Digital Library

[10]

W. S. A. Halabi, M. Kubat, and M. Tapia. Time spent on a web page is sufficient to infer a user's interest. In IMSA '07: Proceedings of IASTED European Conference on Internet and Multimedia Systems and Applications, pages 41--46, Anaheim, CA, USA, 2007. ACTA Press.

Digital Library

[11]

W. Hersh, C. Buckley, T. J. Leone, and D. Hickam. Ohsumed: an interactive retrieval evaluation and new large test collection for research. In SIGIR '94: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 192--201, New York, NY, USA, 1994. Springer-Verlag New York, Inc.

Digital Library

[12]

C.-K. Huang, Y.-J. Oyang, and L.-F. Chien. A contextual term suggestion mechanism for interactive web search. In WI '01: Proceedings of Asia-Pacific Conference on Web Intelligence: Research and Development, pages 272--281, London, UK, 2001. Springer-Verlag.

Digital Library

[13]

J. Huang, S. R. Kumar, M. Mitra, W.-J. Zhu, and R. Zabih. Image indexing using color correlograms. In CVPR '97: Proceedings of International Conference on Computer Vision and Pattern Recognition, page 762, Washington, DC, USA, 1997. IEEE Computer Society.

Digital Library

[14]

T. Joachims. A probabilistic analysis of the rocchio algorithm with tfidf for text categorization. In ICML '97: Proceedings of International Conference on Machine Learning, pages 143--151, San Francisco, CA, USA, 1997. Morgan Kaufmann Publishers Inc.

Digital Library

[15]

T. Joachims. Optimizing search engines using clickthrough data. In KDD '02: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 133--142, New York, NY, USA, 2002. ACM.

Digital Library

[16]

T. Joachims, L. Granka, B. Pan, H. Hembrooke, and G. Gay. Accurately interpreting clickthrough data as implicit feedback. In SIGIR '05: Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval, pages 154--161, New York, NY, USA, 2005. ACM.

Digital Library

[17]

D. Kelly and N. J. Belkin. Reading time, scrolling and interaction: exploring implicit sources of user preferences for relevance feedback. In SIGIR '01: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 408--409, New York, NY, USA, 2001. ACM.

Digital Library

[18]

D. Kelly and N. J. Belkin. Display time as implicit feedback: understanding task eects. In SIGIR '04: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 377---384, New York, NY, USA, 2004. ACM.

Digital Library

[19]

K.-N. Kim and R. Ramakrishna. Vision-based eye-gaze tracking for human computer interface. In SMC '99: Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, volume 2, pages 324--329, 1999.

[20]

Y.-P. Lin, Y.-P. Chao, C.-C. Lin, and J.-H. Chen. Webcam mouse using face and eye tracking in various illumination environments. In EMBS '05: Proceedings of 27th IEEE Annual International Conference of Engineering in Medicine and Biology Society, pages 3738--3741, 2005.

[21]

F. Liu, C. Yu, and W. Meng. Personalized web search by mapping user queries to categories. In CIKM '02: Proceedings of International Conference on Information and Knowledge Management, pages 558--565, New York, NY, USA, 2002. ACM.

Digital Library

[22]

Y. Lv, L. Sun, J. Zhang, J.-Y. Nie, W. Chen, and W. Zhang. An iterative implicit feedback approach to personalized search. In ACL '06: Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics, pages 585--592, Morristown, NJ, USA, 2006. Association for Computational Linguistics.

Digital Library

[23]

J. Pitkow, H. Schütze, T. Cass, R. Cooley, D. Turnbull, A. Edmonds, E. Adar, and T. Breuel. Personalized search. Communications of the ACM, 45(9):50--55, 2002.

Digital Library

[24]

F. Radlinski and T. Joachims. Query chains: learning to rank from implicit feedback. In KDD '05: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, pages 239--248, New York, NY, USA, 2005. ACM.

Digital Library

[25]

R. Ruddarraju, A. Haro, K. Nagel, Q. T. Tran, I. A. Essa, G. Abowd, and E. D. Mynatt. Perceptual user interfaces using vision-based eye tracking. In ICMI '03: Proceedings of 5th International Conference on Multimodal Interfaces, pages 227--233, New York, NY, USA, 2003. ACM.

Digital Library

[26]

G. Salton and C. Buckley. Improving retrieval performance by relevance feedback. Jornal of the American Society for Information Science, 41(4):288--297, 1990.

[27]

M. Speretta and S. Gauch. Personalized search based on user search histories. In WI '05: Proceedings of IEEE/WIC/ACM International Conference on Web Intelligence, pages 622--628, Washington, DC, USA, 2005. IEEE Computer Society.

Digital Library

[28]

M.-C. Su, S.-Y. Su, and G.-D. Chen. A low-cost vision-based human-computer interface for people with severe disabilities. Biomedical Engineering Applications, Basis, and Communications, 17:284--292, 2005.

[29]

J.-T. Sun, H.-J. Zeng, H. Liu, Y. Lu, and Z. Chen. Cubesvd: a novel approach to personalized web search. In WWW '05: Proceedings of International Conference on World Wide Web, pages 382--390, New York, NY, USA, 2005. ACM.

Digital Library

[30]

R. White, J. M. Jose, and I. Ruthven. Comparing explicit and implicit feedback techniques for web retrieval: Trec-10 interactive track report. In TREC, 2001.

[31]

R. White, I. Ruthven, and J. M. Jose. The use of implicit evidence for relevance feedback in web retrieval. In Proceedings of BCS-IRSG European Colloquium on IR Research, pages 93--109, London, UK, 2002. Springer-Verlag.

Digital Library

[32]

S. Xu, Y. Zhu, H. Jiang, and F. C. M. Lau. A user-oriented webpage ranking algorithm based on user attention time. In AAAI '08: Proceedings of the 23rd AAAI Conference on Artificial Intelligence, pages 1255--1260, Chicago, USA, 2008.

Digital Library

[33]

P. Zielinski. Opengazer: open-source gaze tracker for ordinary webcams, Samsung and The Gatsby Charitable Foundation. http://www.inference.phy.cam.ac.uk/opengazer/, 2007.

Cited By

Lukovics MPrónay SNagy B(2024)Segmented Trust Assessment in Autonomous Vehicles via Eye-TrackingJournal of Intelligent and Connected Vehicles10.26599/JICV.2023.92100377:2(151-161)Online publication date: Jun-2024
https://doi.org/10.26599/JICV.2023.9210037
Zhu HWang CDarmanola VGuo HJin WLi MGanesan DLane NShi W(2024)Bere: A Novel Video Recommender System for Virtual Reality Using Human Behavioral SignalsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690660(770-784)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690660
Khan TRashid UKhan A(2024)End-to-end pseudo relevance feedback based vertical web search queries recommendationMultimedia Tools and Applications10.1007/s11042-024-18559-4Online publication date: 21-Feb-2024
https://doi.org/10.1007/s11042-024-18559-4
Show More Cited By

Index Terms

Personalized online document, image and video recommendation via commodity eye-tracking

Recommendations

User-oriented document summarization through vision-based eye-tracking
IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces

We propose a new document summarization algorithm which is personalized. The key idea is to rely on the attention (reading) time of individual users spent on single words in a document as the essential clue. The prediction of user attention over every ...
Observing facial expressions and gaze positions for personalized webpage recommendation
ICEC '10: Proceedings of the 12th International Conference on Electronic Commerce: Roadmap for the Future of Electronic Business

We propose a new method for personalized webpage recommendation. The method is capable of inferring a user's personal reading interest distribution according to implicit user feedbacks coming from the user's past online reading activities. With the ...
Ranking and Suggesting Popular Items

We consider the problem of ranking the popularity of items and suggesting popular items based on user feedback. User feedback is obtained by iteratively presenting a set of suggested items, and users selecting items based on their own preferences either ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

RecSys '08: Proceedings of the 2008 ACM conference on Recommender systems

October 2008

348 pages

ISBN:9781605580937

DOI:10.1145/1454008

General Chair:
Pearl Pu
Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland
,
Program Chairs:
Derek Bridge
University College Cork, Ireland
,
Bamshad Mobasher
DePaul University, USA
,
Francesco Ricci
Free University Bozen-Bolzano, Italy

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

RecSys08

Sponsor:

RecSys08: ACM Conference on Recommender Systems

October 23 - 25, 2008

Lausanne, Switzerland

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

66
Total Citations
View Citations
1,256
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)2

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lukovics MPrónay SNagy B(2024)Segmented Trust Assessment in Autonomous Vehicles via Eye-TrackingJournal of Intelligent and Connected Vehicles10.26599/JICV.2023.92100377:2(151-161)Online publication date: Jun-2024
https://doi.org/10.26599/JICV.2023.9210037
Zhu HWang CDarmanola VGuo HJin WLi MGanesan DLane NShi W(2024)Bere: A Novel Video Recommender System for Virtual Reality Using Human Behavioral SignalsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690660(770-784)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690660
Khan TRashid UKhan A(2024)End-to-end pseudo relevance feedback based vertical web search queries recommendationMultimedia Tools and Applications10.1007/s11042-024-18559-4Online publication date: 21-Feb-2024
https://doi.org/10.1007/s11042-024-18559-4
Becker VCavalcanti MMelo FSilva TFalcão M(2023)Using Eye Tracking to Map Attention in an EEG-Based Brainwave Graphic Visualization SystemApplications and Usability of Interactive TV10.1007/978-3-031-45611-4_9(129-143)Online publication date: 18-Oct-2023
https://doi.org/10.1007/978-3-031-45611-4_9
Felfernig AWillemsen M(2023)Handling PreferencesGroup Recommender Systems10.1007/978-3-031-44943-7_5(95-107)Online publication date: 23-Sep-2023
https://doi.org/10.1007/978-3-031-44943-7_5
Cavalcanti MMelo FSilva TFalcão Mde Queiroz Cavalcanti DBecker V(2023)Incorporating Eye Tracking into an EEG-Based Brainwave Visualization SystemHuman-Computer Interaction10.1007/978-3-031-35596-7_25(392-403)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35596-7_25
Da Silva TCavalcanti MDe Sá FMarinho ICavalcanti DBecker V(2022)Visualization of brainwaves using EEG to map emotions with eye tracking to identify attention in audiovisual workpiecesProceedings of the Brazilian Symposium on Multimedia and the Web10.1145/3539637.3557055(381-389)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3539637.3557055
Heck MEdinger JBecker C(2022)Lessons Learned from an Eye Tracking Study for Targeted Advertising in the Wild2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops53856.2022.9767470(539-544)Online publication date: 21-Mar-2022
https://doi.org/10.1109/PerComWorkshops53856.2022.9767470
Koorathota SThakoor KHong LMao YAdelman PSajda P(2021)A Recurrent Neural Network for Attenuating Non-cognitive Components of Pupil DynamicsFrontiers in Psychology10.3389/fpsyg.2021.60452212Online publication date: 1-Feb-2021
https://doi.org/10.3389/fpsyg.2021.604522
Brandstetter CSuda FPapariello LDopler FGöschlberger B(2021)Exploring Learning Resource Recommendation Approaches for Secondary EducationThe 23rd International Conference on Information Integration and Web Intelligence10.1145/3487664.3487774(28-33)Online publication date: 29-Nov-2021
https://dl.acm.org/doi/10.1145/3487664.3487774
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten