research-article

Saliency-based image editing for guiding visual attention

Authors:

Akihiro Sugimoto,

Kazuhiko KawamotoAuthors Info & Claims

PETMEI '11: Proceedings of the 1st international workshop on pervasive eye tracking & mobile eye-based interaction

Pages 43 - 48

https://doi.org/10.1145/2029956.2029968

Published: 18 September 2011 Publication History

Abstract

The most important part of an information system that assists human activities is a natural interface with human beings. Gaze information strongly reflects the human interest or their attention, and thus, a gaze-based interface is promising for future usage. In particular, if we can smoothly guide the user's visual attention toward a target without interrupting their current visual attention, the usefulness of the gaze-based interface will be highly enhanced. To realize such an interface, this paper proposes a method for editing an image, when given a region in the image, to synthesize the image in which the region is most salient. Our method first computes a saliency map of a given image and then iteratively adjusts the intensity and color until the saliency inside the region becomes the highest for the entire image. Experimental results confirm that our image editing method naturally draws the human visual attention toward our specified region.

References

[1]

G. Abdollahian, C. Taskiran, Z. Pizlo, and E. Delp. Camera motion-based analysis of user generated video. IEEE Transactions on Multimedia, 12(1):28--41, 2009.

Digital Library

[2]

R. Bailey, A. McNamara, N. Sudarsanam, and C. Grimm. Subtle gaze direction. ACM Trans. Graph., 28(100):1--14, 2009.

Digital Library

[3]

J. Collomosse and P. Hall. Painterly rendering using image salience. In Proc. of Eurographics UK Conference (EGUK'02), pages 122--128, 2002.

Digital Library

[4]

D. DeCarlo and A. Santella. Stylization and abstraction of photographs. ACM Trans. Graph., 21:769--776, 2002.

Digital Library

[5]

M. Gangnet, D. Perny, and P. Coueignoux. Perspective mapping of planar textures. Computers & Graphics, 8(2):115--123, 1984.

Digital Library

[6]

H. Greenspan, S. Belongie, R. Goodman, P. Perona, S. Rakshit, and C. Anderson. Overcomplete steerable pyramid filters and rotation invariance. In Proc. of Computer Vision and Pattern Recognition, pages 222--228, 1994.

[7]

M. Imai, T. Ono, and H. Ishiguro. Physical relation and expression: Joint attention for human-robot interaction. IEEE Transactions on Industrial Electronics, 50(4):636--643, 2003.

[8]

L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11):1254--1259, 1998.

Digital Library

[9]

Y. Kim and A. Varshney. Persuading visual attention through geometry. IEEE Transactions on Visualization and Computer Graphics, 14:772--782, 2008.

Digital Library

[10]

C. Koch and S. Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Human neurobiology, 4(4):219--227, 1985.

[11]

A. McNamara, R. Bailey, and C. Grimm. Improving search task performance using subtle gaze direction. In Proc. of the 5th symposium on Applied perception in graphics and visualization (APGV'08), pages 51--56, 2008.

Digital Library

[12]

Y. Ogata and K. Uchikawa. Does a stimulus not detected induce saccade? Journal of Vision, 9(14):47, 2009.

[13]

T. Razali, R. Zhu, K. Yoshinori, and K. Yoshinori. Smart wheelchair navigation based on user's gaze on destination. In Proc. of Intelligent Computing in Computer Vision, 3, pages 387--394, 2010.

[14]

K. Sakita, K. Ogawara, S. Murakami, K. Kawamura, and K. Ikeuchi. Flexible cooperation between human and robot by interpreting human intention from gaze information. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pages 845--851, 2004.

[15]

A. Santella, M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen. Gaze-based interaction for semi-automatic photo cropping. In Proc. of CHI '06, pages 771--780, 2006.

Digital Library

[16]

E. Veas, E. Mendez, S. Feiner, and D. Schmalstieg. Directing attention and influencing memory with visual saliency modulation. In Proc. of CHI'11, 2011.

Digital Library

[17]

M. Verma and P. McOwan. Generating customised experimental stimuli for visual search using genetic algorithms shows evidence for a continuum of search efficiency. Vision research, 49(3):374--382, 2009.

Cited By

Kohtani AMiyafuji SUragaki KKatsuyama HKoike H(2024)MOSion: Gaze Guidance with Motion-triggered Visual Cues by Mosaic PatternsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642577(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642577
Prawiro HPan TYang CHuang CHu M(2024)Towards Efficient Visual Attention Prediction for 360 Degree Videos2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)10.1109/AIxVR59861.2024.00014(50-59)Online publication date: 17-Jan-2024
https://doi.org/10.1109/AIxVR59861.2024.00014
Liu ZHayat MYang HPeng DLei Y(2023)Deep Hypersphere Feature Regularization for Weakly Supervised RGB-D Salient Object DetectionIEEE Transactions on Image Processing10.1109/TIP.2023.331895332(5423-5437)Online publication date: 2023
https://doi.org/10.1109/TIP.2023.3318953
Show More Cited By

Index Terms

Saliency-based image editing for guiding visual attention
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks

Recommendations

Visual attention analysis and prediction on human faces

Human faces are almost always the focus of visual attention because of the rich semantic information therein. While some visual attention models incorporating face cues indeed perform better in images with faces, yet there is no systematic analysis of ...
Keyframe-Based Video Summary Using Visual Attention Clues

A visual attention index descriptor based on a visual attention model bridges the semantic gap between low-level descriptors used by computers and high-level concepts perceived by humans.
Assessing the contribution of color in visual attention
Special issue: Attention and performance in computer vision

Visual attention is the ability of a vision system, be it biological or artificial, to rapidly detect potentially relevant parts of a visual scene, on which higher level vision tasks, such as object recognition, can focus. The saliency-based model of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

PETMEI '11: Proceedings of the 1st international workshop on pervasive eye tracking & mobile eye-based interaction

September 2011

64 pages

ISBN:9781450309301

DOI:10.1145/2029956

Program Chairs:
Andreas Bulling
University of Cambridge and Lancaster University, UK
,
Andrew T. Duchowski
Clemson University, USA
,
Päivi Majaranta
University of Tampere, Finland

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

University of Florida: University of Florida
SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Ubicomp '11

Sponsor:

Ubicomp '11: The 2011 ACM Conference on Ubiquitous Computing

September 18, 2011

Beijing, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
563
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)8

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kohtani AMiyafuji SUragaki KKatsuyama HKoike H(2024)MOSion: Gaze Guidance with Motion-triggered Visual Cues by Mosaic PatternsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642577(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642577
Prawiro HPan TYang CHuang CHu M(2024)Towards Efficient Visual Attention Prediction for 360 Degree Videos2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)10.1109/AIxVR59861.2024.00014(50-59)Online publication date: 17-Jan-2024
https://doi.org/10.1109/AIxVR59861.2024.00014
Liu ZHayat MYang HPeng DLei Y(2023)Deep Hypersphere Feature Regularization for Weakly Supervised RGB-D Salient Object DetectionIEEE Transactions on Image Processing10.1109/TIP.2023.331895332(5423-5437)Online publication date: 2023
https://doi.org/10.1109/TIP.2023.3318953
Miangoleh SBylinskii ZKee EShechtman EAksoy Y(2023)Realistic Saliency Guided Image Enhancement2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00026(186-194)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00026
Thu NHossain MHuh E(2023)EC2Net: Efficient Attention-Based Cross-Context Network for Near Real-Time Salient Object DetectionIEEE Access10.1109/ACCESS.2023.326811411(39845-39854)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3268114
Zhang Q(2022)Programmable Peripheral Vision: augment/reshape human visual perceptionExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3503821(1-5)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3503821
Zhang QHuang YChernyshov GLi JPai YKunze K(2022)GazeSync: Eye Movement Transfer Using an Optical Eye Tracker and Monochrome Liquid Crystal DisplaysCompanion Proceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490100.3516469(54-57)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490100.3516469
Aberman KHe JGandelsman YMosseri IJacobs DKohlhoff KPritch YRubinstein M(2022)Deep Saliency Prior for Reducing Visual Distraction2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01923(19819-19828)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01923
Hirsch LSchneegass CWelsch RButz A(2021)To See or Not to SeeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34481235:1(1-25)Online publication date: 30-Mar-2021
https://dl.acm.org/doi/10.1145/3448123
Jiang LXu MWang XSigal L(2021)Saliency-Guided Image Translation2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.01624(16504-16513)Online publication date: Jun-2021
https://doi.org/10.1109/CVPR46437.2021.01624
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents