Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Saliency detection based on seed propagation in a multilayer graph

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a saliency detection algorithm based on the seed propagation in graph representation of image. First, the image is divided into over-segmented regions and a graph of the connected regions (nodes) with color similarity (edge weight) is constructed. Second, saliency seeds and background seeds are extracted based on contrast and boundary prior respectively. The contrast prior is used to select the regions to be used as saliency seeds, because salient regions usually have high contrast. Meanwhile, the regions for the background seeds are extracted from image boundaries, based on the observation that salient objects are seldom located on the image boundaries. Finally, using a semi-supervised learning framework, both saliency and background seeds are propagated to the entire nodes and the saliency of each node is calculated from the propagated results. In addition, we introduce a multilayer graph to further improve the performance, which makes the saliency values within an object more uniform. Comparison with the state-of-the-art methods shows that our algorithm yields comparable or better results on several datasets in terms of precision-recall curve, ROC curve, F-measure and area under ROC curve, and also show visually plausible results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Achanta R, Estrada F, Wils P, Süsstrunk S (2008) Salient region detection and segmentation. In: Computer Vision Systems, Lecture Notes in Computer Science, vol 5008. Springer, pp 66–75

  2. Achanta R, Hemami S, Estrada F, Süsstrunk S (2009) Frequency-tuned salient region detection. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1597–1604

  3. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Analysis and Machine Intelligence 34(11):2274–2282

    Article  Google Scholar 

  4. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. ACM Trans Graph 26(3):10:1–10:10

    Article  Google Scholar 

  5. Borji A, Sihite D, Itti L (2012) Salient object detection: A benchmark. In: Computer Vision – ECCV 2012, Lecture Notes in Computer Science, vol 7573. Springer, pp 414–429

  6. Cheng MM, Zhang GX, Mitra NJ, Huang X, Hu S M (2011) Global contrast based salient region detection. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 409–416

  7. Cheng MM, Warrell J, Lin WY, Zheng S, Vineet V, Crook N (2013) Efficient salient region detection with soft image abstraction. In: 2013 IEEE International Conference on Computer Vision (ICCV). IEEE, pp 1529–1536

  8. Cheng MM, Mitra NJ, Huang X, Hu SM (2014) Salientshape: Group saliency in image collections. Vis Comput 30(4):443–453

    Article  Google Scholar 

  9. Cheng MM, Mitra NJ, Huang X, Torr PH, Hu S (2015) Global contrast based salient region detection. IEEE Trans Pattern Analysis and Machine Intelligence 37(3):569–582

    Article  Google Scholar 

  10. Farbman Z, Fattal R, Lischinski D, Szeliski R (2008) Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans Graph 27(3):67:1–67:10

    Article  Google Scholar 

  11. Gopalakrishnan V, Hu Y, Rajan D (2010) Random walks on graphs for salient object detection in images. IEEE Trans Image Process 19(12):3232–3242

    Article  MathSciNet  MATH  Google Scholar 

  12. Guo C, Ma Q, Zhang L (2008) Spatio-temporal saliency detection using phase spectrum of quaternion Fourier transform. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1–8

  13. Harel J, Koch C, Perona P (2007) Graph-based visual saliency. In: Advances in Neural Information Processing Systems, pp 545–552

  14. Hou X, Zhang L (2007) Saliency detection : A spectral residual approach. In: 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1–8

  15. Hu G, Zhao Y, Yuan Y, Gu D (2012) Local stereo matching with canny segmentation and reliable seed propagation. In: 2012 International Conference on Computer Vision in Remote Sensing (CVRS). IEEE, pp 177–182

  16. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Analysis and Machine Intelligence 20(11):1254–1259

    Article  Google Scholar 

  17. Jiang B, Zhang L, Lu H, Yang C, Yang M H (2013) Saliency detection via absorbing markov chain. In: 2013 IEEE International Conference on Computer Vision (ICCV). IEEE, pp 1665–1672

  18. Kim JS, Sim JY, Kim CS (2014) Multiscale saliency detection using random walk with restart. IEEE Trans Circuits Systems for Video Technology 24(2):198–210

    Article  Google Scholar 

  19. Kim TH, Lee KM, Lee SU (2013) Learning full pairwise affinities for spectral segmentation. IEEE Trans Pattern Analysis and Machine Intelligence 35(7):1690–1703

    Article  Google Scholar 

  20. Liu T, Yuan Z, Sun J, Wang J, Zheng N, Tang X, Shum HY (2011) Learning to detect a salient object. IEEE Trans Pattern Analysis and Machine Intelligence 33(2):353–367

    Article  Google Scholar 

  21. Lu S, Mahadevan V, Vasconcelos N (2014) Learning optimal seeds for diffusion-based salient object detection. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 2790–2797

  22. Mansfield A, Gehler P, Van Gool L, Rother C (2012) Visibility maps for improving seam carving. In: Trends and Topics in Computer Vision, Lecture Notes in Computer Science, vol 6554. Springer, pp 131–144

  23. Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: 1998 IEEE International Conference on Computer Vision (ICCV). IEEE, pp 839–846

  24. Wei Y, Wen F, Zhu W, Sun J (2012) Geodesic saliency using background priors. In: Computer Vision - ECCV 2012, Lecture Notes in Computer Science, vol 7574. Springer, pp 29–42

  25. Yan Q, Xu L, Shi J, Jia J (2013) Hierarchical saliency detection. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 1155–1162

  26. Yang C, Zhang L, Lu H (2013a) Graph-regularized saliency detection with convex-hull-based center prior. IEEE Signal Proc Letters 20(7):637–640

    Article  Google Scholar 

  27. Yang C, Zhang L, Lu H, Ruan X, Yang MH (2013b) Saliency detection via graph-based manifold ranking. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 3166–3173

  28. Zhou D, Bousquet O, Lal TN, Weston J, Schölkopf B (2004) Learning with local and global consistency. In: Advances in Neural Information Processing Systems, pp 321–328

  29. Zhou L, Hu R, Qian Y, Chen HH (2013) Energy-spectrum efficiency tradeoff for video streaming over mobile ad hoc networks. IEEE J Selected Areas in Communications 31(5):981–991

    Article  Google Scholar 

Download references

Acknowledgments

This research was supported by Projects for Research and Development of Police science and Technology under Center for Research and Development of Police science and Technology and Korean National Police Agency funded by the Ministry of Science, ICT and Future Planning (PA-C000001).

Author information

Authors and Affiliations

  1. INMC, Department of Electrical and Computer Engineering, Seoul National University, Seoul, 151-742, South Korea

    Insung Hwang, Sang Hwa Lee, Jae Sung Park & Nam Ik Cho

  2. Visual Display Division, SAMSUNG Electronics Co. Ltd., Suwon, 443-742, South Korea

    Jae Sung Park

Authors
  1. Insung Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sang Hwa Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jae Sung Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nam Ik Cho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nam Ik Cho.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hwang, I., Lee, S.H., Park, J.S. et al. Saliency detection based on seed propagation in a multilayer graph. Multimed Tools Appl 76, 2111–2129 (2017). https://doi.org/10.1007/s11042-015-3171-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-3171-7

Keywords

Search

Navigation