Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Image retargeting using RGB-D camera

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Forimage retargeting, most approaches only use color information to tackle this problem. In this paper, we analyze both color and depth information captured by a RGB-D camera to maintain the structure and preserve important regions. Particularly, we present a content-aware image retargeting algorithm based on depth information. In addition, we introduce a depth-based importance map, such that deformation of the image is guided by this map. This depth-based importance map is produced automatically by combining gradient, salience, and depth-based measures. More specifically, the depth-based measure is a weight map, in which we analyze depth information and use the mean shift procedure to find the local peak as the central of the important objects, and apply Gaussian distribution to determine the weight. Consequently, this depth-based importance map is used as the input of the discontinuous seam carving algorithm, and the seam is processed by the dynamic programming method. Our experimental results demonstrate the effectiveness of using the depth-based importance map in the discontinuous seam carving algorithm that it can visually behave better in maintaining the structure and preserving important regions. The proposed method produces much better results than other approaches, that are the state-of-the-art in content-aware image resizing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. In: ACM transactions on graphics (TOG), vol 26, p 10

  2. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Article  Google Scholar 

  3. Eriksen BA, Eriksen CW (1974) Effects of noise letters upon the identification of a target letter in a nonsearch task. Percept Psychophys 16(1):143–149

    Article  MathSciNet  Google Scholar 

  4. Eriksen CW, Hoffman JE (1973) The extent of processing of noise elements during selective encoding from visual displays. Percept Psychophys 14(1):155–160

    Article  Google Scholar 

  5. Fox E (1998) Perceptual grouping and visual selective attention. Percept Psychophys 60(6):1004–1021

    Article  Google Scholar 

  6. Frankovich M, Wong A (2011) Enhanced seam carving via integration of energy gradient functionals. IEEE Signal Proc Lett 18(6):375–378

    Article  Google Scholar 

  7. Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):1915–1926

    Article  Google Scholar 

  8. Grundmann M, Kwatra V, Han M, Essa I (2010) Discontinuous seam-carving for video retargeting. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 569–576

  9. Juola JF, Bouwhuis DG, Cooper EE, Warner CB (1991) Control of attention around the fovea. J Exp Psychol Hum Percept Perform 17(1):125–141

    Article  Google Scholar 

  10. Kahneman D, Treisman A, Gibbs BJ (1992) The reviewing of object files: object-specific integration of information. Cogn Psychol 24(2):175–219

    Article  Google Scholar 

  11. Kim J-S, Jeong S-G, Joo Y, Kim C-S (2011) Content-aware image and video resizing based on frequency domain analysis. IEEE Trans Consum Electron 57(2):615–622

    Article  Google Scholar 

  12. Kim W, Kim C (2011) A texture-aware salient edge model for image retargeting. IEEE Signal Proc Lett 18(11):631–634

    Article  Google Scholar 

  13. Lamb MR, Yund EW (2000) The role of spatial frequency in cued shifts of attention between global and local forms. Percept Psychophys 62(4):753–761

    Article  Google Scholar 

  14. Li J-H, Yeh S-L (2004) The selection basis of visual attention: space-based or object-based? Res Appl Psychol 21:165–194

    Google Scholar 

  15. Mansfield A, Gehler P, Van Gool L, Rother C (2010) Scene carving: scene consistent image retargeting. In: European conference on computer vision (ECCV), pp 143–156

  16. Mansfield A, Gehler P, Van Gool L, Rother C (2012) Visibility maps for improving seam carving. In: European conference on trends and topics in computer vision, pp 131–144

  17. Niu Y, Geng Y, Li X, Liu F (2012) Leveraging stereopsis for saliency analysis. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 454–461

  18. Pritch Y, Kav-Venaki E, Peleg S (2009) Shift-map image editing. In: International conference on computer vision (ICCV), pp 151–158

  19. Rubinstein M, Gutierrez D, Sorkine O, Shamir A (2010) A comparative study of image retargeting. In: ACM transactions on graphics (TOG), vol 29, p 160

  20. Rubinstein M, Shamir A, Avidan S (2008) Improved seam carving for video retargeting. In: ACM transactions on graphics (TOG), vol 27, p 16

  21. Sung Y-H, Tseng W-Y, Lin P-H, Kang L-W, Lin C-Y, Yeh C-H (2013) Significance-preserving-guided content-aware image retargeting. In: Advances in intelligent systems and applications, pp 339–348

  22. Wang Y-S, Tai C-L, Sorkine O, Lee T-Y (2008) Optimized scale-and-stretch for image resizing. ACM Trans Graph (TOG) 27(5)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, National Chung Cheng University, Chiayi, Taiwan

    Wei-Yang Lin, Pei-Chen Wu & Bo-Rong Chen

  2. Department of Information Management, National Central University, Taoyuan County, 32001, Taiwan

    Chih-Fong Tsai

Authors
  1. Wei-Yang Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chih-Fong Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pei-Chen Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bo-Rong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei-Yang Lin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lin, WY., Tsai, CF., Wu, PC. et al. Image retargeting using RGB-D camera. Multimed Tools Appl 74, 3155–3170 (2015). https://doi.org/10.1007/s11042-013-1776-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1776-2

Keywords

Search

Navigation