research-article

Exemplar-based image inpainting using structure consistent patch matching

Authors:

Xiao-Xin LiAuthors Info & Claims

Neurocomputing, Volume 269, Issue C

Pages 90 - 96

https://doi.org/10.1016/j.neucom.2016.08.149

Published: 20 December 2017 Publication History

Abstract

Image inpainting restores lost or deteriorated parts of images according to the information of known regions. Criminisi has proposed an effective exemplar-based inpainting method, which has the advantages of both texture synthesis and diffusion-based inpainting. Yet, it has its own flaws of fast priority dropping and visual inconsistency. In this paper, we propose a space varying updating strategy for the confidence term and a matching confidence term to improve the filling priority estimation. We propose structure consistent patch matching to take the distribution of source and target patch differences into account. Fast Fourier transform is adapted for full image searching to achieve better and faster matching results. Experimental results are given to demonstrate the improvements made by our proposed method.

References

[1]

J. Wang, K. Lu, D. Pan, N. He, B. Bao, Robust object removal with an exemplar-based image inpainting approach, Neurocomputing, 123 (2014) 150-155.

Digital Library

[2]

D.Q. Chen, Y. Zhou, Inexact alternating direction method based on proximity projection operator for image inpainting in wavelet domain, Neurocomputing, 189 (2016) 145-159.

Digital Library

[3]

T. Wen, F. Yang, J. Gu, L. Wang, A novel Bayesian-based nonlocal reconstruction method for freehand 3D ultrasound imaging, Neurocomputing, 168 (2015) 104-118.

Digital Library

[4]

M. Bertalmio, G. Sapiro, V. Caselles, C. Ballester, Image inpainting, in: Proc. ACM SIGGRAPH, New Orleans, Louisiana, 2000, pp. 417-424.

[5]

T.F. Chan, J. Shen, Mathematical models for local nontexture inpaintings, SIAM J. Appl. Math. (2002) 1019-1043.

[6]

T.F. Chan, J. Shen, Non-Texture Inpainting by Curvature-Driven Diffusion (CCD), J.Vis. Commun. Image Represent., 12 (2001) 436-449.

Digital Library

[7]

A. Efros, T. Leung, Texture synthesis by non-parametric sampling, in: Proc. ICCV, Kerkyra, Greece, 1999, pp. 1033-1038.

[8]

L. Wei, M. Levoy, Fast texture synthesis using tree-structured vector quantization, in: Proc. ACM SIGGRAPH, 2000, pp. 479-488.

Digital Library

[9]

M. Ashikhmin, Synthesizing natural textures, in: Proc. ACM Symposium Interactive 3D Graphics, 2001, pp. 217-226.

[10]

Y. Wexler, E. Shechtman, M. Irani, Space-time video completion, in: Proc. IEEE Computer Society Conference Computer Vision and Pattern Recognition, 1, 2004, pp. 120-127.

[11]

A. Criminisi, P. Prez, K. Toyama, Region filling and object removal by exemplar-based inpainting, IEEE Trans. Image Process., 13 (2004) 1200-1212.

Digital Library

[12]

J. Hays, A.A. Efros, Scene completion using millions of photographs, Commun. ACM, 51 (2015) 87-94.

[13]

W.H. Cheng, C.W. Hsieh, S.K. Lin, Robust algorithm for exemplar-based image inpainting, in: The International Conference on Computer Graphics, Imaging and Vision (CGIV), Beijing, China, 2002, pp. 65-69.

[14]

A. Bugeau, M. Bertalmio, V. Caselles, G. Sapiro, A comprehensive framework for image inpainting, IEEE Trans. Image Process., 19 (2010) 2634-2645.

Digital Library

[15]

S. Kumar, M. Biswas, S.J. Belongie, T.Q. Nguyen, Spatio-temporal texture synthesis and image inpainting for video applications, in: International Conference on Image Processing, 2005, pp. 85-88.

Cited By

Ge YSun LWang D(2023)A novel image reconstruction algorithm based on texture aware multiscale GAN for veneer defectsJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23169245:6(9753-9769)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.3233/JIFS-231692
Xu YPagnucco MSong Y(2023)An edge guided coarse-to-fine generative network for image outpaintingNeurocomputing10.1016/j.neucom.2023.126254541:COnline publication date: 7-Jul-2023
https://dl.acm.org/doi/10.1016/j.neucom.2023.126254
Patil B(2022)Effect of Optimized Deep Belief Network to Patch-Based Image Inpainting ForensicsInternational Journal of Swarm Intelligence Research10.4018/IJSIR.30440113:3(1-21)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.4018/IJSIR.304401
Show More Cited By

Exemplar-based image inpainting using structure consistent patch matching
1. Computing methodologies
  1. Artificial intelligence
  2. Computer graphics

Recommendations

An Improved Algorithm Based on Exemplar Based Image Inpainting
AIAM 2019: Proceedings of the 2019 International Conference on Artificial Intelligence and Advanced Manufacturing

Image restoration technology is an important image processing technology. In image restoration, it not only can reconstruct the loss part of impaired image caused by external factors, but also can remove unwanted parts from the specified image. ...
Enhanced adaptive patch based exemplar image inpainting
DATA '19: Proceedings of the Second International Conference on Data Science, E-Learning and Information Systems

Image inpainting is a process in which missing or deteriorated portions of an image is reconstructed. In the proposed framework, an adaptive patch updating strategy for the basic Criminisi's exemplar-based image inpainting is implemented. Patch matching ...
Iterative gradient-driven patch-based inpainting
PSIVT'11: Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part II

A novel exemplar-based image inpainting is proposed in this paper. This method is based on iterative approach which provides better result than greedy one. The problem of inconsistent results caused by raster scanning on target patch selection in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Neurocomputing

Neurocomputing Volume 269, Issue C

December 2017

246 pages

ISSN:0925-2312

Issue’s Table of Contents

Copyright © Elsevier B.V.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 20 December 2017

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ge YSun LWang D(2023)A novel image reconstruction algorithm based on texture aware multiscale GAN for veneer defectsJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-23169245:6(9753-9769)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.3233/JIFS-231692
Xu YPagnucco MSong Y(2023)An edge guided coarse-to-fine generative network for image outpaintingNeurocomputing10.1016/j.neucom.2023.126254541:COnline publication date: 7-Jul-2023
https://dl.acm.org/doi/10.1016/j.neucom.2023.126254
Patil B(2022)Effect of Optimized Deep Belief Network to Patch-Based Image Inpainting ForensicsInternational Journal of Swarm Intelligence Research10.4018/IJSIR.30440113:3(1-21)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.4018/IJSIR.304401
Liu KLi JHussain Bukhari S(2022)Overview of Image Inpainting and Forensic TechnologySecurity and Communication Networks10.1155/2022/92919712022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/9291971
Yang SWang YCai HChen X(2022)Residual inpainting using selective free-form attentionNeurocomputing10.1016/j.neucom.2022.09.041510:C(149-158)Online publication date: 21-Oct-2022
https://dl.acm.org/doi/10.1016/j.neucom.2022.09.041
Le Hégarat-Mascle SAldea E(2022)Spectral Analysis of Masked Signals in the Context of Image InpaintingImage Analysis and Processing. ICIAP 2022 Workshops10.1007/978-3-031-13321-3_10(105-114)Online publication date: 23-May-2022
https://dl.acm.org/doi/10.1007/978-3-031-13321-3_10
Maiti SKumar AJain SBhatnagar G(2021)A Novel Image Inpainting Framework Using RegressionACM Transactions on Internet Technology10.1145/340217721:3(1-16)Online publication date: 16-Jun-2021
https://dl.acm.org/doi/10.1145/3402177
Yaghmaee FPeyvandi K(2020)Improving image inpainting quality by a new SVD-based decompositionMultimedia Tools and Applications10.1007/s11042-020-08650-x79:19-20(13795-13809)Online publication date: 1-May-2020
https://dl.acm.org/doi/10.1007/s11042-020-08650-x
Talat RMuzammal MShan R(2020)A decentralised approach to scene completion using distributed feature hashgramMultimedia Tools and Applications10.1007/s11042-019-08403-579:15-16(9799-9817)Online publication date: 1-Apr-2020
https://dl.acm.org/doi/10.1007/s11042-019-08403-5
J. SKovoor BHoballah IZeineddine HAljawarneh SLara J(2019)Enhanced adaptive patch based exemplar image inpaintingProceedings of the Second International Conference on Data Science, E-Learning and Information Systems10.1145/3368691.3368699(1-6)Online publication date: 2-Dec-2019
https://dl.acm.org/doi/10.1145/3368691.3368699
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents