A Novel Diffusion-Model-Based OCT Image Inpainting Algorithm for Wide Saturation Artifacts
Pages 284 - 295
Abstract
Saturation artifacts in Optical Coherence Tomography (OCT) images will affect the image quality and reduce the accuracy of clinical diagnosis. Recently, the researcher proposed various OCT image inpainting algorithms for saturation artifacts, and these algorithms were limited to .oct format files only (spectral data) or simple interpolation algorithms, which led to the failure of the best performance on wide saturation artifacts. In this paper, a novel image inpainting model based on a generative model (diffusion model) is proposed, which can recover degraded regions in OCT images. Experimental results show that the average PSNR and SSIM values outperformed existing approaches. Besides, the classification models, vision transformer (ViT), for OCT images were implemented to compare the accuracy difference before and after the proposed image inpainting algorithm. The proposed algorithm presents a promising solution for better OCT image inpainting methods.
References
[1]
Chen Y and Hu H An improved method for semantic image inpainting with GANs: progressive inpainting Neural Process. Lett. 2019 49 1355-1367
[2]
Croitoru FA, Hondru V, Ionescu RT, and Shah M Diffusion models in vision: a survey IEEE Trans. Pattern Anal. Mach. Intell. 2023 45 10850-10869
[3]
De Carlo TE, Romano A, Waheed NK, and Duker JS A review of optical coherence tomography angiography (OCTA) Int. J. Retina Vitreous 2015 1 1-15
[4]
Dhariwal P and Nichol A Diffusion models beat GANs on image synthesis Adv. Neural. Inf. Process. Syst. 2021 34 8780-8794
[5]
Dosovitskiy, A., et al.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
[6]
Elharrouss O, Almaadeed N, Al-Maadeed S, and Akbari Y Image inpainting: a review Neural Process. Lett. 2020 51 2007-2028
[7]
Getreuer P Total variation inpainting using split Bregman Image Process. On Line 2012 2 147-157
[8]
Goodfellow I et al. Generative adversarial networks Commun. ACM 2020 63 11 139-144
[9]
Ho J, Jain A, and Abbeel P Denoising diffusion probabilistic models Adv. Neural. Inf. Process. Syst. 2020 33 6840-6851
[10]
Kermany, D.S., et al.: Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5), 1122–1131 (2018)
[11]
Li H, Luo W, and Huang J Localization of diffusion-based inpainting in digital images IEEE Trans. Inf. Forensics Secur. 2017 12 12 3050-3064
[12]
Li, J., Wang, N., Zhang, L., Du, B., Tao, D.: Recurrent feature reasoning for image inpainting. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7760–7768 (2020)
[13]
Liu H, Cao S, Ling Y, and Gan Y Inpainting for saturation artifacts in optical coherence tomography using dictionary-based sparse representation IEEE Photon. J. 2021 13 2 1-10
[14]
Lugmayr, A., Danelljan, M., Romero, A., Yu, F., Timofte, R., Van Gool, L.: Repaint: inpainting using denoising diffusion probabilistic models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11461–11471 (2022)
[15]
Nichol, A.Q., Dhariwal, P.: Improved denoising diffusion probabilistic models. In: International Conference on Machine Learning, pp. 8162–8171. PMLR (2021)
[16]
Shen J, Kang SH, and Chan TF Euler’s elastica and curvature-based inpainting SIAM J. Appl. Math. 2003 63 2 564-592
[17]
Sridevi G and Srinivas Kumar S Image inpainting based on fractional-order nonlinear diffusion for image reconstruction Circuits Syst. Signal Process. 2019 38 3802-3817
[18]
Xu Z and Sun J Image inpainting by patch propagation using patch sparsity IEEE Trans. Image Process. 2010 19 5 1153-1165
[19]
Yan Z, Li X, Li M, Zuo W, and Shan S Ferrari V, Hebert M, Sminchisescu C, and Weiss Y Shift-Net: image inpainting via deep feature rearrangement Computer Vision – ECCV 2018 2018 Cham Springer 3-19
[20]
Zhang X and Chan TF Wavelet inpainting by nonlocal total variation Inverse Probl. Imaging 2010 4 1 191-210
[21]
Zhang, Y.y., Xie, D.: Detection and segmentation of multi-class artifacts in endoscopy. J. Zhejiang Univ. Sci. B 20(12), 1014 (2019)
[22]
Zhao, J., Chen, Z., Zhang, L., Jin, X.: Unsupervised learnable sinogram inpainting network (SIN) for limited angle CT reconstruction. arXiv preprint arXiv:1811.03911 (2018)
Index Terms
- A Novel Diffusion-Model-Based OCT Image Inpainting Algorithm for Wide Saturation Artifacts
Index terms have been assigned to the content through auto-classification.
Recommendations
An Improved Algorithm Based on Exemplar Based Image Inpainting
AIAM 2019: Proceedings of the 2019 International Conference on Artificial Intelligence and Advanced ManufacturingImage restoration technology is an important image processing technology. In image restoration, it not only can reconstruct the loss part of impaired image caused by external factors, but also can remove unwanted parts from the specified image. ...
Image Retrieval Using Digital Image Inpainting Techniques
Image retrieval is an inverse problem in digital image processing. In this paper, the authors deal with restoration of image using digitally image inpainting methods. In this inpainting technique, one can extract a missing an important part or can ...
Nonlocal Curvature-Driven Diffusion Model for Image Inpainting
IAS '09: Proceedings of the 2009 Fifth International Conference on Information Assurance and Security - Volume 02A nonlocal image inpainting model is proposed by incorporating the nonlocal differential operators into the curvature-driven diffusion model. The new model differs from the original model in that pixels of similar structures rather than pixels in the ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Oct 2023
523 pages
ISBN:978-981-99-8557-9
DOI:10.1007/978-981-99-8558-6
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 26 December 2023
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 23 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in