Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3653804.3656268acmotherconferencesArticle/Chapter ViewAbstractPublication PagescvdlConference Proceedingsconference-collections
research-article

Infrared Spectral Deconvolution Algorithm Based on Masked Pre-training Transformer

Published: 01 June 2024 Publication History

Abstract

Nowadays, infrared spectral analysis technology has been widely used in various fields in real life, however, infrared spectral signals are susceptible to degradation and contamination due to the aging of infrared spectrometer equipment, bandwidth overlap, and random noise. In order to improve the quality and reliability of IR spectral signals, denoising and reconstruction are important preprocessing steps. To address these challenges, a masked pre-trained Transformer model is proposed in this paper. To train the model's ability to suppress noise in IR spectra, the encoder randomly masks the IR spectral sequences during pre-training, and the decoder reconstructs the masked inputs, which can greatly enhance the downstream spectral predictor with the learnt hidden representations. The masking strategy makes the learned representation more robust by capturing the dependencies between IR spectral sequences for feature extraction. The experiments are compared with the current state-of-the-art deconvolution technique, and the experimental results show that the method has excellent deconvolution performance and is able to effectively recover the texture details of the infrared spectrum.
Keywords: Infrared Spectroscopy; spectral deconvolution; Masking strategy, Transformer.

References

[1]
H. Zhu, H. Ni, S. Liu, G. Xu, and L. Deng, “Tnlrs: Target-aware non-local low-rank modeling with saliency filtering regularization for infrared small target detection,” IEEE Transactions on Image Processing, vol. 29, pp. 9546–9558, 2020.
[2]
He, Chunming, "Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Grouping." arXiv preprint arXiv:2305.11003 (2023).
[3]
He, Chunming, "Degradation-resistant unfolding network for heterogeneous image fusion." Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023.
[4]
H Deng, Lizhen, "PcGAN: A noise robust conditional generative adversarial network for one shot learning." IEEE Transactions on Intelligent Transportation Systems 23.12 (2022): 25249-25258.
[5]
Ren, Wenqi, "Deep non-blind deconvolution via generalized low-rank approximation." Advances in neural information processing systems 31 (2018).
[6]
Zhu, Hu, "Spectral semi-blind deconvolution methods based on modified ϕHS regularizations." Optics & Laser Technology 110 (2019): 24-29.
[7]
Liu, Xionghua, "Infrared blind spectral deconvolution with low-rank sparse regularization for small object tracking." Infrared Physics & Technology 133 (2023): 104803.
[8]
Zhu, Hu, "Dspnet: A lightweight dilated convolution neural networks for spectral deconvolution with self-paced learning." IEEE Transactions on Industrial Informatics 16.12 (2019): 7392-7401.
[9]
Deng, Lizhen, "A dual stream spectrum deconvolution neural network." IEEE Transactions on Industrial Informatics 18.5 (2021): 3086-3094.
[10]
Han, Kai, "Transformer in transformer." Advances in Neural Information Processing Systems 34 (2021): 15908-15919.
[11]
Hodson, Timothy O. "Root-mean-square error (RMSE) or mean absolute error (MAE): When to use them or not." Geoscientific Model Development 15.14 (2022): 5481-5487.
[12]
Chatterjee, Sourav. "A new coefficient of correlation." Journal of the American Statistical Association 116.536 (2021): 2009-2022.
[13]
Zhang, Hong-yu, "An improved weighted correlation coefficient based on integrated weight for interval neutrosophic sets and its application in multi-criteria decision-making problems." International Journal of Computational Intelligence Systems 8.6 (2015): 1027-1043.
[14]
Deng, Lizhen, "Unpaired Self-supervised Learning for Industrial Cyber-Manufacturing Spectrum Blind Deconvolution." ACM Transactions on Internet Technology (2023).
[15]
Zhu, Hu, "Deconvolution methods based on convex regularization for spectral resolution enhancement." Computers & Electrical Engineering 70 (2018): 959-967.
[16]
Arjovsky, Martin, Soumith Chintala, and Léon Bottou. "Wasserstein generative adversarial networks." International conference on machine learning. PMLR, 2017.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
CVDL '24: Proceedings of the International Conference on Computer Vision and Deep Learning
January 2024
506 pages
ISBN:9798400718199
DOI:10.1145/3653804
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2024

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

CVDL 2024

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 22
    Total Downloads
  • Downloads (Last 12 months)22
  • Downloads (Last 6 weeks)5
Reflects downloads up to 14 Nov 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media