Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Automated catastrophic optical damage inspection of semiconductor laser chip based on multi-scale strip convolution aggregation

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Catastrophic optical damage (COD) is one of the reasons limiting the output power and lifetime of semiconductor lasers. Nevertheless, the automatic defects inspection of the COD is a challenging task due to several factors, including the micron-scale size of the laser chip, poor contrast, the notable similarities in defect features across different categories, and the fact that defects occupy a minimal portion of image pixels in the images. In this work, We first design and implement a data acquisition and inspection system to collect micron-scale laser chip electroluminescence (EL) images. Secondly, we establish a laser chip COD dataset for training. Finally, a novel COD detection network (CODDNet) is proposed to construct an end-to-end defect detection method. To better extract strip-like COD features under poor contrast, a strip convolution is proposed to acquire more discriminative features and reduce the parameters. A multi-scale strip convolution aggregation structure is proposed to extract richer information across different defect categories from the network to obtain multi-scale feature maps. To address the class imbalance issue between defect and the background, an attention module is embedded into the block to emphasize the COD defects. The experimental results demonstrated that the proposed CODDNet could achieve a higher inspection accuracy and faster inference speed with fewer parameters. Based on the proposed method, manufacturers could take corresponding effective measures to improve the stability of laser chips. In the future, we will continue to expand the COD dataset and conduct research on defect detection for different types of laser chips.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

The dataset generated during the current study is available from the corresponding author on reasonable request.

References

  1. Kundu I, Wang F, Qi X, Nong H, Dean P, Freeman JR, Valavanis A, Agnew G, Grier AT, Taimre T, Li L, Indjin D, Mangeney J, Tignon J, Dhillon SS, Rakić AD, Cunningham JE, Linfield EH, Davies AG (2018) Ultrafast switch-on dynamics of frequency-tuneable semiconductor lasers. Nat Commun 9(1):3076

    Article  Google Scholar 

  2. Welch DF (2000) A brief history of high-power semiconductor lasers. IEEE J Sel Top Quantum Electron 6(6):1470–1477

    Article  Google Scholar 

  3. Yun SH, Boudoux C, Pierce MC, Boer JF, Tearney GJ, Bouma BE (2004) Extended-cavity semiconductor wavelength-swept laser for biomedical imaging. IEEE Photonics Technol Lett 16(1):293–295

    Article  Google Scholar 

  4. Yoshida M, De Zoysa M, Ishizaki K, Tanaka Y, Kawasaki M, Hatsuda R, Song B, Gelleta J, Noda S (2019) Double-lattice photonic-crystal resonators enabling high-brightness semiconductor lasers with symmetric narrow-divergence beams. Nat Mater 18(2):121–128

    Article  Google Scholar 

  5. Li L, Xie Y, Liu B, Xiao Y, Ye Y, Song T, Zhang Y, Liu Y (2019) Optical image encryption and transmission with semiconductor lasers. Opt Laser Technol 119:105616

    Article  Google Scholar 

  6. Hempel M, Dadgostar S, Jiménez J, Kernke R, Gollhardt A, Tomm JW (2022) Catastrophic optical damage in semiconductor lasers: Physics and new results on InGaN high-power diode lasers. Phys Status Solidi RRL 16(4):2100527

    Article  Google Scholar 

  7. Zhang S, Feng S, Zhang Y, An Z, Yang H, He X, Wang X, Qiao Y (2017) Monitoring of early catastrophic optical damage in laser diodes based on facet reflectivity measurement. Appl Phys Lett 110(22):223503

    Article  Google Scholar 

  8. Bou Sanayeh M, Jaeger A, Schmid W, Tautz S, Brick P, Streubel K, Bacher G (2006) Investigation of dark line defects induced by catastrophic optical damage in broad-area AlGaInP laser diodes. Appl Phys Lett 89(10):101111

    Article  Google Scholar 

  9. Pura JL, Souto J, Jiménez J (2020) Effect of thermal lensing and the micrometric degraded regions on the catastrophic optical damage process of high-power laser diodes. Opt Lett 45(7):1667–1670

    Article  Google Scholar 

  10. Henry CH, Petroff PM, Logan RA, Merritt FR (2008) Catastrophic damage of \({\rm Al}_{x}{\rm Ga}_{1-x}\)As double-heterostructure laser material. J Appl Phys 50(5):3721–3732

    Article  Google Scholar 

  11. Sin Y, Lingley Z, Presser N, Brodie M, Ives N, Moss SC (2017) Catastrophic optical bulk damage in high-power InGaAs-AlGaAs strained quantum well lasers. IEEE J Sel Top Quantum Electron 23(6):1–13

    Article  Google Scholar 

  12. Ressel P, Erbert G, Zeimer U, Hausler K, Beister G, Sumpf B, Klehr A, Trankle G (2005) Novel passivation process for the mirror facets of Al-free active-region high-power semiconductor diode lasers. IEEE Photonics Technol Lett 17(5):962–964

    Article  Google Scholar 

  13. Souto J, Pura JL, Jiménez J (2017) Nanoscale effects on the thermal and mechanical properties of AlGaAs/GaAs quantum well laser diodes: influence on the catastrophic optical damage. J Phys D Appl Phys 50(23):235101

    Article  Google Scholar 

  14. Wen G, Gao Z, Cai Q, Wang Y, Mei S (2020) A novel method based on deep convolutional neural networks for wafer semiconductor surface defect inspection. IEEE Trans Instrum Meas 69(12):9668–9680

    Article  Google Scholar 

  15. Zheng X, Zheng S, Kong Y, Chen J (2021) Recent advances in surface defect inspection of industrial products using deep learning techniques. Int J Adv Manuf Tech 113(1):35–58

    Article  Google Scholar 

  16. Jiang BC, Wang CC, Liu HC (2005) Liquid crystal display surface uniformity defect inspection using analysis of variance and exponentially weighted moving average techniques. Int J Prod Res 43(1):67–80

    Article  Google Scholar 

  17. Li W-C, Tsai D-M (2012) Wavelet-based defect detection in solar wafer images with inhomogeneous texture. Pattern Recognit 45(2):742–756

    Article  Google Scholar 

  18. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297

    Article  Google Scholar 

  19. Lu Z, He Q, Xiang X, Liu H (2018) Defect detection of PCB based on Bayes feature fusion. J Eng 2018(16):1741–1745

    Google Scholar 

  20. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1. pp. 886–8931 (2005)

  21. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recognit 29(1):51–59

    Article  Google Scholar 

  22. Wen L, Li X, Gao L, Zhang Y (2017) A new convolutional neural network-based data-driven fault diagnosis method. IEEE Trans Ind Electron 65(7):5990–5998

    Article  Google Scholar 

  23. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444

    Article  Google Scholar 

  24. Lin H, Li B, Wang X, Shu Y, Niu S (2019) Automated defect inspection of LED chip using deep convolutional neural network. J Intell Manuf 30(6):2525–2534

    Article  Google Scholar 

  25. Chen H, Pang Y, Hu Q, Liu K (2020) Solar cell surface defect inspection based on multispectral convolutional neural network. J Intell Manuf 31(2):453–468

    Article  Google Scholar 

  26. Saqlain M, Abbas Q, Lee JY (2020) A deep convolutional neural network for wafer defect identification on an imbalanced dataset in semiconductor manufacturing processes. IEEE Trans Semicond Manuf 33(3):436–444

    Article  Google Scholar 

  27. Yu Z, Wu Y, Wei B, Ding Z, Luo F (2023) A lightweight and efficient model for surface tiny defect detection. Appl Intell 53(6):6344–6353

    Article  Google Scholar 

  28. Hou, D., Liu, T., Zhang, X., Wang, Y., Pan, Y.-T., Hou, J.: DFB Laser Chip Defect Detection Based on Successive Subspace Learning. In: 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0061–0064 (2020)

  29. Wang X, Li Y, Liu J, Zhang J, Du X, Liu L, Liu Y (2022) Intelligent Micron Optical Character Recognition of DFB Chip Using Deep Convolutional Neural Network. IEEE Trans Instrum Meas 71:1–9

    Article  Google Scholar 

  30. Souto J, Pura JL, Jiménez J (2019) Thermomechanical issues of high power laser diode catastrophic optical damage. J Phys D Appl Phys 52(34):343002

    Article  Google Scholar 

  31. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  32. Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., Adam, H., Le, Q.: Searching for MobileNetV3. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1314–1324 (2019)

  33. Tan, M., Le, Q.: EfficientNet: Rethinking model scaling for convolutional neural networks. In: Proceedings of the 36th International Conference on Machine Learning, vol. 97, pp. 6105–6114 (2019). PMLR

  34. Tan, M., Le, Q.: EfficientNetV2: Smaller Models and Faster Training. In: Proceedings of the 38th International Conference on Machine Learning, vol. 139, pp. 10096–10106 (2021). PMLR

  35. Radosavovic, I., Kosaraju, R.P., Girshick, R., He, K., Dollár, P.: Designing network design spaces. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10425–10433 (2020)

  36. Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., Xie, S.: A ConvNet for the 2020s. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11966–11976 (2022)

  37. Guo, MH, Lu CZ, Hou Q, Liu Z, Cheng MM, Hu SM (2022) SegNeXt: Rethinking convolutional attention design for semantic segmentation. arXiv:2209.08575

  38. Hou, Q., Zhang, L., Cheng, M.-M., Feng, J.: Strip pooling: Rethinking spatial pooling for scene parsing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4003–4012 (2020)

  39. Gupta S, Akin B (2020) Accelerator-aware neural network design using AutoML. arXiv:2003.02838

  40. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

  41. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin transformer: Hierarchical vision transformer using shifted windows. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9992–10002 (2021)

  42. Hendrycks D, Gimpel K (2016) Gaussian error linear units (GELUs). arXiv:1606.08415

  43. Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–11572 (1999)

  44. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-Up Robust Features (SURF). Comput Vision Image Understanding 110(3):346–359

    Article  Google Scholar 

  45. Xie Q, Li D, Xu J, Yu Z, Wang J (2019) Automatic detection and classification of sewer defects via hierarchical deep learning. IEEE Trans Autom Sci Eng 16(4):1836–1847

    Article  Google Scholar 

  46. Chai Q, Zeng J, Lin D, Li X, Huang J, Wang W (2021) Improved 1D convolutional neural network adapted to near-infrared spectroscopy for rapid discrimination of Anoectochilus roxburghii and its counterfeits. J Pharm Biomed Anal 199:114035

    Article  Google Scholar 

  47. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: Visual explanations from deep networks via gradient-based localization. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618–626 (2017)

  48. Sattarzadeh, S., Sudhakar, M., Lem, A., Mehryar, S., Plataniotis, K.N., Jang, J., Kim, H., Jeong, Y., Lee, S., Bae, K.: Explaining convolutional neural networks through attribution-based input sampling and block-wise feature aggregation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 11639–11647 (2021)

  49. Yang, C., Rangarajan, A., Ranka, S.: Visual explanations from deep 3D convolutional neural networks for Alzheimer’s disease classification. In: AMIA Annual Symposium Proceedings, vol. 2018, pp. 1571–1580 (2018)

  50. Peng H, Zhang R, Dou Y, Yang R, Zhang J, Yu PS (2021) Reinforced neighborhood selection guided multi-relational graph neural networks. ACM Trans Inf Syst 40(4):1–46

    Article  Google Scholar 

  51. Yang Y, Yang R, Li Y, Cui K, Yang Z, Wang Y, Xu J, Xie H (2023) Rosgas: adaptive social bot detection with reinforced self-supervised GNN architecture search. ACM Trans Web 17(3):1–31

    Article  Google Scholar 

Download references

Acknowledgements

This paper is supported by National Major Scientific Research Instrument Development Project of China (62,027,819) and Research and Development Project of Key Core and Common Technology of Shanxi Province (2020XXX007).

Author information

Authors and Affiliations

  1. College of Computer Science and Technology(College of Data Science), Taiyuan University of Technology, Taiyuan, 030024, China

    Shuai Guo & Dengao Li

  2. College of Electronic Information and Optical Engineering, Taiyuan University of Technology, Taiyuan, 030024, China

    Jumin Zhao & Yuxiang Lv

  3. College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan, 030024, China

    Huayu Jia

  4. Key Laboratory of Big Data Fusion Analysis and Application of Shanxi Province, Taiyuan, 030024, China

    Shuai Guo, Dengao Li, Jumin Zhao, Huayu Jia & Yuxiang Lv

  5. Intelligent Perception Engineering Technology Center of Shanxi, Taiyuan, 030024, China

    Shuai Guo, Dengao Li, Jumin Zhao, Huayu Jia & Yuxiang Lv

  6. Accelink Technologies Co., Ltd, Wuhan, 430074, China

    Biao Luo & Bao Tang

Authors
  1. Shuai Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dengao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jumin Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huayu Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Biao Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Bao Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yuxiang Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dengao Li.

Ethics declarations

Conflict of interest

We guarantee that there is no conflict of interest in the submission of this manuscript, and our manuscript is approved by all authors for publication. I would like to declare on behalf of my co-authors that the work described is original research that has not been published previously.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guo, S., Li, D., Zhao, J. et al. Automated catastrophic optical damage inspection of semiconductor laser chip based on multi-scale strip convolution aggregation. Int. J. Mach. Learn. & Cyber. 15, 3027–3042 (2024). https://doi.org/10.1007/s13042-023-02079-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-023-02079-y

Keywords

Search

Navigation