Dual-Band Maritime Ship Classification Based on Multi-layer Convolutional Features and Bayesian Decision
Authors: 
Zhaoqing Wu, Yancheng Cai, Xiaohua Qiu, Min Li, Yujie He, Yu Song, Weidong DuAuthors Info & Claims
Pages 438 - 449
Abstract
There are some problems arising from the classification of visible and infrared maritime ship, for example, the small number of image annotated samples and the low classification accuracy of feature concatenation fusion. To solve the problems, this paper proposes a dual-band ship decision-level fusion classification method based on multi-layer features and naive Bayesian model. To avoid the occurrence of over-fitting caused by the small number of annotated samples, the proposed method is adopted. First of all, a convolutional neural network (CNN) which has been pre-trained on ImageNet dataset is used and fine-tuned to extract convolutional features of dual-band images. Then, principal component analysis is conducted to reduce the dimension of convolutional feature while L2 normalization is applied to normalize the features after dimensionality reduction. Meanwhile, multi-layer convolutional feature fusion is conducted through the period. In doing so, not only storage and computing resources is reduced, the information of feature representation is also enriched. Finally, a Bayesian decision model is constructed using support vector machine and naive Bayesian theory, for the subsequent dual-band ship fusion classification. According to the experiments results on the public maritime ship dataset, the classification accuracy of the proposed decision-level fusion method reaches 89.8%, which is higher not only than that of the dual-band feature-level fusion by 1.0%–2.0%, but also than that of the state-of-the-art method by 1.6%.
References
[1]
Oliveau, Q.: Ship classification for maritime surveillance. In: OCEANS 2019-Marseille, pp. 1–5. IEEE (2019)
[2]
Zhang X, Lv Y, Yao L, Xiong W, and Fu C A New benchmark and an attribute-guided multilevel feature representation network for fine-grained ship classification in optical remote sensing images IEEE J. Sel. Topics Appl. Earth Obs. Remote Sens. 2020 13 1271-1285
[3]
Zhenzhen L, Baojun Z, Linbo T, Zhen L, and Fan F Ship classification based on convolutional neural networks J. Eng. 2019 2019 7343-7346
[4]
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition (2014). arXiv preprint arXiv:1409.1556
[5]
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
[6]
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
[7]
Zhang E, Wang K, and Lin G Classification of marine vessels with multi-feature structure fusion Appl. Sci. 2019 9 2153-2164
[8]
Peng C, Wang N, Li J, and Gao X DLFace: Deep local descriptor for cross-modality face recognition Pattern Recogn. 2019 90 161-171
[9]
Ding L, Wang Y, Laganiere R, Huang D, and Fu S Convolutional neural networks for multispectral pedestrian detection Signal Process. Image Commun. 2020 82 115764-115779
[10]
Zhang Q, Huang N, Yao L, Zhang D, Shan C, and Han J RGB-T salient object detection via fusing multi-level CNN features IEEE Trans. Image Process. 2019 29 3321-3335
[11]
Zhang H, Zhang L, Zhuo L, and Zhang J Object tracking in rgb-t videos using modal-aware attention network and competitive learning Sensors 2020 20 393-348
[12]
Yosinski, J., Clune, J., Bengio, Y., Lipson, H.: How transferable are features in deep neural networks (2014). arXiv preprint arXiv:1411.1792
[13]
Ren S, He K, Girshick R, and Sun J Faster R-CNN: towards real-time object detection with region proposal networks Adv. Neural. Inf. Process. Syst. 2015 28 91-99
[14]
Dao-Duc, C., Xiaohui, H., Morère, O.: Maritime vessel images classification using deep convolutional neural networks. In: Proceedings of the Sixth International Symposium on Information and Communication Technology, pp. 276–281 (2015)
[15]
Gundogdu E, Solmaz B, Yücesoy V, and Koç A Lai S-H, Lepetit V, Nishino K, and Sato Y Marvel: a large-scale image dataset for maritime vessels Computer Vision – ACCV 2016 2017 Cham Springer 165-180
[16]
Solmaz B, Gundogdu E, Yucesoy V, and Koc A Generic and attribute-specific deep representations for maritime vessels IPSJ Trans. Comput. Vision Appl. 2017 9 1 1-18
[17]
Milicevic M, Zubrinic K, Obradovic I, and Sjekavica T Ntalianis K, Vachtsevanos G, Borne P, and Croitoru A Application of transfer learning for fine-grained vessel classification using a limited dataset Applied Physics, System Science and Computers III 2019 Cham Springer 125-131
[18]
Liu, Y., Cui, H.-Y., Kuang, Z., Li, G.-Q.: Ship detection and classification on optical remote sensing images using deep learning. In: ITM Web of Conferences, pp. 5012–5025. EDP Sciences (2017)
[19]
Zhang, M.M., Choi, J., Daniilidis, K., Wolf, M.T., Kanan, C.: VAIS: a dataset for recognizing maritime imagery in the visible and infrared spectrums. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 10–16 (2015)
[20]
Shi Q, Li W, Zhang F, Hu W, Sun X, and Gao L Deep CNN with multi-scale rotation invariance features for ship classification IEEE Access 2018 6 38656-38668
[21]
Huang L, Li W, Chen C, Zhang F, and Lang H Multiple features learning for ship classification in optical imagery Multimedia Tools Appl. 2017 77 11 13363-13389
[22]
Shi Q, Li W, Tao R, Sun X, and Gao L Ship classification based on multifeature ensemble with convolutional neural network Remote Sens. 2019 11 419
[23]
Aziz, K., Bouchara, F.: Multimodal deep learning for robust recognizing maritime imagery in the visible and infrared spectrums. In: Campilho, A., Karray, F., ter Haar Romeny, B. (eds.) ICIAR 2018. LNCS, vol. 10882, pp. 235–244. Springer, Cham (2018).
[24]
Santos, C.E., Bhanu, B.: Dyfusion: dynamic IR/RGB fusion for maritime vessel recognition. In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 1328–1332. IEEE (2018)
[25]
Li C, Ren J, Huang H, Wang B, Zhu Y, and Hu H PCA and deep learning based myoelectric grasping control of a prosthetic hand Biomed. Eng. Online 2018 17 1-18
[26]
Sun Y et al. Image classification base on PCA of multi-view deep representation J. Vis. Commun. Image Represent. 2019 62 253-258
Recommendations
Ship Classification Based on Multi-Layer Convolution Features Fusion in Optical Imagery
ICCPR '20: Proceedings of the 2020 9th International Conference on Computing and Pattern RecognitionAddressing to the problem that single layer feature of the pre-trained convolutional neural network is insufficient to represent the object in the visible image, a ship classification method based on multi-layer convolution features fusion is proposed. ...
A dyadic multi-resolution deep convolutional neural wavelet network for image classification
For almost the past four decades, image classification has gained a lot of attention in the field of pattern recognition due to its application in various fields. Given its importance, several approaches have been proposed up to now. In this paper, we ...
Maritime Vessel Images Classification Using Deep Convolutional Neural Networks
SoICT '15: Proceedings of the 6th International Symposium on Information and Communication TechnologyThe ability to identify maritime vessels and their type is an important component of modern maritime safety and security. In this work, we present the application of deep convolutional neural networks to the classification of maritime vessel images. We ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Dec 2021
718 pages
ISBN:978-3-030-92184-2
DOI:10.1007/978-3-030-92185-9
© Springer Nature Switzerland AG 2021.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 08 December 2021
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in