rapid-communication

GA-SURF: : A new Speeded-Up robust feature extraction algorithm for multispectral images based on geometric algebra

Authors:

Wenming CaoAuthors Info & Claims

Volume 127, Issue C

Pages 11 - 17

https://doi.org/10.1016/j.patrec.2018.11.001

Published: 01 November 2019 Publication History

Highlights

•

Speeded-up robust features algorithm is reformulated based on geometric algebra to deal with multispectral images.

•

A new Hessian matrix based on geometric algebra is presented to improve the performance both in computation time and accuracy.

•

The proposed algorithm outperforms the current state-of-the-art algorithms in some respects.

Abstract

Speeded-Up Robust Features (SURF) can be used for tasks such as object recognition, image registration, classification or 3D reconstruction. However, existing SURF algorithm cannot be directly applied to deal with multispectral images. In this paper, based on SURF and the theory of Geometric Algebra (GA), a novel feature extraction algorithm named GA-SURF is proposed for multispectral images. First, a Hessian matrix based on GA is calculated for locating interest points in spatial and spectral space. The box filters based on GA are used to simplify the calculation of Hessian matrix and generate image pyramids. Then, following the procedures of SURF, interest points are located by the image pyramids and described in GA space. Experimental results demonstrate that, compared with other feature extraction algorithms for multispectral images, GA-SURF can be computed much faster and are more robust and distinctive.

References

[1]

X. Shen, L. Xu, Q. Zhang, J. Jia, Multi-modal and multi-spectral registration for natural images, European Conference on Computer Vision, Springer, Cham, 2014, pp. 309–324.

[2]

Q. Xie, Q. Zhao, D. Meng, Z. Xu, S. Gu, W. Zuo, L. Zhang, Multispectral images denoising by intrinsic tensor sparsity regularization, Computer Vision and Pattern Recognition, IEEE, 2016, pp. 1692–1700.

[3]

S. Bernab, P.R. Marpu, A. Plaza, M. Dalla Mura, J.A. Benediktsson, Spectral-spatial classification of multispectral images using kernel feature space representation, IEEE Geosci. Remote Sens. Lett. 11 (1) (2014) 288–292.

[4]

G. Vivone, R. Restaino, M. Dalla Mura, G. Licciardi, J. Chanussot, Contrast and error-based fusion schemes for multispectral image pansharpening, 11 (5) (2014) 930–934.

[5]

Y. Hao, Z. Sun, T. Tan, C. Ren, Multispectral palm image fusion for accurate contact-free palmprint recognition, IEEE International Conference on Image Processing, IEEE, 2008, pp. 281–284.

[6]

S. Saleem, R. Sablatnig, A robust sift descriptor for multispectral images, IEEE Signal Process. Lett. 21 (4) (2014) 400–403.

[7]

Q. Zhang, Z. Cao, Z. Hu, Y. Jia, X. Wu, Joint image registration and fusion for panchromatic and multispectral images, IEEE Geosci. Remote Sens. Lett. 12 (3) (2015) 467–471.

[8]

D. Chaudhuri, A. Samal, An automatic bridge detection technique for multispectral images, IEEE Trans. Geosci. Remote Sens. 46 (9) (2008) 2720–2727.

[9]

R. Chen, X. Lin, T. Ding, Liveness detection for iris recognition using multispectral images, Pattern Recognit. Lett. 33 (12) (2012) 1513–1519.

[10]

D.G. Lowe, Object recognition from local scale-invariant features, IEEE International Conference on Computer Vision, IEEE, 1999, pp. 1150–1157.

[11]

D.G. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis. 60 (2) (2004) 91–110.

Digital Library

[12]

A.E. Abdel-Hakim, A.A. Farag, CSIFT: A SIFT descriptor with color invariant characteristics, Computer Vision and Pattern Recognition, volume 2, IEEE Computer Society Conference on. IEEE, 2006, pp. 1978–1983.

[13]

Z.S. Zhao, Q.J. Tian, J.Z. Wang, J.M. Zhou, Image match using distribution of colorful SIFT, International Conference on Wavelet Analysis and Pattern Recognition, IEEE, 2010, pp. 150–153.

[14]

K. Van De Sande, T. Gevers, C. Snoek, Evaluating color descriptors for object and scene recognition, IEEE Trans. Pattern Anal. Mach. Intell. 32 (9) (2010) 1582–1596.

[15]

D.N. Ai, X.H. Han, X. Ruan, Y.W. Chen, Color independent components based SIFT descriptors for object/scene classification, IEICE Trans. Inf. Syst. 93 (9) (2010) 2577–2586.

[16]

A. Chapman, U. Vishne, Clifford algebras of binary homogeneous forms, J. Algebra 366 (2012) 94–111.

[17]

V. Labunets, Clifford algebras as unified language for image processing and pattern recognition, Computational Noncommutative Algebra and Applications, volume 136, Springer Netherlands, 2004, pp. 197–225.

[18]

T. Batard, C. Saint-Jean, M. Berthier, A metric approach to nd images edge detection with clifford algebras, J. Math. Imaging Vision 33 (3) (2009) 296–312.

[19]

Y.S. Li, A digital image watermarking algorithm based on clifford algebra, Acta Electronica Sin. 36 (5) (2008) 852–855.

[20]

S. Buchholz, G. Sommer, On clifford neurons and clifford multi-layer perceptrons, Neural Netw. Off. J. Int. Neural Netw. Soc. 21 (7) (2008) 925–935.

[21]

Y. Li, W. Liu, X. Li, Q. Huang, X. Li, GA-SIFT: A new scale invariant feature transform for multispectral image using geometric algebra, Inf. Sci. 281 (2014) 559–572.

[22]

H. Bay, A. Ess, T. Tuytelaars, L.V. Gool, Surf: speeded up robust features, European conference on computer vision, Springer, Berlin, Heidelberg, 2006, pp. 404–417.

[23]

R. Kalia, K.D. Lee, B.V.R. Samir, S.K. Je, W.G. Oh, An analysis of the effect of different image preprocessing techniques on the performance of SURF: Speeded up robust features, The Workshop on Frontiers of Computer Vision, IEEE, 2011, pp. 1–6.

[24]

L. Li, J. Zic, Image matching algorithm based on feature-point and DAISY descriptor, J. Multimed. 9 (6) (2014) 829–835.

[25]

P. Fan, A. Men, M. Chen, B. Yang, Color-SURF: a surf descriptor with local kernel color histograms, IEEE International Conference on Network Infrastructure and Digital Content, 2009, Ic-Nidc. IEEE, 2009, pp. 726–730.

[26]

M. Du, J. Wang, J. Li, H. Cao, G. Cui, J. Fang..., X. Chen, Robot robust object recognition based on fast surf feature matching, Chinese Automation Congress, IEEE, 2013, pp. 581–586.

Cited By

Shi PHe QZhu SLi XFan XXin Y(2024)Multi-scale fusion and efficient feature extraction for enhanced sonar image object detectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124958256:COnline publication date: 5-Dec-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.124958
Yin SWang LWang QYang JJiang M(2023)Remote Sensing Image Segmentation Based on a Novel Gaussian Mixture Model and SURF AlgorithmInternational Journal of Swarm Intelligence Research10.4018/IJSIR.32230114:2(1-15)Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.4018/IJSIR.322301
Liu JCao JZhou C(2023)Helmet wear detection based on YOLOV5Proceedings of the 2023 2nd Asia Conference on Algorithms, Computing and Machine Learning10.1145/3590003.3590017(73-77)Online publication date: 17-Mar-2023
https://dl.acm.org/doi/10.1145/3590003.3590017
Show More Cited By

Index Terms

GA-SURF: A new Speeded-Up robust feature extraction algorithm for multispectral images based on geometric algebra
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision representations
  2. Computer graphics
    1. Image manipulation

Index terms have been assigned to the content through auto-classification.

Recommendations

Upper and lower volumetric fractal descriptors for texture classification

In this study we propose a novel approach based on BouligandMinkowski method.We convert the texture into a surface in R3 and use a sphere of radius r to dilate it.We consider that the arrangement of the pixels in the texture interferes in the dilation ...
Bark recognition using novel rotationally invariant multispectral textural features
Highlights
- Novel multispectral rotationally and illumination invariant textural features.
- ...
Graphical abstract

Display Omitted

Abstract
We present novel rotationally invariant fully multispectral Markovian textural features applied for the efficient tree bark recognition. These textural features are derived from the novel descriptive multispectral spiral wide-sense ...
KVD

A novel keypoint detector which merges efficiently visual and depth data.Scale invariance and robustness to noise and affine transformations.The detection method provides reliable keypoints even in the absence of visual data.Low computational cost and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Pattern Recognition Letters

Pattern Recognition Letters Volume 127, Issue C

Nov 2019

215 pages

ISSN:0167-8655

Issue’s Table of Contents

Elsevier B.V.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 November 2019

Author Tags

Author Tags

Qualifiers

Rapid-communication

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shi PHe QZhu SLi XFan XXin Y(2024)Multi-scale fusion and efficient feature extraction for enhanced sonar image object detectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.124958256:COnline publication date: 5-Dec-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.124958
Yin SWang LWang QYang JJiang M(2023)Remote Sensing Image Segmentation Based on a Novel Gaussian Mixture Model and SURF AlgorithmInternational Journal of Swarm Intelligence Research10.4018/IJSIR.32230114:2(1-15)Online publication date: 26-Apr-2023
https://dl.acm.org/doi/10.4018/IJSIR.322301
Liu JCao JZhou C(2023)Helmet wear detection based on YOLOV5Proceedings of the 2023 2nd Asia Conference on Algorithms, Computing and Machine Learning10.1145/3590003.3590017(73-77)Online publication date: 17-Mar-2023
https://dl.acm.org/doi/10.1145/3590003.3590017
Li GYang Y(2023)Smart vision for quality apple classification using SURF–Harris optimizing techniquesWireless Networks10.1007/s11276-023-03323-730:6(5709-5721)Online publication date: 24-Apr-2023
https://dl.acm.org/doi/10.1007/s11276-023-03323-7

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents