research-article

A novel technique for image classification using short-time Fourier transform and local binary pattern

Authors:

Mohit GambhirAuthors Info & Claims

Multimedia Tools and Applications, Volume 81, Issue 15

Pages 20705 - 20718

https://doi.org/10.1007/s11042-022-12671-z

Published: 01 June 2022 Publication History

Abstract

Machine Learning (ML) has been widely used for Image processing. The pertinent feature extraction and feature selection techniques can help us to accomplish many complex tasks. This paper presents a framework for the classification of emotions using ML. Training and testing have been done using the JAFFE (Japanese Female Facial Expression) dataset. The work proposes a combination of Short-Time Fourier Transform (STFT) and Local Binary Pattern (LBP) for extracting interesting features. Also, a fusion of popular feature reduction techniques namely: Fisher Discriminant Ratio (FDR), variance threshold method and chi-square test has been introduced. The selected relevant features are applied to the Support Vector Machine (SVM) classifier. Performance analysis of the existing techniques and the proposed technique has been carried out where the latter was found efficient. The proposed pipeline performs better in terms of accuracy, specificity and sensitivity as compared to the state of art.

References

[1]

Alpaydin E Introduction to machine learning 2010 MIT Press 9-22

[2]

Bock DE, Velleman PF, and De Veaux RD Stats, modeling the world 2007 Boston Pearson Addison Wesley 606-627 ISBN 0-13-187621-X

[3]

Borges F, Pinto A, Ribeiro D, Barbosa T, Pereira D, Magalhaes R, Barbosa B, and Ferreira D An unsupervised method based on support vector machines and higher-order statistics for mechanical faults detection IEEE Lat Am Trans 2020 18 6 1093-1101

[4]

Bracewell RN The Fourier transform and its applications 2000 3 Boston McGraw-Hill ISBN 978-0-07-116043-8

[5]

Chrysikopoulos HS Clinical MR imaging and physics 2009 Springer https://www.springer.com/gp/book/9783540779995

[6]

Cortes C and Vapnik V Support-vector networks Mach Learn 1995 20 3 273-297

[7]

Fisher RA On the interpretation of chi-squared from contingency tables, and the calculation of P J R Stat Soc 1922 85 1 87-94

[8]

Friedman JH Data mining and statistics: What's the connection? Computing Science and Statistics 1998 3-9

[9]

Gareth J et al (2013) An introduction to statistical learning. Springer:15–57

[10]

Gaurav K and Pradeep KB A detailed review of feature extraction in image processing systems [paper presentation] Fourth International Conference on Advanced Computing & Communication Technologies 2014 IEEE

[11]

Hemanth D and Anitha J Image pre-processing and feature extraction techniques for magnetic resonance brain image analysis 2012 Berlin Heidelberg Springer-Verlag 349-356

[12]

Khanna K et al. Current challenges in detection of Parkinson’s disease J Crit Rev 2020 7 18 1461-1467

[13]

Li M Quaternion discrete Fourier transform-based color image watermarking method using quaternion QR decomposition IEEE Access 2020 8 72308-72315

[14]

Mark SN and Alberto SA Feature extraction and image processing 2002 Oxford Jordan Hill

[15]

Ming X and Changjun Z A study and application on machine learning of artificial Intellligence 2009 IEEE

[16]

Ojala T, Pietikainen M, and Maenpaa T Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Trans Pattern Anal Mach Intell 2002 24 7 971-987

[17]

Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay É (2011) Scikit-learn: machine learning in Python. 12(85):2825–2830

[18]

Popa C and Glăvan C Fourier Transform-Based Image Classification Using Complex-Valued Convolutional Neural Networks 2018 Springer Nature 300-309

[19]

Ravishankar S et al. Image reconstruction: from sparsity to data-adaptive methods and machine learning IEEE 2020 108 1 86-109

[20]

Sejdić, E. et. al. (2009). Time-frequency feature representation using energy concentration: an overview of recent advances. Digital Signal Processing, 19 (1), 153–183.

[21]

Shi S, Yang R, and You H A new two-dimensional fourier transform algorithm based on image sparsity 2017 IEEE 978-1-5090-4117-6/17

[22]

Soni D, Gupta Y, and Dubey S Empirical study of DWT and FFT techniques to extract intensity based features from the images International Research Journal of Engineering and Technology (IRJET) 2016 3 10 437-443

[23]

Susmita R A quick review of machine learning algorithms International conference on machine learning, Big Data, Cloud and Parallel Computing (Com-IT-Con), India 2019

[24]

Tao Y, Muthukkumarasamy V, Verma B, and Blumenstein M A texture feature extraction technique using 2D-DFT and hamming distance ICCIMA 2003: FIFTH international conference on computational intelligence and multimedia applications, proceedings 2003

[25]

Tran H and Cuntai G Feature selection based on Fisher ratio and mutual information analyses for robust brain computer interface IEEE international conference on acoustics, speech and signal processing ICASSP, 1 2007 337-340

Cited By

Karanwal S(2024)Robust And Discriminant Local Color Pattern (RADLCP)International Journal of Hybrid Intelligent Systems10.3233/HIS-23001620:1(23-39)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.3233/HIS-230016
Khanna KGambhir SGambhir M(2023)Comparative analysis of machine learning techniques for Parkinson’s detection: A reviewMultimedia Tools and Applications10.1007/s11042-023-15414-w82:29(45205-45231)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11042-023-15414-w
Khanna KGambhir SGambhir M(2023)A novel technique for classifying Parkinson’s disease using structural MRI scansMultimedia Tools and Applications10.1007/s11042-023-15302-382:29(46011-46036)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11042-023-15302-3

Recommendations

Efficient Texture Classification Using Short-Time Fourier Transform with Spatial Pyramid Matching
SMC '13: Proceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics

Texture feature extraction plays an important role in texture image classification. In this paper, we have proposed a texture feature extraction method by utilizing the Short-time Fourier Transform to provide local image information, and for the global ...
Fourier transform representation by frequency-time wavelets

A new concept of the A-wavelet transform is introduced, and the representation of the Fourier transform by the A-wavelet transform is described. Such a wavelet transform uses a fully scalable modulated window but not all possible shifts. A geometrical ...
Blue whale calls classification using short-time Fourier and wavelet packet transforms and artificial neural network

Two new characterization methods based on the short-time Fourier and the wavelet packet transforms are proposed to classify blue whale calls. The vocalizations are divided into short-time overlapping segments before applying these transforms to each ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Tools and Applications

Multimedia Tools and Applications Volume 81, Issue 15

Jun 2022

1590 pages

ISSN:1380-7501

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 June 2022

Accepted: 21 February 2022

Revision received: 19 January 2022

Received: 27 April 2021

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Karanwal S(2024)Robust And Discriminant Local Color Pattern (RADLCP)International Journal of Hybrid Intelligent Systems10.3233/HIS-23001620:1(23-39)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.3233/HIS-230016
Khanna KGambhir SGambhir M(2023)Comparative analysis of machine learning techniques for Parkinson’s detection: A reviewMultimedia Tools and Applications10.1007/s11042-023-15414-w82:29(45205-45231)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11042-023-15414-w
Khanna KGambhir SGambhir M(2023)A novel technique for classifying Parkinson’s disease using structural MRI scansMultimedia Tools and Applications10.1007/s11042-023-15302-382:29(46011-46036)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s11042-023-15302-3

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents