Abstract
The amount of high dimensional data produced by visual sensors in the smart environments and by autonomous vehicles is increasing exponentially. In order to search and model this data for real-time applications, the dimensionality of the data should be reduced. In this paper, a novel dimensionality reduction algorithm based on fuzzy rough set theory, called Centralized Binary Mapping (CBM), is proposed. The fuzzy CBM kernel is used for extracting the central elements and the memory cells from the blocks of high dimensional data. The proposed applications of CBM in this paper include hashing and generative modelling of multimedia big data. The robustness of the proposed CBM based hashing algorithm is 10% higher than comparable methods. Furthermore, based on the CBM, a novel architecture for neural networks called Deep Root Dimensional Mapping (DRDM) is proposed. The DRDM is used for generative modelling of multimedia big data using a new autonomous vehicle visual navigation dataset as well as the standard datasets. The simulation results show that the proposed DRDM converges rapidly and the perceptual quality of the outputs at the same epoch is higher than generative adversarial networks. The proposed CBM can be used as a new data structures in various pattern recognition and machine learning tasks.
Similar content being viewed by others
References
Al-Qerem A, Alauthman M, Almomani A, Gupta B (2020) IoT transaction processing through cooperative concurrency control on fog–cloud computing environment. Soft Comput 24(8):5695–5711
An J, Fu L, Hu M, Chen W, Zhan J (2019) A novel fuzzy-based convolutional neural network method to traffic flow prediction with uncertain traffic accident information. IEEE Access 7:20708–20722
Chen X, Zhang Q, Lin M, Yang G, He C (2019) No-reference color image quality assessment: from entropy to perceptual quality. EURASIP J Image Video Process 2019(1):77
Dai J, Hu H, Wu W-Z, Qian Y, Huang D (2017) Maximal-discernibility-pair-based approach to attribute reduction in fuzzy rough sets. IEEE Trans Fuzzy Syst 26(4):2174–2187
Deng Y, Li H, Fu K, Du Q, Emery WJ (2018) Tensor low-rank discriminant embedding for Hyperspectral image dimensionality reduction. IEEE Trans Geosci Remote Sens 56(12):7183–7194. https://doi.org/10.1109/TGRS.2018.2849085
Duan Y, Huang H, Tang Y, Li Y, Pu C (2020) Semisupervised Manifold Joint Hypergraphs for Dimensionality Reduction of Hyperspectral Image. IEEE Geoscience and Remote Sensing Letters:1–5. doi:https://doi.org/10.1109/LGRS.2020.3009144
Dubois D, Prade H (1990) Rough fuzzy sets and fuzzy rough sets. Int J Gen Syst 17(2–3):191–209
Fadaeddini A, Majidi B, Eshghi M A (2018) case study of generative adversarial networks for procedural synthesis of original textures in video games. In: 2018 2nd National and 1st International Digital Games Research Conference: Trends, Technologies, and Applications (DGRC). IEEE, pp 118–122
Fujiwara T, Chou JK, Shilpika S, Xu P, Ren L, Ma KL (2020) An incremental dimensionality reduction method for visualizing streaming multidimensional data. IEEE Trans Vis Comput Graph 26(1):418–428. https://doi.org/10.1109/TVCG.2019.2934433
Gahar RM, Arfaoui O, Hidri MS, Hadj-Alouane NB (2019) A distributed approach for high-dimensionality heterogeneous data reduction. IEEE Access 7:151006–151022. https://doi.org/10.1109/ACCESS.2019.2945889
Gao Z, Li C, Liu N, Pan Z, Gao J, Xu Z (2020) Large-Dimensional Seismic Inversion Using Global Optimization With Autoencoder-Based Model Dimensionality Reduction. IEEE Transactions on Geoscience and Remote Sensing:1–15. doi:https://doi.org/10.1109/TGRS.2020.2998035
Geiger A, Lenz P, Stiller C, Urtasun R (2013) Vision meets robotics: the Kitti dataset. Int J Robotics Res 32(11):1231–1237
Jeba JA, Roy S, Rashid MO, Atik ST, Whaiduzzaman M (2019) Towards green cloud computing an algorithmic approach for energy minimization in cloud data centers. Int J Cloud Appl Comput (IJCAC) 9(1):59–81
Khanzadi P, Majidi B, Akhtarkavan E (2017) Edge detection using determinant-variance trace algorithm based on Roots-Dimensional Mapping method. In: 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI). IEEE, pp 0446–0451
Khanzadi P, Majidi B, Akhtarkavan E A (2017) novel metric for digital image quality assessment using entropy-based image complexity. In: 2017 IEEE 4th International Conference on Knowledge-Based Engineering and Innovation (KBEI). IEEE, pp 0440–0445
Long Z, Meng H, Sioutis M (2020) Semi-supervised dimensionality reduction by linear compression and stretching. IEEE Access 8:27308–27317. https://doi.org/10.1109/ACCESS.2020.2971562
Ma Z, Zhan Z, Ouyang X, Su X (2018) Nonlinear dimensionality reduction based on HSIC maximization. IEEE Access 6:55537–55555. https://doi.org/10.1109/ACCESS.2018.2871825
Majidi B, Hemmati O, Baniardalan F, Farahmand H, Hajitabar A, Sharafi S, Aghajani K, Esmaeili A, Manzuri MT Geo-Spatiotemporal Intelligence for Smart Agricultural and Environmental Eco-Cyber-Physical Systems. In: Enabling AI Applications in Data Science. Springer, pp 471–491
Mohammadkhani MA, Majidi B, Manzuri MT (2019) Deep Vision for Navigation of Autonomous Motorcycle in Urban and Semi-Urban Environments. In: 2019 5th Iranian conference on signal processing and intelligent systems (ICSPIS). IEEE, pp 1–5
Pang Y, Zhou B, Nie F (2019) Simultaneously learning Neighborship and projection matrix for supervised dimensionality reduction. IEEE Trans Neural Networks Learn Syst 30(9):2779–2793. https://doi.org/10.1109/TNNLS.2018.2886317
Psannis KE, Stergiou C, Gupta BB (2018) Advanced media-based smart big data on intelligent cloud systems. IEEE Trans Sustainable Comput 4(1):77–87
Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:151106434
Ran R, Feng J, Zhang S, Fang B (2020) A general matrix function dimensionality reduction framework and extension for manifold learning. IEEE Trans Cybernetics:1–12. https://doi.org/10.1109/TCYB.2020.3003620
Safari G, Majidi B, Khanzadi P, Manzuri MT (2018) Cross-platform e-management for smart care facilities using deep interpretation of patient surveillance videos. In: 2018 25th National and 3rd International Iranian Conference on Biomedical Engineering (ICBME). IEEE, pp 1–6
Schizas ID (2020) Online data dimensionality reduction and reconstruction using graph filtering. IEEE Trans Signal Process 68:3871–3886. https://doi.org/10.1109/TSP.2020.3003423
Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27(3):379–423
Sharafi S, Majidi B, Movaghar A (2019) Low Altitude Aerial Scene Synthesis Using Generative Adversarial Networks for Autonomous Natural Resource Management. In: 2019 5th Conference on Knowledge Based Engineering and Innovation (KBEI). IEEE, pp 322–326
Sheng L, Pan J, Guo J, Shao J, Loy CC High-Quality Video Generation from Static Structural Annotations
Shi G, Huang H, Wang L (2020) Unsupervised dimensionality reduction for Hyperspectral imagery via local geometric structure feature learning. IEEE Geosci Remote Sens Lett 17(8):1425–1429. https://doi.org/10.1109/LGRS.2019.2944970
Tan A, Wu W-Z, Qian Y, Liang J, Chen J, Li J (2018) Intuitionistic fuzzy rough set-based granular structures and attribute subset selection. IEEE Trans Fuzzy Syst 27(3):527–539
Tang Z, Zhang X, Zhang S (2013) Robust perceptual image hashing based on ring partition and NMF. IEEE Trans Knowl Data Eng 26(3):711–724
Tang Z, Zhang X, Li X, Zhang S (2015) Robust image hashing with ring partition and invariant vector distance. IEEE Trans Inform Forensics Secur 11(1):200–214
Tian D, Zhou D, Gong M, Wei Y (2019) Interval Type-2 fuzzy logic for Semisupervised multimodal hashing. IEEE Transactions on Cybernetics
Tsafack N, Sankar S, Abd-El-Atty B, Kengne J, Jithin K, Belazi A, Mehmood I, Bashir AK, Song O-Y, Abd El-Latif AA (2020) A new chaotic map with dynamic analysis and encryption application in internet of health things. IEEE Access 8:137731–137744
Ullo SL, Sinha G (2020) Advances in smart environment monitoring systems using IoT and sensors. Sensors 20(11):3113
Vahdat-Nejad H, Eilaki SO, Izadpanah S (2018) Towards a better understanding of ubiquitous cloud computing. Int J Cloud Appl Comput (IJCAC) 8(1):1–20
Wan L, Sun Y, Sun L, Ning Z, Rodrigues JJ (2020) Deep learning based autonomous vehicle super resolution DOA estimation for safety driving. IEEE Trans Intell Transp Syst, 1, 15
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Yang Y, Chen D, Wang H (2016) Active sample selection based incremental algorithm for attribute reduction with rough sets. IEEE Trans Fuzzy Syst 25(4):825–838
Yang Y, Chen D, Wang H, Wang X (2017) Incremental perspective for feature selection based on fuzzy rough sets. IEEE Trans Fuzzy Syst 26(3):1257–1273
Zhang T, Shen F, Zhu T, Zhao J (2020) An evolutionary orthogonal component analysis method for incremental dimensionality reduction. IEEE Trans Neural Networks Learn Syst:1–14. doi:https://doi.org/10.1109/TNNLS.2020.3027852
Acknowledgements
Pouria Khanzadi thanks Pasargad Institute for Advanced Innovative Solutions (PIAIS) for providing computational support to conduct simulations.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khanzadi, P., Majidi, B., Adabi, S. et al. Robust fuzzy rough set based dimensionality reduction for big multimedia data hashing and unsupervised generative learning. Multimed Tools Appl 80, 17745–17772 (2021). https://doi.org/10.1007/s11042-021-10571-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-10571-2