Abstract
Facial image based characterization and analysis of ethnicity, which is an important index of human demography, have become increasingly popular in the research areas of pattern recognition, computer vision, and machine learning. Many applications, such as face recognition and facial expression recognition, are affected by ethnicity information of individuals. In this study, we first create a human face database, which focuses on human ethnicity information and includes individuals from eight ethnic groups in China. This dataset can be used to conduct psychological experiments or evaluate the performance of computational algorithms. To evaluate the usefulness of this created dataset, some critical landmarks of these face images are detected and three types of features are extracted as ethnicity representations. Next, the ethnicity manifolds are learnt to demonstrate the discriminative power of the extracted features. Finally, ethnicity classifications with different popular classifiers are conducted on the constructed database, and the results indicate the effectiveness of the proposed features.
Similar content being viewed by others
Change history
22 January 2021
Editor’s Note: Concerns have been raised about the ethics approval and informed consent procedures related to the research reported in this paper. Editorial action will be taken as appropriate once an investigation of the concerns is complete and all parties have been given an opportunity to respond in full.
References
Balasubramanian M, Schwartz EL (2002) The isomap algorithm and topological stability
Ball R (2011) SizeChina: a 3D anthropometric survey of the Chinese head. TU Delft, Delft University of Technology
Benlamoudi A, Samai D, Ouafi A, Taleb-Ahmed A, Bekhouche SE, Hadid A (2015) Face spoofing detection from single images using active shape models with stasm and lbp. In: Proceeding of the Troisime conference internationale sur la vision artificielle CVA 2015
Choe KS, Sclafani AP, Litner JA, Yu G-P, Romo T (2004) The korean american woman’s face: anthropometric measurements and quantitative analysis of facial aesthetics. Arch Facial Plast Surg 6(4):244–252
Dailey MN, Joyce C, Lyons MJ, Kamachi M, Ishi H, Gyoba J, Cottrell GW (2010) Evidence and a computational explanation of cultural differences in facial expression recognition. Emotion 10(6):874
Das S (2001) Filters, wrappers and a boosting-based hybrid for feature selection. In: ICML, vol 1, pp 74–81
Enlow DH, Moyers RE (1982) Handbook of facial growth. Saunders, Philadelphia
Farkas LG (1994) Anthropometry of the head and face. Raven Pr
Farkas LG, Katic MJ, Forrest CR (2005) International anthropometric study of facial morphology in various ethnic groups/races. J Craniofac Surg 16(4):615–646
Fu S-Y, Yang G-S, Kuai X-K (2012) A spiking neural network based cortex-like mechanism and application to facial expression recognition. Comput Intell Neurosci 2012:19
Fu S, He H, Hou Z-G (2014) Learning race from face: a survey. IEEE Trans Pattern Anal Mach Intell 36(12):2483–2509
Gao W, Cao B, Shan S, Chen X, Zhou D, Zhang X, Zhao D (2008) The cas-peal large-scale chinese face database and baseline evaluations. IEEE Trans Syst Man Cybern Part A Syst Hum 38(1):149–161
Gupta S, Castleman KR, Markey MK, Bovik AC (2010) Texas 3d face recognition database. In: IEEE southwest symposium on image analysis & interpretation (SSIAI), 2010, IEEE, pp 97–100
Gutta S, Wechsler H, Phillips PJ (1998) Gender and ethnic classification of face images. In: Third IEEE international conference on automatic face and gesture recognition, 1998. Proceedings. IEEE, pp 194–199
Gutta S, Huang JR, Jonathon P, Wechsler H (2000) Mixture of experts for classification of gender, ethnic origin, and pose of human faces. IEEE Trans Neural Netw 11(4):948–960
Guyomarc’HP, Dutailly B, Charton J, Santos F, Desbarats P, Coqueugniot H (2015) Anthropological facial approximation in three dimensions (afa3d): computer-assisted estimation of the facial morphology using geometric morphometrics. J Forensic Sci 59(6):1502–1516
He X, Yan S, Hu Y, Niyogi P, Zhang HJ (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340
Hosoi S (2010) Face authentication apparatus, person image search system, face authentication apparatus control program, computer-readable recording medium, and method of controlling face authentication apparatus, uS Patent App 13/059,424
Huang Y, Yao H, Zhao S, Zhang Y (2017) Towards more efficient and flexible face image deblurring using robust salient face landmark detection. Multimed Tools Appl 76(1):123–142
Jianwen H, Lihua W, Longguang L, Shourong C (2010) Analysis of morphous characteristics of facial reconstruction and the five organs in chinese north five national minorities crowd. J Chongqing Med Univ 35(2):297–303
Keli Y, Lianbin Z, Yonglan L, Huanjiu X, Sunhua L (2016) Differences of head-face morphological traits between southern and northern chinese han. Acta Anat Sin 47(3):404–408
Lin H, Lu H, Zhang L (2006) A new automatic recognition system of gender, age and ethnicity. In: 2006 6th world congress on intelligent control and automation, vol 2. IEEE, pp 9988–9991
Lu X, Chen H, Jain AK (2006) Multimodal facial gender and ethnicity identification. In: International conference on biometrics. Springer, pp 554–561
Milborrow S Active shape models with stasm, Stasm Version 3
Ou Y, Wu X, Qian H, Xu Y (2005) A real time race classification system, IEEE
Peng H, Long F, Ding C (2005) Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238
Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The feret database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16(5):295–306
Qiu X, Sun Z, Tan T (2006) Global texture analysis of iris images for ethnic classification. In: International conference on biometrics. Springer, pp 411–418
Qiu X, Sun Z, Tan T (2007) Learning appearance primitives of iris images for ethnic classification. In: 2007 IEEE international conference on image processing, vol 2. IEEE, pp II–405
Robinette KM, Daanen H, Paquet E (1999) The caesar project: a 3-d surface anthropometry survey. In: Second international conference on 3-D digital imaging and modeling, 1999. Proceedings. IEEE, pp 380–386
Sauter SL, Murphy LR, Hurrell JJ (1990) Prevention of work-related psychological disorders: a national strategy proposed by the national institute for occupational safety and health (niosh). Am Psychol 45(10):1146
Semwal VB, Raj M, Nandi GC (2015) Biometric gait identification based on a multilayer perceptron. Robot Auton Syst 65:65–75
Semwal VB, Mondal K, Nandi GC (2017) Robust and accurate feature selection for humanoid push recovery and classification: deep learning approach. Neural Comput Appl 28(3):565–574
Semwal VB, Singha J, Sharma PK, Chauhan A, Behera B (2017) An optimized feature selection technique based on incremental feature analysis for bio-metric gait data classification. Multimed Tools Appl 76(22):24457–24475
Siffert W, Forster P, Jöckel K-H, Mvere DA, Brinkmann B, Naber C, Crookes R, HEYNS ADP, EPPLEN JT, Fridey J et al (1999) Worldwide ethnic distribution of the g protein \(\beta \)3 subunit 825t allele and its association with obesity in caucasian, chinese, and black african individuals. J Am Soc Nephrol 10(9):1921–1930
Snow CC, Gatliff BP, Mcwilliams KR (2010) Reconstruction of facial features from the skull: an evaluation of its usefulness in forensic anthropology. Am J Phys Anthropol 33(2):221–227
Strom MA, Zebrowitz LA, Zhang S, Bronstad PM, Lee HK (2012) Skin and bones: the contribution of skin tone and facial structure to racial prototypicality ratings. PloS One 7(7):e41193
Yao Y-G, Nie L, Harpending H, Fu Y-X, Yuan Z-G, Zhang Y-P (2002) Genetic relationship of chinese ethnic populations revealed by mtdna sequence diversity. Am J Phys Anthropol 118(1):63–76
Zhang H, Ding M, Jiao Y, Wang X, Yan Z, Jin G, Meng X, Bai C, Lu Z, Chen R (1997) A dermatoglyphic study of the chinese population dermatoglyphics cluster of fifty-two nationalities in China. Acta Genet Sin 25(5):381–391
Zhang H, Sun Z, Tan T, Wang J (2011) Ethnic classification based on iris images. In: Chinese conference on biometric recognition, Springer, pp 82–90
Zhang Y, Wang S, Phillips P, Ji G (2014) Binary pso with mutation operator for feature selection using decision tree applied to spam detection. Knowl-Based Syst 64:22–31
Zhao S, Yao H, Sun X (2013) Video classification and recommendation based on affective analysis of viewers. Neurocomputing 119:101–110
Zhao S, Yao H, Gao Y, Ji R, Ding G (2017) Continuous probability distribution prediction of image emotions via multitask shared sparse regression. IEEE Trans Multimed 19(3):632–645
Zhuang Z, Bradtmiller B (2005) Head-and-face anthropometric survey of us respirator users. J Occup Environ Hyg 2(11):567–576
Zhuang Z, Landsittel D, Benson S, Roberge R, Shaffer R (2010) Facial anthropometric differences among gender, ethnicity, and age groups. Ann Occup Hyg. meq007
Acknowledgements
This work is sponsored by Natural Science Foundation of China (61370146, 61672132), National Science and Technology Support Program (2013BAJ07B02) and Science & Technology Project of Liaoning Province (No.2013405003).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, C., Zhang, Q., Duan, X. et al. Multi-ethnical Chinese facial characterization and analysis. Multimed Tools Appl 77, 30311–30329 (2018). https://doi.org/10.1007/s11042-018-6018-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-6018-1