Kinship Recognition based on Deep Scattering Wavelet Convolutional Neural Network on Wild Facial Image

• Somayeh Arab Najafabadi ¹
• Sara Nazari * Email ORCID ¹
• Nafiseh Osati Eraghi ¹

• Department of Computer Engineering, Arak Branch, Islamic Azad University, Arak, Iran

Abstract

Kinship verification is a process that two or more people has a family relation such as father and son or other family relation. Numerous studies have been presented to investigate the relationship between people. Kingship verification can be done based on image of face. Most of the methods presented on face images work well on face data sets recorded under controlled conditions. However, due to the complex nature of environments, rapidly and accurately examining human kinship in real-world unrestricted or wild-type scenarios is still a challenging research. In this paper, in order to overcome the aforementioned challenges, an efficient and new method is presented. In the proposed method, a method is used to launch the operation to create a map. The created feature map is stable against deformation, transition, scaling, direction and Dilation in wild images. Group-Face and TSKinFace databases are used for simulation. In order to evaluate the evaluation of the proposed method, average recall of 94.1, precision 94.6, accuracy 94.7, specificity 93.8, and finally F_Measure 95.0 were used. The superiority of the proposed method in all comparisons shows the effectiveness of the proposed method in diagnosing kinship.

 

References

[1]     J. Lu, J. Hu, and Y.-P. Tan, “Discriminative deep metric learning for face and kinship verification, ” IEEE Transactions on Image Processing, vol. 26, no. 9, pp. 4269-4282, 2017.

[2]     A. Goyal and T. Meenpal, “Eccentricity based kinship verification from facial images in the wild, ” Pattern Analysis and Applications, vol. 24, no. 1, pp. 119-144, 2021.

[3]     X. Qin, D. Liu, and D. Wang, “A literature survey on kinship verification through facial images, ” Neurocomputing, vol. 377, pp. 213-224, 2020.

[4]     H. Yan and J. Lu, “ Facial Kinship Verification. Springer, ” 2017.

[5]     A. R. Khan et al., “Authentication through gender classification from iris images using support vector machine, ” Microscopy research and technique, vol. 84, no. 11, pp. 2666-2676, 2021.

[6]     J. P. Robinson, M. Shao, Y. Wu, H. Liu, T. Gillis, and Y. Fu, “Visual kinship recognition of families in the wild, ” IEEE Transactions on pattern analysis and machine intelligence, vol. 40, no. 11, pp. 2624-2637, 2018.

[7]     J. P. Robinson, M. Shao, and Y. Fu, “Survey on the Analysis and Modeling of Visual Kinship: A Decade in the Making, ” IEEE Transactions on Pattern Analysis & Machine Intelligence, no. 01, pp. 1-1, 2021.

[8]     J. Lu, X. Zhou, Y.-P. Tan, Y. Shang, and J. Zhou, “Neighborhood repulsed metric learning for kinship verification, ” IEEE transactions on pattern analysis and machine intelligence, vol. 36, no. 2, pp. 331-345, 2013.

[9]     N. Kohli, M. Vatsa, R. Singh, A. Noore, and A. Majumdar, “Hierarchical representation learning for kinship verification, ” IEEE Transactions on Image Processing, vol. 26, no. 1, pp. 289-302, 2016.

[10]  M. Soleimani, M. H. Naderi, and A. R. Ashrafi, “TENSOR PRODUCT OF THE POWER GRAPHS OF SOME FINITE RINGS, ” Facta Universitatis, Series: Mathematics and Informatics, pp. 101-122, 2019.

[11]  M. Soleimani and A. S. Mirshahzadeh, “Multi-class Classification of Imbalanced Intelligent Data using Deep Neural Network, ” EAI Endorsed Transactions on AI and Robotics, vol. 2, 2023.

[12]  A. J. Moshayedi et al., “E-Nose design and structures from statistical analysis to application in robotic: a compressive review, ” EAI Endorsed Transactions on AI and Robotics, vol. 2, no. 1, pp. e1-e1, 2023.

[13]  W. Wang, S. You, S. Karaoglu, and T. Gevers, “A survey on kinship verification, ” Neurocomputing, vol. 525, pp. 1-28, 2023.

[14]  A. Raftarai, R. R. Mahounaki, M. Harouni, M. Karimi, and S. K. Olghoran, “Predictive models of hospital readmission rate using the improved adaboost in COVID-19, ” in Intelligent Computing Applications for COVID-19: CRC Press, 2021, pp. 67-86.

[15]  E. Karimi and A. Ebrahimi, “Considering risk of cascading line outages in transmission expansion planning by benefit/cost analysis, ” International Journal of Electrical Power & Energy Systems, vol. 78, pp. 480-488, 2016.

[16]  M. Soleimani, F. Mahmudi, and M. H. Naderi, “On the Maximal Graph of a Commutative Ring, ” Mathematics Interdisciplinary Research, 2021.

[17]  M. M. Dehshibi and J. Shanbehzadeh, “Cubic norm and kernel-based bi-directional PCA: toward age-aware facial kinship verification, ” The Visual Computer, vol. 35, no. 1, pp. 23-40, 2019.

[18]  S. Aryanmehr, M. Karimi, and F. Z. Boroujeni, “CVBL IRIS Gender Classification Database Image Processing and Biometric Research, Computer Vision and Biometric Laboratory (CVBL), ” in 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC), 2018, pp. 433-438: IEEE.

[19]  E. Karimi and A. Ebrahimi, “Probabilistic transmission expansion planning considering risk of cascading transmission line failures, ” International Transactions on Electrical Energy Systems, vol. 25, no. 10, pp. 2547-2561, 2015.

[20]  F. Mahmudi, M. Soleimani, and M. Naderi, “Some Properties of the Maximal Graph of a Commutative Ring, ” Southeast Asian Bulletin of Mathematics, vol. 43, no. 4, 2019.

[21]  M. Karimi, M. Harouni, E. I. Jazi, A. Nasr, and N. Azizi, “Improving Monitoring and Controlling Parameters for Alzheimer’s Patients Based on IoMT, ” in Prognostic Models in Healthcare: AI and Statistical Approaches: Springer, 2022, pp. 213-237.

[22]  G. Guo and X. Wang, “Kinship measurement on salient facial features, ” IEEE Transactions on Instrumentation and Measurement, vol. 61, no. 8, pp. 2322-2325, 2012.

[23]  Z. Zhu, P. Luo, X. Wang, and X. Tang, “Deep learning multi-view representation for face recognition, ” arXiv preprint arXiv:1406.6947, 2014.

[24]  E. Karimi and A. Ebrahimi, “Inclusion of blackouts risk in probabilistic transmission expansion planning by a multi-objective framework, ” IEEE Transactions on Power Systems, vol. 30, no. 5, pp. 2810-2817, 2014.

[25]  A. Jafarzadeh and M. Soleimani, “NON-VANISHING ELEMENTS AND ZEROS OF CHARACTERS OF FINITE GROUPS: A REVIEW, ” in 42nd Annual Iranian Mathematics Conference, 2011.

[26]  M. Soleimani, F. Mahmudi, and M. Naderi, “Some results on the maximal graph of commutative rings, ” Advanced Studies: Euro-Tbilisi Mathematical Journal, vol. 16, no. supp1, pp. 21-26, 2023.

[27]  H. Yan and C. Song, “Multi-scale deep relational reasoning for facial kinship verification, ” Pattern Recognition, vol. 110, p. 107541, 2021.

[28]  A. Rehman, M. Harouni, M. Karimi, T. Saba, S. A. Bahaj, and M. J. Awan, “Microscopic retinal blood vessels detection and segmentation using support vector machine and K‐nearest neighbors, ” Microscopy research and technique, 2022.

[29]  A. Rehman, M. Harouni, M. Karimi, T. Saba, S. A. Bahaj, and M. J. Awan, “Microscopic retinal blood vessels detection and segmentation using support vector machine and K‐nearest neighbors, ” Microscopy Research and Technique, vol. 85, no. 5, pp. 1899-1914, 2022.

[30]  S. Sharma and V. P. Sharma, “Insights of Kinship Verification for Facial Images—A Review, ” in Proceedings of Second International Conference on Smart Energy and Communication, 2021, pp. 111-122: Springer.

[31]  M. Harouni, M. Karimi, A. Nasr, H. Mahmoudi, and Z. Arab Najafabadi, “Health Monitoring Methods in Heart Diseases Based on Data Mining Approach: A Directional Review, ” in Prognostic Models in Healthcare: AI and Statistical Approaches: Springer, 2022, pp. 115-159.

[32]  H. Yan, J. Lu, W. Deng, and X. Zhou, “Discriminative multimetric learning for kinship verification, ” IEEE Transactions on Information forensics and security, vol. 9, no. 7, pp. 1169-1178, 2014.

[33]  O. Laiadi, A. Ouamane, A. Benakcha, A. Taleb-Ahmed, and A. Hadid, “Multi-view deep features for robust facial kinship verification, ” arXiv preprint arXiv:2006.01315, 2020.

[34]  M. Karimi, M. Harouni, A. Nasr, and N. Tavakoli, “Automatic Lung Infection Segmentation of Covid-19 in CT Scan Images, ” in Intelligent Computing Applications for COVID-19: CRC Press, 2021, pp. 235-253.

[35]  M. Harouni, M. Karimi, and S. Rafieipour, “Precise Segmentation Techniques in Various Medical Images, ” Artificial Intelligence and Internet of Things, pp. 117-166, 2021.

[36]  M. Harouni, M. Karimi, and S. Rafieipour, “Precise Segmentation Techniques in Various Medical Images, ” Artificial Intelligence and Internet of Things: Applications in Smart Healthcare, p. 117, 2021.

[37]  A. Ebrahimi and M. Fotuhi-Firuzabad, “Exploring self-organized criticality conditions in Iran bulk power system with disturbance times series, ” Scientia Iranica, vol. 21, no. 6, pp. 2264-2272, 2014.

[38]  Q. Yuan and S. Xia, “Kinship Understanding for a Family Photo, ” in 2019 Chinese Control And Decision Conference (CCDC), 2019, pp. 5319-5323: IEEE.

[39]  M. Karimi, M. Harouni, and S. Rafieipour, “Automated Medical Image Analysis in Digital Mammography, ” in Artificial Intelligence and Internet of Things: CRC Press, 2021, pp. 85-116.

[40]  X. Zhou, J. Hu, J. Lu, Y. Shang, and Y. Guan, “Kinship verification from facial images under uncontrolled conditions, ” in Proceedings of the 19th ACM international conference on Multimedia, 2011, pp. 953-956.

[41]  R. Singh, M. Vatsa, and A. Noore, “Effect of plastic surgery on face recognition: A preliminary study, ” in 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2009, pp. 72-77: IEEE.

[42]  D. Cakir, S. Akay, and N. Arica, “Deep learning approaches in face analysis, ” in Learning Control: Elsevier, 2021, pp. 103-145.

[43]  Y. Guo, H. Dibeklioglu, and L. Van der Maaten, “Graph-based kinship recognition, ” in 2014 22nd international conference on pattern recognition, 2014, pp. 4287-4292: IEEE.

[44]  K. Zhang12, Y. Huang, C. Song, H. Wu, L. Wang, and S. M. Intelligence, “Kinship verification with deep convolutional neural networks, ” 2015.

[45]  A. Tidjani, A. Taleb-Ahmed, D. Samai, and A. K. Eddine, “Deep learning features for robust facial kinship verification, ” IET Image Processing, vol. 12, no. 12, pp. 2336-2345, 2018.

[46]  M. Wang, X. Shu, J. Feng, X. Wang, and J. Tang, “Deep multi-person kinship matching and recognition for family photos, ” Pattern Recognition, vol. 105, p. 107342, 2020.

[47]  O. Laiadi, A. Ouamane, A. Benakcha, A. Taleb-Ahmed, and A. Hadid, “A weighted exponential discriminant analysis through side-information for face and kinship verification using statistical binarized image features, ” International Journal of Machine Learning and Cybernetics, vol. 12, no. 1, pp. 171-185, 2021.

[48]  A. Singh and N. Kingsbury, “Multi-resolution dual-tree wavelet scattering network for signal classification, ” arXiv preprint arXiv:1702.03345, 2017.

[49]  H. Zhang and X. Guan, “Iris recognition based on grouping KNN and rectangle conversion, ” in Software Engineering and Service Science (ICSESS), 2012 IEEE 3rd International Conference on, 2012, pp. 131-134: IEEE.

[50]  X. Qin, X. Tan, and S. Chen, “Tri-subject kinship verification: Understanding the core of a family, ” IEEE Transactions on Multimedia, vol. 17, no. 10, pp. 1855-1867, 2015.

[51]  A. S. M. Samara and R. M. Ibrahim, "Plastic Surgery Face Recognition USING Photometric based illumination normalization Techniques and Gabor faces (Dept. E.(Electronics)), ” MEJ. Mansoura Engineering Journal, vol. 38, no. 3, pp. 11-23, 2020.

[52]  R. Fang, A. C. Gallagher, T. Chen, and A. Loui, “Kinship classification by modeling facial feature heredity, ” in 2013 IEEE International Conference on Image Processing, 2013, pp. 2983-2987: IEEE.

[53]  A. Dehghan, E. G. Ortiz, R. Villegas, and M. Shah, “Who do i look like? determining parent-offspring resemblance via gated autoencoders, ” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 1757-1764.

[54]  J. Hu, J. Lu, and Y.-P. Tan, “Discriminative deep metric learning for face verification in the wild, ” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 1875-1882.

[55]  J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon, “Information-theoretic metric learning, ” in Proceedings of the 24th international conference on Machine learning, 2007, pp. 209-216.

[56]  K. Q. Weinberger and L. K. Saul, “Distance metric learning for large margin nearest neighbor classification, ” Journal of machine learning research, vol. 10, no. 2, 2009.

[57]  A. Chergui, S. Ouchtati, S. Mavromatis, S. E. Bekhouche, M. Lashab, and J. Sequeira, “Kinship Verification Through Facial Images Using CNN-Based Features, ” Traitement du Signal, vol. 37, no. 1, 2020.

[58]  M. Wang, J. Feng, X. Shu, Z. Jie, and J. Tang, “Photo to family tree: Deep kinship understanding for nuclear family photos, ” in Proceedings of the Joint Workshop of the 4th Workshop on Affective Social Multimedia Computing and first Multi-Modal Affective Computing of Large-Scale Multimedia Data, 2018, pp. 41-46.

[59]  F. Bougourzi, F. Dornaika, K. Mokrani, A. Taleb-Ahmed, and Y. Ruichek, “Fusing Transformed Deep and Shallow features (FTDS) for image-based facial expression recognition, ” Expert Systems with Applications, vol. 156, p. 113459, 2020.

[60]  J. L. Schonberger, H. Hardmeier, T. Sattler, and M. Pollefeys, “Comparative evaluation of hand-crafted and learned local features, ” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 1482-1491.