Edge Face Recognition System Based on One-Shot Augmented Learning

  1. Diego M. Jiménez-Bravo 1
  2. Álvaro Lozano Murciego 1
  3. André Sales Mendes 1
  4. Luis Augusto Silva 1
  5. Daniel H. De La Iglesia 1
  1. 1 Universidad de Salamanca
    info

    Universidad de Salamanca

    Salamanca, España

    ROR https://ror.org/02f40zc51

Revista:
IJIMAI

ISSN: 1989-1660

Año de publicación: 2022

Título del ejemplar: Special Issue on New Trends in Disruptive Technologies, Tech Ethics and Artificial Intelligence

Volumen: 7

Número: 6

Páginas: 31-44

Tipo: Artículo

DOI: 10.9781/IJIMAI.2022.09.001 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: IJIMAI

Resumen

There is growing concern among users of computer systems about how their data is handled. In this sense, IT (Information Technology) professionals are not unaware of this problem and are looking for solutions to meet the requirements and concerns of their users. During the last few years, various techniques and technologies have emerged that allow us to answer to the problem posed by users. Technologies such as edge computing and techniques such as one-shot learning and data augmentation enable progress in this regard. Thus, in this article, we propose the creation of a system that makes use of these techniques and technologies to solve the problem of face recognition and form a low-cost security system. The results obtained show that the combination of these techniques is effective in most of the face detection algorithms and allows an effective solution to the problem raised.

Referencias bibliográficas

  • E. G. Miller, N. E. Matsakis, P. A. Viola, “Learning from one example through shared densities on transforms,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 464– 471, 2000, doi: 10.1109/CVPR.2000.855856.
  • L. Fei-Fei, R. Fergus, P. Perona, “One-shot learning of object categories,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, pp. 594–611, 4 2006, doi: 10.1109/TPAMI.2006.79.
  • O. Vinyals, C. Blundell, T. Lillicrap, K. Kavukcuoglu, D. Wierstra, “Matching networks for one shot learning,” in Advances in Neural Information Processing Systems, 6 2016, pp. 3637–3645, Neural information processing systems foundation.
  • A. Shaban, S. Bansal, Z. Liu, I. Essa, B. Boots, “One-shot learning for semantic segmentation,” British Machine Vision Conference 2017, BMVC 2017, 9 2017, doi: 10.5244/c.31.167.
  • M. Woodward, C. Finn, “Active One-shot Learning,” arXiv, 2 2017.
  • P. Wang, L. Liu, C. Shen, Z. Huang, A. Van Den Hengel, H. T. Shen, “Multi-attention network for one shot learning,” 2017. doi: 10.1109/ CVPR.2017.658.
  • H. Altae-Tran, B. Ramsundar, A. S. Pappu, V. Pande, “Low Data Drug Discovery with One-Shot Learning,” ACS Central Science, vol. 3, pp. 283– 293, 4 2017, doi: 10.1021/acscentsci.6b00367.
  • C. Shorten, T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” Journal of Big Data, vol. 6, pp. 1–48, 12 2019, doi: 10.1186/s40537-019-0197-0.
  • Z. Zhong, L. Zheng, G. Kang, S. Li, Y. Yang, “Random erasing data augmentation,” 8 2020. Available: https://github.com/ zhunzhong07/Random-Erasing., doi: 10.1609/aaai.v34i07.7000.
  • L. Perez, J. Wang, “The Effectiveness of Data Augmentation in Image Classification using Deep Learning,” arXiv, 12 2017.
  • D. S. Park, W. Chan, Y. Zhang, C. C. Chiu, B. Zoph, E. D. Cubuk, Q. V. Le, “Specaugment: A simple data augmentation method for automatic speech recognition,” Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, vol. 2019-Septe, pp. 2613–2617, 4 2019, doi: 10.21437/Interspeech.2019-2680.
  • A. Kumar, A. Kaur, M. Kumar, “Face detection techniques: a review,” Artificial Intelligence Review, vol. 52, pp. 927–948, 8 2019, doi: 10.1007/ s10462-018- 9650-2.
  • P. Viola, M. J. Jones, “Robust Real-Time Face Detection,” International Journal of Computer Vision, vol. 57, pp. 137–154, 5 2004, doi: 10.1023/B:VISI.0000013087.49260.fb.
  • A. Jadhav, S. Lone, S. Matey, T. Madamwar, S. Jakhete, “Survey on Face Detection Algorithms,” 2021. Available: www.ijisrt.com.
  • X. Lu, X. Kang, S. Nishide, F. Ren, “Object detection based on SSDResNet,” in Proceedings of 2019 6th IEEE International Conference on Cloud Computing and Intelligence Systems, CCIS 2019, 12 2019, pp. 89–92, Institute of Electrical and Electronics Engineers Inc.
  • K. Zhang, Z. Zhang, Z. Li, Y. Qiao, “Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks,” IEEE Signal Processing Letters, vol. 23, pp. 1499–1503, 4 2016, doi: 10.1109/ LSP.2016.2603342.
  • Chunming Wu, Ying Zhang, “MTCNN and FACENET Based Access Control System for Face Detection and Recognition,” Automatic Control and Computer Sciences, vol. 55, pp. 102–112, 1 2021, doi: 10.3103/ S0146411621010090.
  • S. Milborrow, F. Nicolls, “Locating facial features with an extended active shape model,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5305 LNCS, 10 2008, pp. 504–513, Springer Verlag.
  • J. Saragih, R. Goecke, “A nonlinear discriminative approach to AAM fitting,” in Proceedings of the IEEE International Conference on Computer Vision, 2007.
  • N. Kumar, P. Belhumeur, S. Nayar, “FaceTracer: A search engine for large collections of images with faces,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5305 LNCS, 10 2008, pp. 340–353, Springer Verlag.
  • X. Cao, Y. Wei, F. Wen, J. Sun, “Face alignment by explicit shape regression,” International Journal of Computer Vision, vol. 107, no. 2, pp. 177–190, 2014, doi: 10.1007/s11263-013-0667-3.
  • G. Trigeorgis, P. Snape, M. A. Nicolaou, E. Antonakos, S. Zafeiriou, “Mnemonic Descent Method: A Recurrent Process Applied for Endto-End Face Alignment,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2016- Decem, 12 2016, pp. 4177–4187, IEEE Computer Society.
  • J. Lv, X. Shao, J. Xing, C. Cheng, X. Zhou, “A deep regression architecture with two-stage re-initialization for high performance facial landmark detection,” 2017. doi: 10.1109/CVPR.2017.393.
  • J. Yang, Q. Liu, K. Zhang, “Stacked Hourglass Network for Robust Facial Landmark Localisation,” 2017. Available: https://www. umdfaces.io., doi: 10.1109/CVPRW.2017.253.
  • A. Newell, K. Yang, J. Deng, “Stacked hourglass networks for human pose estimation,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9912 LNCS, pp. 483–499, 3 2016, doi: 10.1007/978- 3-319-46484-8_29.
  • J. Deng, G. Trigeorgis, Y. Zhou, S. Zafeiriou, “Joint Multi-View Face Alignment in the Wild,” IEEE Transactions on Image Processing, vol. 28, pp. 3636–3648, 8 2019, doi: 10.1109/TIP.2019.2899267.
  • A. Ahmed, J. Guo, F. Ali, F. Deeba, A. Ahmed, “LBPH based improved face recognition at low resolution,” in 2018 International Conference on Artificial Intelligence and Big Data, ICAIBD 2018, 6 2018, pp. 144–147, Institute of Electrical and Electronics Engineers Inc.
  • T. Baltrusaitis, A. Zadeh, Y. C. Lim, L. P. Morency, “OpenFace 2.0: Facial behavior analysis toolkit,” in Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, 6 2018, pp. 59–66, Institute of Electrical and Electronics Engineers Inc.
  • K. He, X. Zhang, S. Ren, J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2016-Decem, 12 2016, pp. 770– 778, IEEE Computer Society.
  • F. Schroff, D. Kalenichenko, J. Philbin, “FaceNet: A Unified Embedding for Face Recognition and Clustering,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 07-12- June-2015, pp. 815–823, 3 2015, doi: 10.1109/CVPR.2015.7298682.
  • Z. Wang, G. Wang, B. Huang, Z. Xiong, Q. Hong, H. Wu, P. Yi, K. Jiang, N. Wang, Y. Pei, H. Chen, Y. Miao, Z. Huang, J. Liang, “Masked Face Recognition Dataset and Application,” 3 2020.
  • H. Wang, Y. Wang, Z. Zhou, X. Ji, D. Gong, J. Zhou, Z. Li, W. Liu, “CosFace: Large Margin Cosine Loss for Deep Face Recognition,” 2018. doi: 10.1109/ CVPR.2018.00552.
  • W. Liu, Y. Wen, Z. Yu, M. Li, B. Raj, L. Song, “SphereFace: Deep hypersphere embedding for face recognition,” 2017. doi: 10.1109/CVPR.2017.713.
  • A. Suruliandi, A. Kasthuri, S. P. Raja, “Deep Feature Representation and Similarity Matrix based Noise Label Refinement Method for Efficient Face Annotation,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 7, pp. 2–66, doi: 10.9781/ijimai.2021.05.001.
  • “European Edge Computing Consortium(EECC).” Available: https://ecconsortium.eu/.
  • X. Jiang, F. R. Yu, T. Song, V. C. Leung, “Intelligent Resource Allocation for Video Analytics in Blockchain- Enabled Internet of Autonomous Vehicles with Edge Computing,” IEEE Internet of Things Journal, pp. 1–1, 9 2020, doi: 10.1109/jiot.2020.3026354.
  • M. Gheisari, G. Wang, S. Chen, “An Edge Computing- enhanced Internet of Things Framework for Privacy-preserving in Smart City,” Computers and Electrical Engineering, vol. 81, p. 106504, 1 2020, doi: 10.1016/j. compeleceng.2019.106504.
  • H. Albataineh, M. Nijim, D. Bollampall, “The Design of a Novel Smart Home Control System using Smart Grid Based on Edge and Cloud Computing,” 2020 8th International Conference on Smart Energy Grid Engineering, SEGE 2020, pp. 88–91, 8 2020, doi: 10.1109/SEGE49949.2020.9181961.
  • K. P. Dirgantoro, J. M. Lee, D. S. Kim, “Generative Adversarial Networks Based on Edge Computing with Blockchain Architecture for Security System,” 2020 International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2020, pp. 039– 042, 2 2020, doi: 10.1109/ICAIIC48513.2020.9065231.
  • L. J. Karam, T. Zhu, “Quality labeled faces in the wild (QLFW): a database for studying face recognition in real-world environments,” 2015. Available: http://vis-www.cs.umass.edu/lfw/., doi: 10.1117/12.2080393