Open Access Open Access  Restricted Access Subscription Access

An Abnormal Expression Detection System (AEDS) Using Deep Learning Algorithms

Nimmagadda Muralikrishna, Dwiti Krishna Bebarta, Angadi Seshagiri Rao

Abstract


In the last decade, many deep learning algorithms have achieved remarkable success and gained popularity in various computer vision tasks, including object detection, image recognition, and segmentation. This AEDS (Abnormal Expression Detection System)leverages the power of deep learning algorithms to detect abnormal facial expressions in real-time automatically. AEDS proposed two important models; those are Deep CNN and RNN. CNN is responsible for learning discriminative features from facial images and capturing local and global information. These features are fed into the RNN, which can effectively model the temporal dependencies present in facial expressions. To train the AEDS, a large dataset of facial expressions, comprising both normal and abnormal instances, is collected and labeled. Data augmentation techniques enhance the model's generalization capabilities and reduce overfitting. The deep learning model is trained using this dataset supervised, where the ground truth labels indicate normal or abnormal expressions. The evaluation of the AEDS is performed on an independent test set, and AEDS outcomes prove high accuracy and robustness in detecting strange facial expressions. Furthermore, the system exhibits real-time performance, making it fit for the many applications, for instance, security monitoring, healthcare, and human-computer interaction.


Keywords


Abnormal Expression Detection System (AEDS), Deep Learning (DL), Recurrent Neural Network (RNN), Deep Convolutional Neural Network (CNN)

Full Text:

PDF

References


Yadan Lv, Zhiyong Feng, Chao Xu. Facial expression recognition via deep learning. In 2014 IEEE International Conference on Smart Computing. 2014 Nov 3; 303–308.

Majid Mehmood R, Du R, Lee HJ. Optimal feature selection and deep learning ensembles method for emotion recognition from human brain EEG sensors. IEEE Access. 2017; 5: 14797–14806.

Li S, Deng W, Du J. Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA. 2017 Jul; 2852–2861.

Chen L, Zhou M, Su W, Wu M, She J, Hirota K. Softmax regression based deep sparse autoencoder network for facial emotion recognition in human-robot interaction. Inf Sci. 2018; 428: 49–61.

Babajee P, Suddul G, Armoogum S, Foogooa R. Identifying human emotions from facial expressions with deep learning. In Proceedings of the 2020 IEEE Zooming Innovation in Consumer Technologies Conference (ZINC), Novi Sad, Serbia. 2020 May; 36–39.

Hassouneh A, Mutawa AM, Murugappan M. Development of a real-time emotion recognition system using facial expressions and EEG based on machine learning and deep neural network methods. Inform Med Unlocked. 2020; 20: 100372.

Tan C, Šarlija M, Kasabov N. NeuroSense: short-term emotion recognition and understanding based on spiking neural network modelling of spatio-temporal EEG patterns. Neurocomputing. 2021; 434: 137–148.

Satyanarayana P, Vardhan DP, Tejaswi R, Kumar SVP. Emotion recognition by deep learning and cloud access. In Proceedings of the 2021 IEEE 3rd International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India. 2021 Dec; 360–365.

Jayanthi K, Mohan S. An integrated framework for emotion recognition using speech and static images with deep classifier fusion approach. Int J Inf Technol. 2022; 14: 3401–3411.

Li S, Deng W. Deep Facial Expression Recognition: A Survey. IEEE Trans Affect Comput. 2020; 7(3): 1195–1215.

Yadahalli SS, Rege S, Kulkarni S. Facial micro expression detection using deep learning architecture. In Proceedings of the 2020 IEEE International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India. 2020 Sep; 167–171.

Yang B, Han X, Tang J. Three class emotions recognition based on deep learning using staked autoencoder. In Proceedings of the 2017 IEEE 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), Shanghai, China. 2017 Oct; 1–5.

Asaju C, Vadapalli H. A temporal approach to facial emotion expression recognition. In Proceedings of the Southern African Conference for Artificial Intelligence Research. Cham: Springer; 2021 Jan; 274–286.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Journal of Computer Technology & Applications