Facial Micro-Expression Recognition using Feature Extraction

IJCSEC Front Page

Abstract:
Micro-expressions are rapid, involuntary facial expressions which reveal emotions that people do not intend to show. Studying small expressions is effective as recognizing them has several vital applications, notably in forensic science and psychotherapy. However, analyzing spontaneous Micro expressions is very challenging due to their short duration and low intensity. Nowadays, Video-based facial expression recognition has received significant attention because of its wide spread applications. One key issue for video-based facial expression analysis in practice is how to extract dynamic features. This work proposes a novel approach using histogram sequence of local binary patterns from three orthogonal planes (LBP-TOP). In this approach, every facial image sequence is firstly convolved with Gabor filters to extract the Gabor Magnitude Sequences (GMSs) that extract local information of magnitude, phase and orientation. The main Facial action units which are located at eye and mouth regions of face are extracted and apply feature extraction to increase the discrimination for micro-expressions. For classification nearest neighbour method is exploited. Our experimental results on CASME2 database demonstrate that proposed method achieved better results compared to other methods in past years.

Keywords: Micro-Expressions, Gabor filters, LBP-TOP, Nearest Neighbour method.

References:

  1. E. A. Haggard,et. al., “Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy,” In: Auerback A, Ed: Methods of Research in Psychotherapy. New York: Appleton Century Crofts,pp.154-165,1966.
  2. P. Ekman and W. V. Friesen, “Nonverbal leakage and clues to deception,” Psychiatry, vol. 32, pp. 88–97, February 1969.
  3. Guo, Yanjun, et al. "Micro-expression recognition based on local binary patterns from three orthogonal planes and nearest neighbor method." Neural Networks (IJCNN), 2014 International Joint Conference on. IEEE, 2014.
  4. C. Shan,et. al., Facial expression recognition based on Local Binary Patterns: A comprehensive study, Image and Vision Computing , 27(6): 803–816, 2009.
  5. Duan, Xiaodong, et al. "Recognizing spontaneous micro-expression from eye region." Neurocomputing 217 (2016): 27-36.
  6. .Wang,R.F.Li,K.Wang,etal.,”Feature representation for facial expression recognition based on FACS and LBP”, Int.J. Autom. Comput. 11(5) (2015) 459–468.
  7. Q.Zou,J.Zeng,L.Cao,etal.,”A novel features ranking metric with application to scalable visual and bioinformatics data classification”, Neurocomputing 173 (2015)346–354.
  8. C.Ding,H.Peng,”Minimum redundancy feature selection from microarray gene expression data”, J.Bioinform. Comput.Biol. 3(2)(2003)523–528.
  9. J. Zou, C. Liu, Y. Zhang and G. Lu, Object recognition using Gabor co-occurrence similarity, Pattern Recognition, 46(1):434–448, 2012.
  10. M. Yang and L. Zhang, Gabor feature based sparse representation for face recognition with gabor occlusion dictionary, In European Conference on Computer Vision (ECCV), 2010: 448–461.
  11. S. Polikovsky, Y. Kameda and Y. Ohta, “Facial micro-expression recognition using high speed camera and 3D-gradient descriptor,” 3rd International Conference on Imaging for Crime Detection and Prevention (ICDP 2009), January 2009.
  12. K. Wang, B. Chen and G. Wu, Edge detection from high-resolution remotely sensed imagery based on Gabor filter in frequency domain, In IEEE International Conference on Geoinformatics, 2010: 1–6.
  13. Yan, Wen-Jing, et al. "CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces." Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on. IEEE, 2013
  14. Ekman, Paul. Telling lies: Clues to deceit in the marketplace, politics, and marriage (revised edition). WW Norton & Company, 2009.
  15. Almaev,et. al., "Local gabor binary patterns from three orthogonal planes for automatic facial expression recognition." Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on. IEEE, 2013.