Micro Expression Recognition

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks
Alternatives To Micro Expression Recognition
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
3d Resnets Pytorch2,677
2 years ago120mitPython
3D ResNets for Action Recognition (CVPR 2018)
Sparseconvnet1,781
2 months ago2July 10, 201950otherC++
Submanifold sparse convolutional networks
Face_specific_augm373
4 years ago1Jupyter Notebook
Face Renderer to perform Domain (Face) Specific Data Augmentation
Historyobjectrecognition288
6 years ago3Python
Pytorch Mfnet231
4 years ago14mitPython
Facecept3d151
7 years ago6mitC++
FaceCept3D: 3D Face Analysis and Recognition
3d Densenet113
4 years ago13mitPython
3D Dense Connected Convolutional Network (3D-DenseNet for action recognition)
Opendetection98
5 years ago15bsd-3-clauseC++
OpenDetection is a standalone open source project for object detection and recognition in images and 3D point clouds.
Gcode Preview92
124 days ago21September 21, 20223mitG-code
A simple GCode parser & previewer with 3D printing in mind. Written in Typescript.
3d Resnets88
5 years ago1mitLua
3D ResNets for Action Recognition
Alternatives To Micro Expression Recognition
Select To Compare


Alternative Project Comparisons
Readme

Spontaneous Facial Micro Expression Recognition using 3D Spatio-Temporal Convolutional Neural Networks

Abstract

Facial expression recognition in videos is an active area of research in computer vision. However, fake facial expressions are difficult to be recognized even by humans. On the other hand, facial micro-expressions generally represent the actual emotion of a person, as it is a spontaneous reaction expressed through human face. Despite of a few attempts made for recognizing micro-expressions, still the problem is far from being a solved problem, which is depicted by the poor rate of accuracy shown by the state-of-the-art methods. A few CNN based approaches are found in the literature to recognize micro-facial expressions from still images. Whereas, a spontaneous micro-expression video contains multiple frames that have to be processed together to encode both spatial and temporal information. This paper proposes two 3D-CNN methods: MicroExpSTCNN and MicroExpFuseNet, for spontaneous facial micro-expression recognition by exploiting the spatiotemporal information in CNN framework. The MicroExpSTCNN considers the full spatial information, whereas the MicroExpFuseNet is based on the 3D-CNN feature fusion of the eyes and mouth regions. The experiments are performed over CAS(ME)^2 and SMIC micro-expression databases. The proposed MicroExpSTCNN model outperforms the state-of-the-art methods.

Prerequisites

Results

Method Proposed Year Method Type CAS(ME)^2 SMIC
LBP-TOP 2013 HCM - 42.72%
STCLQP 2016 HCM - 64.02%
CNN with Augumentation 2017 DLM 78.02% -
3D-FCNN 2018 DLM - 55.49%
MicroExpSTCNN Proposed DLM 87.80% 68.75%
Intermediate MicroExpFuseNet Proposed DLM 83.25% 54.77%
Late MicroExpFuseNet Proposed DLM 79.31% 64.82%

Validation Data and Weights

CASME-SQUARE

SMIC

Citation

If you use this code in your research, we would appreciate a citation:

@article{reddy2019microexpression,
        title={Spontaneous Facial Micro-Expression Recognition using 3D Spatiotemporal Convolutional Neural Networks},
        author={Sai Prasanna Teja, Reddy and Surya Teja, Karri and Dubey, Shiv Ram and Mukherjee, Snehasis},
        journal={International Joint Conference on Neural Networks},
        year={2019}
        }

License

Copyright (c) 2019 Bogireddy Teja Reddy. Released under the MIT License. See LICENSE for details.

Popular 3d Graphics Projects
Popular Recognition Projects
Popular Graphics Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
3d
Cnn
Recognition