Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences

Veena Mayya; Radhika M. Pai; M. M.Manohara Pai

doi:10.1109/ICACCI.2016.7732128

Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Micro-expressions are the hidden human emotions that are short lived and are very hard to detect them in real time conversations. Micro-expressions recognition has proven to be an important behavior source for lie detection during crime interrogation. SMIC and CASME II are the two widely used, spontaneous micro-expressions datasets which are available publicly with baseline results that uses LBP-TOP for feature extraction. Estimation of correct parameters is the key factor for feature extraction using LBP-TOP, which results in long computation time. In this paper, the video sequences are interpolated using temporal interpolation(TIM) and then the facial features are extracted using deep convolutional neural network(DCNN) on CUDA enabled General Purpose Graphics Processing Unit(GPGPU) system. Results show that the proposed combination of DCNN and TIM can achieve better performance than the results published in baseline publications. The feature extraction time is reduced due to the usage of GPU enabled systems.

Original language	English
Title of host publication	2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016
Editors	Joel J. P. C. Rodrigues, Patrick Siarry, Gregorio Martinez Perez, Raghuvir Tomar, Al-Sakib Khan Pathan, Sameep Mehta, Sabu M. Thampi, Stefano Berretti, Ravi Prakash Gorthi, Al-Sakib Khan Pathan, Jinsong Wu, Jie Li, Vivek Jain, Joel J. P. C. Rodrigues, Mohammed Atiquzzaman, Joel J. P. C. Rodrigues, Punam Bedi, Mohamed Habib Kammoun
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	699-703
Number of pages	5
ISBN (Electronic)	9781509020287
DOIs	https://doi.org/10.1109/ICACCI.2016.7732128
Publication status	Published - 02-11-2016
Event	5th International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016 - Jaipur, India Duration: 21-09-2016 → 24-09-2016

Publication series

Name	2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016

Conference

Conference	5th International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016
Country/Territory	India
City	Jaipur
Period	21-09-16 → 24-09-16

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 16 Peace, Justice and Strong Institutions

All Science Journal Classification (ASJC) codes

Information Systems
Computer Science (miscellaneous)
Computer Networks and Communications
Hardware and Architecture

Access to Document

10.1109/ICACCI.2016.7732128

Cite this

Mayya, V., Pai, R. M., & Pai, M. M. M. (2016). Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences. In J. J. P. C. Rodrigues, P. Siarry, G. M. Perez, R. Tomar, A.-S. K. Pathan, S. Mehta, S. M. Thampi, S. Berretti, R. P. Gorthi, A.-S. K. Pathan, J. Wu, J. Li, V. Jain, J. J. P. C. Rodrigues, M. Atiquzzaman, J. J. P. C. Rodrigues, P. Bedi, & M. H. Kammoun (Eds.), 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016 (pp. 699-703). Article 7732128 (2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICACCI.2016.7732128

Mayya, Veena ; Pai, Radhika M. ; Pai, M. M.Manohara. / Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences. 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016. editor / Joel J. P. C. Rodrigues ; Patrick Siarry ; Gregorio Martinez Perez ; Raghuvir Tomar ; Al-Sakib Khan Pathan ; Sameep Mehta ; Sabu M. Thampi ; Stefano Berretti ; Ravi Prakash Gorthi ; Al-Sakib Khan Pathan ; Jinsong Wu ; Jie Li ; Vivek Jain ; Joel J. P. C. Rodrigues ; Mohammed Atiquzzaman ; Joel J. P. C. Rodrigues ; Punam Bedi ; Mohamed Habib Kammoun. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 699-703 (2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016).

@inproceedings{cec5f82f90d04dcfbca430b07e19f7b5,

title = "Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences",

abstract = "Micro-expressions are the hidden human emotions that are short lived and are very hard to detect them in real time conversations. Micro-expressions recognition has proven to be an important behavior source for lie detection during crime interrogation. SMIC and CASME II are the two widely used, spontaneous micro-expressions datasets which are available publicly with baseline results that uses LBP-TOP for feature extraction. Estimation of correct parameters is the key factor for feature extraction using LBP-TOP, which results in long computation time. In this paper, the video sequences are interpolated using temporal interpolation(TIM) and then the facial features are extracted using deep convolutional neural network(DCNN) on CUDA enabled General Purpose Graphics Processing Unit(GPGPU) system. Results show that the proposed combination of DCNN and TIM can achieve better performance than the results published in baseline publications. The feature extraction time is reduced due to the usage of GPU enabled systems.",

author = "Veena Mayya and Pai, \{Radhika M.\} and Pai, \{M. M.Manohara\}",

note = "Publisher Copyright: {\textcopyright} 2016 IEEE.; 5th International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016 ; Conference date: 21-09-2016 Through 24-09-2016",

year = "2016",

month = nov,

day = "2",

doi = "10.1109/ICACCI.2016.7732128",

language = "English",

series = "2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "699--703",

editor = "Rodrigues, \{Joel J. P. C.\} and Patrick Siarry and Perez, \{Gregorio Martinez\} and Raghuvir Tomar and Pathan, \{Al-Sakib Khan\} and Sameep Mehta and Thampi, \{Sabu M.\} and Stefano Berretti and Gorthi, \{Ravi Prakash\} and Pathan, \{Al-Sakib Khan\} and Jinsong Wu and Jie Li and Vivek Jain and Rodrigues, \{Joel J. P. C.\} and Mohammed Atiquzzaman and Rodrigues, \{Joel J. P. C.\} and Punam Bedi and Kammoun, \{Mohamed Habib\}",

booktitle = "2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016",

address = "United States",

}

Mayya, V , Pai, RM & Pai, MMM 2016, Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences. in JJPC Rodrigues, P Siarry, GM Perez, R Tomar, A-SK Pathan, S Mehta, SM Thampi, S Berretti, RP Gorthi, A-SK Pathan, J Wu, J Li, V Jain, JJPC Rodrigues, M Atiquzzaman, JJPC Rodrigues, P Bedi & MH Kammoun (eds), 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016., 7732128, 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016, Institute of Electrical and Electronics Engineers Inc., pp. 699-703, 5th International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016, Jaipur, India, 21-09-16. https://doi.org/10.1109/ICACCI.2016.7732128

Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences. / Mayya, Veena ; Pai, Radhika M.; Pai, M. M.Manohara.
2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016. ed. / Joel J. P. C. Rodrigues; Patrick Siarry; Gregorio Martinez Perez; Raghuvir Tomar; Al-Sakib Khan Pathan; Sameep Mehta; Sabu M. Thampi; Stefano Berretti; Ravi Prakash Gorthi; Al-Sakib Khan Pathan; Jinsong Wu; Jie Li; Vivek Jain; Joel J. P. C. Rodrigues; Mohammed Atiquzzaman; Joel J. P. C. Rodrigues; Punam Bedi; Mohamed Habib Kammoun. Institute of Electrical and Electronics Engineers Inc., 2016. p. 699-703 7732128 (2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences

AU - Mayya, Veena

AU - Pai, Radhika M.

AU - Pai, M. M.Manohara

PY - 2016/11/2

Y1 - 2016/11/2

N2 - Micro-expressions are the hidden human emotions that are short lived and are very hard to detect them in real time conversations. Micro-expressions recognition has proven to be an important behavior source for lie detection during crime interrogation. SMIC and CASME II are the two widely used, spontaneous micro-expressions datasets which are available publicly with baseline results that uses LBP-TOP for feature extraction. Estimation of correct parameters is the key factor for feature extraction using LBP-TOP, which results in long computation time. In this paper, the video sequences are interpolated using temporal interpolation(TIM) and then the facial features are extracted using deep convolutional neural network(DCNN) on CUDA enabled General Purpose Graphics Processing Unit(GPGPU) system. Results show that the proposed combination of DCNN and TIM can achieve better performance than the results published in baseline publications. The feature extraction time is reduced due to the usage of GPU enabled systems.

AB - Micro-expressions are the hidden human emotions that are short lived and are very hard to detect them in real time conversations. Micro-expressions recognition has proven to be an important behavior source for lie detection during crime interrogation. SMIC and CASME II are the two widely used, spontaneous micro-expressions datasets which are available publicly with baseline results that uses LBP-TOP for feature extraction. Estimation of correct parameters is the key factor for feature extraction using LBP-TOP, which results in long computation time. In this paper, the video sequences are interpolated using temporal interpolation(TIM) and then the facial features are extracted using deep convolutional neural network(DCNN) on CUDA enabled General Purpose Graphics Processing Unit(GPGPU) system. Results show that the proposed combination of DCNN and TIM can achieve better performance than the results published in baseline publications. The feature extraction time is reduced due to the usage of GPU enabled systems.

UR - https://www.scopus.com/pages/publications/85007359830

UR - https://www.scopus.com/pages/publications/85007359830#tab=citedBy

U2 - 10.1109/ICACCI.2016.7732128

DO - 10.1109/ICACCI.2016.7732128

M3 - Conference contribution

AN - SCOPUS:85007359830

T3 - 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016

SP - 699

EP - 703

BT - 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016

A2 - Rodrigues, Joel J. P. C.

A2 - Siarry, Patrick

A2 - Perez, Gregorio Martinez

A2 - Tomar, Raghuvir

A2 - Pathan, Al-Sakib Khan

A2 - Mehta, Sameep

A2 - Thampi, Sabu M.

A2 - Berretti, Stefano

A2 - Gorthi, Ravi Prakash

A2 - Pathan, Al-Sakib Khan

A2 - Wu, Jinsong

A2 - Li, Jie

A2 - Jain, Vivek

A2 - Rodrigues, Joel J. P. C.

A2 - Atiquzzaman, Mohammed

A2 - Rodrigues, Joel J. P. C.

A2 - Bedi, Punam

A2 - Kammoun, Mohamed Habib

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 5th International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016

Y2 - 21 September 2016 through 24 September 2016

ER -

Mayya V , Pai RM , Pai MMM. Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences. In Rodrigues JJPC, Siarry P, Perez GM, Tomar R, Pathan ASK, Mehta S, Thampi SM, Berretti S, Gorthi RP, Pathan ASK, Wu J, Li J, Jain V, Rodrigues JJPC, Atiquzzaman M, Rodrigues JJPC, Bedi P, Kammoun MH, editors, 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 699-703. 7732128. (2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016). doi: 10.1109/ICACCI.2016.7732128

Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences

Abstract

Publication series

Conference

UN SDGs

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this