Deakin University
Browse

Sparsity in dynamics of spontaneous subtle emotions: analysis and application

Version 2 2024-06-13, 12:43
Version 1 2019-05-02, 13:59
journal contribution
posted on 2024-06-13, 12:43 authored by AC Le Ngo, J See, RCW Phan
Subtle emotions are present in diverse real-life situations: in hostile environments, enemies and/or spies maliciouslyconceal their emotions as part of their deception; in life-threatening situations, victims under duress have no choice but to withhold theirreal feelings; in the medical scene, patients with psychological conditions such as depression could either be intentionally orsubconsciously suppressing their anguish from loved ones. Under such circumstances, it is often crucial that these subtle emotions arerecognized before it is too late. These spontaneous subtle emotions are typically expressed through micro-expressions, which are tiny,sudden and short-lived dynamics of facial muscles; thus, such micro-expressions pose a great challenge for visual recognition. Theabrupt but significant dynamics for the recognition task are temporally sparse while the rest, i.e. irrelevant dynamics, are temporallyredundant. In this work, we analyze and enforce sparsity constraints to learn significant temporal and spectral structures whileeliminating irrelevant facial dynamics of micro-expressions, which would ease the challenge in the visual recognition of spontaneoussubtle emotions. The hypothesis is confirmed through experimental results of automatic spontaneous subtle emotion recognition withseveral sparsity levels on CASME II and SMIC, the two well-established and publicly available spontaneous subtle emotion databases.The overall performances of the automatic subtle emotion recognition are boosted when only significant dynamics of the originalsequences are preserved.

History

Journal

IEEE transactions on affective computing

Volume

8

Season

Jul-Sep

Pagination

396-411

Location

Piscataway, N.J.

ISSN

1949-3045

Language

eng

Publication classification

C1.1 Refereed article in a scholarly journal

Copyright notice

2016, IEEE

Issue

3

Publisher

Institute of Electrical and Electronics Engineers