论文标题

AFFDEX 2.0:实时面部表达分析工具包

AFFDEX 2.0: A Real-Time Facial Expression Analysis Toolkit

论文作者

Bishay, Mina, Preston, Kenneth, Strafuss, Matthew, Page, Graham, Turcot, Jay, Mavadati, Mohammad

论文摘要

在本文中,我们介绍了AffDex 2.0-一种用于分析野外面部表情的工具包,也就是说,它是针对目标的用户; a)估计3D头姿势,b)检测面部动作单元(AUS),c)识别基本情绪和2个新的情绪状态(感性和混乱),d)检测高水平的表达指标,例如眨眼和注意力。 AFFDEX 2.0模型主要基于深度学习,并使用大型自然主义数据集进行了培训,该数据集由来自不同人口组的数千名参与者组成。 AffDex 2.0是我们以前的工具包的增强版本[1],能够在更具挑战性的条件下有效地跟踪面对面,检测到更准确的面部表情以及识别新的情绪状态(感性和混乱)。 AffDex 2.0可以实时处理多个面,并且可以在Windows和Linux平台上工作。

In this paper we introduce AFFDEX 2.0 - a toolkit for analyzing facial expressions in the wild, that is, it is intended for users aiming to; a) estimate the 3D head pose, b) detect facial Action Units (AUs), c) recognize basic emotions and 2 new emotional states (sentimentality and confusion), and d) detect high-level expressive metrics like blink and attention. AFFDEX 2.0 models are mainly based on Deep Learning, and are trained using a large-scale naturalistic dataset consisting of thousands of participants from different demographic groups. AFFDEX 2.0 is an enhanced version of our previous toolkit [1], that is capable of tracking efficiently faces at more challenging conditions, detecting more accurately facial expressions, and recognizing new emotional states (sentimentality and confusion). AFFDEX 2.0 can process multiple faces in real time, and is working across the Windows and Linux platforms.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源