Micro-expression recognition by two-stream difference network | |
Pan, Hang2; Xie, Lun2; Li, Juan3; Lv, Zeping1; Wang, Zhiliang2 | |
刊名 | IET COMPUTER VISION |
2021-09-01 | |
通讯作者邮箱 | xielun@ustb.edu.cn |
卷号 | 15期号:6页码:440-448 |
ISSN号 | 1751-9632 |
DOI | 10.1049/cvi2.12030 |
产权排序 | 2 |
文献子类 | 实证研究 |
英文摘要 | Facial micro-expression is a superposition of micro-expression features and identity information of a subject. For the problem of identity information interference in micro-expression recognition, this study proposes a new method for facial micro-expression recognition by de-identity information, called two-stream difference network (TSDN). First, a two-stream encoder-decoder network is trained by a convolutional neural network, where the input of the micro-expression stream is a micro-expression image, and the identity stream is a facial identity image. The micro-expression image is the apex image, and the identity image is the onset image in the micro-expression sequence. The identity information and micro-expression features are recorded in the intermediate layer of the micro-expression stream, while the intermediate layer of the identity stream contains only the identity information of a subject. Then, the identity information is removed by the difference network, but micro-expression features are stored in the intermediate layer of the micro-expression stream. Given the sequence of the micro-expressions, the TSDN model of de-identity information learns the difference that stores in the expression stream. Two public spontaneous facial micro-expression data sets (SMIC and CASME II) are employed in our experiments. The experiment results show that our model can achieve a superior performance in micro-expression recognition. |
收录类别 | SCI |
资助项目 | National Key R&D Programme of China[2018YFC 2001700] ; National Natural Science Foundation of China[61672093] ; Advanced Innovation Centre for Intelligent Robots and Systems Open Research Project[2018IRS01] |
WOS研究方向 | Computer Science ; Engineering |
语种 | 英语 |
出版者 | WILEY |
WOS记录号 | WOS:000684219300005 |
资助机构 | National Key R&D Programme of China ; National Natural Science Foundation of China ; Advanced Innovation Centre for Intelligent Robots and Systems Open Research Project |
内容类型 | 期刊论文 |
源URL | [http://ir.psych.ac.cn/handle/311026/40019] |
专题 | 心理研究所_中国科学院心理健康重点实验室 |
通讯作者 | Xie, Lun |
作者单位 | 1.Natl Res Ctr Rehabil Tech Aids, Affiliated Rehabil Hosp, Beijing, Peoples R China 2.Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing, Peoples R China 3.Chinese Acad Sci, Ctr Aging Psychol, Inst Psychol, Key Lab Mental Hlth, Beijing, Peoples R China |
推荐引用方式 GB/T 7714 | Pan, Hang,Xie, Lun,Li, Juan,et al. Micro-expression recognition by two-stream difference network[J]. IET COMPUTER VISION,2021,15(6):440-448. |
APA | Pan, Hang,Xie, Lun,Li, Juan,Lv, Zeping,&Wang, Zhiliang.(2021).Micro-expression recognition by two-stream difference network.IET COMPUTER VISION,15(6),440-448. |
MLA | Pan, Hang,et al."Micro-expression recognition by two-stream difference network".IET COMPUTER VISION 15.6(2021):440-448. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论