Low-frequency Guided Self-supervised Learning for High-fidelity 3D Face Reconstruction in the Wild
Wang, Pengrui1,3; Lin, Chunze2; Xu, Bo3; Che, Wujun3; Wang, Quan2
2020-07
会议日期2020-7-6~2020-7-10
会议地点London, UK
英文摘要

In this paper, we propose a low-frequency guided self-supervised learning method for high-fidelity 3D face reconstruction from an in-the-wild image. 
Unlike other self-supervised methods only using the color difference between the original image and the estimated image, we add low-frequency albedo information to enhance the self-supervised learning for more realistic albedo while insensitive to the non-skin regions. 
Specifically, based on a PCA albedo model, we first train a Boosting Network (B-Net) to provide illumination and intact albedo distribution. Then with above information, we learn an image-to-image non-linear Facial Albedo Network (FAN) by self-supervision to produce a high-fidelity albedo.
We further propose a Detail Recovering Network (DRN) to recover geometric details such as wrinkles.
FAN and DRN permit to reconstruct 3D faces with high-fidelity albedo and geometry details. 
Finally, experimental results demonstrate the effectiveness of the proposed method.

内容类型会议论文
源URL[http://ir.ia.ac.cn/handle/173211/40394]  
专题数字内容技术与服务研究中心_听觉模型与认知计算
通讯作者Che, Wujun
作者单位1.University of Chinese Academy of Sciences, China
2.Sensetime Research
3.Institute of Automation, Chinese Academy of Sciences, China
推荐引用方式
GB/T 7714
Wang, Pengrui,Lin, Chunze,Xu, Bo,et al. Low-frequency Guided Self-supervised Learning for High-fidelity 3D Face Reconstruction in the Wild[C]. 见:. London, UK. 2020-7-6~2020-7-10.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace