Dual-Prior Integrated Image Reconstruction for Quanta Image Sensors Using Multi-Agent Consensus Equilibrium

doi:10.1109/JAS.2023.123390

CORC > 自动化研究所 > 中国科学院自动化研究所 > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	Dual-Prior Integrated Image Reconstruction for Quanta Image Sensors Using Multi-Agent Consensus Equilibrium
	Dan Zhang; Qiusheng Lian; Yueming Su; Tengfei Ren
刊名	IEEE/CAA Journal of Automatica Sinica
	2023
卷号	10 期号:6 页码:1407-1420
关键词	Dual prior image reconstruction multi-agent consensus equilibrium (MACE) quanta image sensors (QIS)
ISSN号	2329-9266
DOI	10.1109/JAS.2023.123390
英文摘要	Quanta image sensors (QIS) are a new type of single-photon imaging device that can oversample the light field to generate binary bit-streams. The reconstruction for QIS refers to the recovery of original scenes from these binary measurements. Conventional reconstruction algorithms for QIS generally depend solely on one instantiated prior and are certainly insufficient for capturing the statistical properties over high-dimensional space. On the other hand, deep learning-based methods have shown promising performance, due to their excellent ability to learn feature representations from relevant databases. However, most deep models only focus on exploring local features while generally overlooking long-range similarity. In view of this, a dual-prior integrated reconstruction algorithm for QIS (DPI-QIS) is proposed, which combines a deep prior with a non-local self-similarity one using the multi-agent consensus equilibrium (MACE) framework. In comparison to the approaches that utilize a single prior, DPI-QIS fits the reconstruction model sufficiently by leveraging the respective merits of both priors. An effective yet flexible MACE framework is employed to integrate the physical forward model allying with the two prior-based models to achieve an overall better result. Extensive experiments demonstrate that the proposed algorithm achieves state-of-the-art performance in terms of objective and visual perception at multiple oversampling factors, while having stronger robustness to noise.
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/51678]
专题	自动化研究所_学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Dan Zhang,Qiusheng Lian,Yueming Su,et al. Dual-Prior Integrated Image Reconstruction for Quanta Image Sensors Using Multi-Agent Consensus Equilibrium[J]. IEEE/CAA Journal of Automatica Sinica,2023,10(6):1407-1420.
APA	Dan Zhang,Qiusheng Lian,Yueming Su,&Tengfei Ren.(2023).Dual-Prior Integrated Image Reconstruction for Quanta Image Sensors Using Multi-Agent Consensus Equilibrium.IEEE/CAA Journal of Automatica Sinica,10(6),1407-1420.
MLA	Dan Zhang,et al."Dual-Prior Integrated Image Reconstruction for Quanta Image Sensors Using Multi-Agent Consensus Equilibrium".IEEE/CAA Journal of Automatica Sinica 10.6(2023):1407-1420.