A Survey on Collaborative DNN Inference for Edge Intelligence

doi:10.1007/s11633-022-1391-7

CORC > 自动化研究所 > 中国科学院自动化研究所 > 学术期刊 > International Journal of Automation and Computing

	A Survey on Collaborative DNN Inference for Edge Intelligence
	Wei-Qing Ren 2
刊名	Machine Intelligence Research
	2023
卷号	20 期号:3 页码:370-395
关键词	Artificial intelligence (AI), edge intelligence (EI), distributed computing, deep neural network (DNN), collaborative inference
ISSN号	2731-538X
DOI	10.1007/s11633-022-1391-7
英文摘要	With the vigorous development of artificial intelligence (AI), intelligence applications based on deep neural networks (DNNs) have changed people's lifestyles and production efficiency. However, the large amount of computation and data generated from the network edge becomes the major bottleneck, and the traditional cloud-based computing mode has been unable to meet the requirements of realtime processing tasks. To solve the above problems, by embedding AI model training and inference capabilities into the network edge, edge intelligence (EI) becomes a cutting-edge direction in the field of AI. Furthermore, collaborative DNN inference among the cloud, edge, and end devices provides a promising way to boost EI. Nevertheless, at present, EI oriented collaborative DNN inference is still in its early stage, lacking systematic classification and discussion of existing research efforts. Motivated by it, we have comprehensively investigated recent studies on EI-oriented collaborative DNN inference. In this paper, we first review the background and motivation of EI. Then, we classify four typical collaborative DNN inference paradigms for EI, and analyse their characteristics and key technologies. Finally, we summarize the current challenges of collaborative DNN inference, discuss future development trends and provide future research directions.
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/51707]
专题	自动化研究所_学术期刊_International Journal of Automation and Computing
作者单位	1.Department of Computing, Hong Kong Polytechnic University, Hong Kong 999077, China 2.College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211100, China
推荐引用方式 GB/T 7714	Wei-Qing Ren. A Survey on Collaborative DNN Inference for Edge Intelligence[J]. Machine Intelligence Research,2023,20(3):370-395.
APA	Wei-Qing Ren.(2023).A Survey on Collaborative DNN Inference for Edge Intelligence.Machine Intelligence Research,20(3),370-395.
MLA	Wei-Qing Ren."A Survey on Collaborative DNN Inference for Edge Intelligence".Machine Intelligence Research 20.3(2023):370-395.