Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing

doi:10.1109/TII.2020.3002239

	Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing
	Yang, Bo 1; Zhang, Jialin 2; Shi, Huaguang 2
刊名	IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
	2021-05-01
卷号	17 期号:5 页码:3599-3608
关键词	Task analysis Manufacturing Heuristic algorithms Training Image edge detection Computer architecture Coordinated manufacturing industrial cyber– physical systems multiagent imitation learning
ISSN号	1551-3203
DOI	10.1109/TII.2020.3002239
英文摘要	Concordant operations among automatic industrial devices (i.e., agents) play a significant role in achieving efficient smart manufacturing. Existing multiagent cooperation methods focus on centralized training with decentralized execution, which is unsuitable for the edge-based distributed industrial scenarios. To harmonize distributed devices' actions and enhance the production efficiency, in this article, we propose an Interactive-Imitation-based Distributed Coordination (IIDC) algorithm. Specifically, we leverage the generative adversarial imitation learning (GAIL) model to direct one agent's actions by following external professional demonstrations. We also adopt the self-imitation learning (SIL) model to direct one agent's potential actions by following its own previous good experiences. As the imperfect demonstrations in the GAIL-based interagent imitation process may degrade the imitation accuracy, we present a confidence-based matching method to reduce the gap between the professional and imitative behaviors. Furthermore, during the SIL-based intra-agent imitation process, the rewardless explorations also lead to nonoptimal imitation policy. We then present a Stein variational policy gradient based self-imitation method to learn an expected optimal policy. We validate the IIDC algorithm's effectiveness via the sequential assembly task. Evaluation results demonstrate that the IIDC algorithm can enhance the production efficiency evidently.
资助项目	National Natural Science Foundation of China[62002346] ; National Natural Science Foundation of China[TII-20-0469]
WOS研究方向	Automation & Control Systems ; Computer Science ; Engineering
语种	英语
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号	WOS:000622100800060
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/16887]
专题	中国科学院计算技术研究所
通讯作者	Yang, Bo
作者单位	1.Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
推荐引用方式 GB/T 7714	Yang, Bo,Zhang, Jialin,Shi, Huaguang. Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing[J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,2021,17(5):3599-3608.
APA	Yang, Bo,Zhang, Jialin,&Shi, Huaguang.(2021).Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing.IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,17(5),3599-3608.
MLA	Yang, Bo,et al."Interactive-Imitation-Based Distributed Coordination Scheme for Smart Manufacturing".IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 17.5(2021):3599-3608.