Generalized Actor-Critic Learning Optimal Control in Smart Home Energy Management

doi:10.1109/TII.2020.3042631

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 智能化团队

	Generalized Actor-Critic Learning Optimal Control in Smart Home Energy Management
	Wei, Qinglai 1,2,3; Liao, Zehua 1,2; Shi, Guang 4
刊名	IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
	2021-10-01
卷号	17 期号:10 页码:6614-6623
关键词	Optimal control Process control Smart homes Dynamic programming Numerical models Iterative methods Informatics Actor-critic learning adaptive critic designs adaptive dynamic programming (ADP) approximate dynamic programming energy management optimal control smart grid
ISSN号	1551-3203
DOI	10.1109/TII.2020.3042631
通讯作者	Wei, Qinglai(qinglai.wei@ia.ac.cn)
英文摘要	This article is concerned with a new generalized actor-critic learning (GACL) optimal control method. It aims at the optimal energy control and management for smart home systems, which is expected to minimize the consumption cost for home users. In the present GACL optimal control method, it is the first time that three iteration processes, which are global iteration, local iteration, and interior iteration, respectively, are established to obtain the optimal energy control law. The main contribution of the developed method is to establish a common iteration structure for both value and policy iterations in adaptive dynamic programming based on a control law sequence in each iteration for periodic time-varying systems, instead of a single control law, and simultaneously accelerates the convergence rate. The monotonicity, convergence, and optimality of the iterative value function for the GACL optimal control method are proven. Finally, numerical results and comparisons are displayed to show the superiority of the developed method.
资助项目	National Key Research and Development Program of China[2018YFB1702300] ; National Natural Science Foundation of China[61722312] ; National Natural Science Foundation of China[61533017] ; National Defense Basic Scientific Research Program[JCKY2019203C029] ; National Defense Basic Scientific Research Program[TII-20-2091]
WOS关键词	STORAGE SYSTEM ; OPTIMIZATION ; USER
WOS研究方向	Automation & Control Systems ; Computer Science ; Engineering
语种	英语
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
WOS记录号	WOS:000673414500006
资助机构	National Key Research and Development Program of China ; National Natural Science Foundation of China ; National Defense Basic Scientific Research Program
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/45508]
专题	自动化研究所_复杂系统管理与控制国家重点实验室_智能化团队
通讯作者	Wei, Qinglai
作者单位	1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 3.Macau Univ Sci & Technol, Inst Syst Engn, Macau 999078, Peoples R China 4.Coordinat Ctr China, Natl Comp Network Emergency Response Tech Team, Beijing 100029, Peoples R China
推荐引用方式 GB/T 7714	Wei, Qinglai,Liao, Zehua,Shi, Guang. Generalized Actor-Critic Learning Optimal Control in Smart Home Energy Management[J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,2021,17(10):6614-6623.
APA	Wei, Qinglai,Liao, Zehua,&Shi, Guang.(2021).Generalized Actor-Critic Learning Optimal Control in Smart Home Energy Management.IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,17(10),6614-6623.
MLA	Wei, Qinglai,et al."Generalized Actor-Critic Learning Optimal Control in Smart Home Energy Management".IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 17.10(2021):6614-6623.