Optimal control for discrete-time affine non-linear systems using general value iteration

CORC > 自动化研究所 > 中国科学院自动化研究所 > 复杂系统管理与控制国家重点实验室 > 智能化团队

	Optimal control for discrete-time affine non-linear systems using general value iteration
	Li, H.; Liu, D.
刊名	IET CONTROL THEORY AND APPLICATIONS
	2012-12-01
卷号	6 期号:18 页码:2725-2736
英文摘要	In this study, the authors propose a novel adaptive dynamic programming scheme based on general value iteration (VI) to obtain near optimal control for discrete-time affine non-linear systems with continuous state and control spaces. First, the selection of initial value function is different from the traditional VI, and a new method is introduced to demonstrate the convergence property and convergence speed of value function. Then, the control law obtained at each iteration can stabilise the system under some conditions. At last, an error-bound-based condition is derived considering the approximation errors of neural networks, and then the error between the optimal and approximated value functions can also be estimated. To facilitate the implementation of the iterative scheme, three neural networks with Levenberg-Marquardt training algorithm are used to approximate the unknown system, the value function and the control law. Two simulation examples are presented to demonstrate the effectiveness of the proposed scheme.
WOS标题词	Science & Technology ; Technology
类目[WOS]	Automation & Control Systems ; Engineering, Electrical & Electronic ; Instruments & Instrumentation
研究领域[WOS]	Automation & Control Systems ; Engineering ; Instruments & Instrumentation
关键词[WOS]	FEEDBACK-CONTROL ; LEARNING CONTROL ; ALGORITHM ; NETWORKS ; ERROR
收录类别	SCI
语种	英语
WOS记录号	WOS:000314503400001
内容类型	期刊论文
源URL	[http://ir.ia.ac.cn/handle/173211/3850]
专题	自动化研究所_复杂系统管理与控制国家重点实验室_智能化团队
作者单位	Chinese Acad Sci, State Key Lab Management & Control Complex Syst, Inst Automat, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Li, H.,Liu, D.. Optimal control for discrete-time affine non-linear systems using general value iteration[J]. IET CONTROL THEORY AND APPLICATIONS,2012,6(18):2725-2736.
APA	Li, H.,&Liu, D..(2012).Optimal control for discrete-time affine non-linear systems using general value iteration.IET CONTROL THEORY AND APPLICATIONS,6(18),2725-2736.
MLA	Li, H.,et al."Optimal control for discrete-time affine non-linear systems using general value iteration".IET CONTROL THEORY AND APPLICATIONS 6.18(2012):2725-2736.