A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm

doi:10.1088/1674-1056/23/5/050504

中国物理B ›› 2014, Vol. 23 ›› Issue (5): 50504-050504.doi: 10.1088/1674-1056/23/5/050504

A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm

宋睿卓^a, 肖文栋^a, 魏庆来^b

a School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China;
b The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China

收稿日期:2013-10-18 修回日期:2013-11-16 出版日期:2014-05-15 发布日期:2014-05-15
基金资助:
Project supported by the Open Research Project from the SKLMCCS (Grant No. 20120106), the Fundamental Research Funds for the Central Universities of China (Grant No. FRF-TP-13-018A), the Postdoctoral Science Foundation of China (Grant No. 2013M530527), the National Natural Science Foundation of China (Grant Nos. 61304079 and 61374105), and the Natural Science Foundation of Beijing, China (Grant No. 4132078 and 4143065).

A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm

Song Rui-Zhuo (宋睿卓)^a, Xiao Wen-Dong (肖文栋)^a, Wei Qing-Lai (魏庆来)^b

a School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China;
b The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China

Received:2013-10-18 Revised:2013-11-16 Online:2014-05-15 Published:2014-05-15
Contact: Wei Qing-Lai E-mail:ql_wei@126.com
About author:05.45.Gg
Supported by:
Project supported by the Open Research Project from the SKLMCCS (Grant No. 20120106), the Fundamental Research Funds for the Central Universities of China (Grant No. FRF-TP-13-018A), the Postdoctoral Science Foundation of China (Grant No. 2013M530527), the National Natural Science Foundation of China (Grant Nos. 61304079 and 61374105), and the Natural Science Foundation of Beijing, China (Grant No. 4132078 and 4143065).

摘要/Abstract

摘要： We develop an online adaptive dynamic programming (ADP) based optimal control scheme for continuous-time chaotic systems. The idea is to use the ADP algorithm to obtain the optimal control input that makes the performance index function reach an optimum. The expression of the performance index function for the chaotic system is first presented. The online ADP algorithm is presented to achieve optimal control. In the ADP structure, neural networks are used to construct a critic network and an action network, which can obtain an approximate performance index function and the control input, respectively. It is proven that the critic parameter error dynamics and the closed-loop chaotic systems are uniformly ultimately bounded exponentially. Our simulation results illustrate the performance of the established optimal control method.

关键词: adaptive dynamic programming, adaptive critic designs, optimal control, continuous-time chaotic system

Abstract: We develop an online adaptive dynamic programming (ADP) based optimal control scheme for continuous-time chaotic systems. The idea is to use the ADP algorithm to obtain the optimal control input that makes the performance index function reach an optimum. The expression of the performance index function for the chaotic system is first presented. The online ADP algorithm is presented to achieve optimal control. In the ADP structure, neural networks are used to construct a critic network and an action network, which can obtain an approximate performance index function and the control input, respectively. It is proven that the critic parameter error dynamics and the closed-loop chaotic systems are uniformly ultimately bounded exponentially. Our simulation results illustrate the performance of the established optimal control method.

Key words: adaptive dynamic programming, adaptive critic designs, optimal control, continuous-time chaotic system

中图分类号: (Control of chaos, applications of chaos)

05.45.Gg

宋睿卓, 肖文栋, 魏庆来. A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm[J]. 中国物理B, 2014, 23(5): 50504-050504.

Song Rui-Zhuo (宋睿卓), Xiao Wen-Dong (肖文栋), Wei Qing-Lai (魏庆来). A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm[J]. Chin. Phys. B, 2014, 23(5): 50504-050504.

参考文献 26

[1]	Liu S and Chen L 2013 Chin. Phys. B 22 100506
[2]	Feng J, Zhang Q, Wang W and Hao S 2013 Chin. Phys. B 22 090503
[3]	Luo Y and Du M 2013 Chin. Phys. B 22 080503
[4]	Giuseppe G 2013 Chin. Phys. B 22 080505
[5]	Chen S and Lu J 2002 Chaos Soliton. Fract. 14 643
[6]	Zhang H, Huang W, Wang Z, Wang a and Chai T 2006 Phys. Lett. A 350 363
[7]	Ma T and Fu J 2011 Chin. Phys. B 20 050511
[8]	Ma T, Fu J and Sun Y 2010 Chin. Phys. B 19 090502
[9]	Zhang H, Ma T, Fu J and Tong S 2009 Chin. Phys. B 18 3751
[10]	Ma T, Zhang H and Fu J 2008 Chin. Phys. B 17 4407
[11]	Zhang H, Wang Z and Liu D 2004 Int. J. Bifur. Chaos 14 3505
[12]	Song R, Xiao W, Sun C and Wei Q 2013 Chin. Phys. B 22 090502
[13]	Werbos P 1977 General Systems Yearbook 22 25
[14]	Zhang H, Song R, Wei Q and Zhang T 2011 IEEE Trans. Neural Netw. 22 1851
[15]	Zhang H, Wei Q and Liu D 2011 Automatica 47 207
[16]	Liu D and Wei Q 2013 Automatica
[17]	Zhang H, Wei Q and Luo Y 2008 IEEE Trans. Syst. Man Cybernet. B 38 937
[18]	Song R, Zhang H, Luo Y and Wei Q 2010 Neurocomputing 73 3020
[19]	Song R, Xiao W and Sun C 2013 Acta Automatica Sinica 39 1413
[20]	Song R, Xiao W and Zhang H 2013 Neurocomputing 119 212
[21]	Murray J, Cox C, Lendaris G and Saeks R 2002 IEEE Trans. Syst. Man Cybernet. C 32 140
[22]	Fu J, He H and Zhou X 2011 IEEE Trans. Neural Netw. 22 1133
[23]	Lewis F and Vamvoudakis K 2011 IEEE Trans. Syst. Man Cybernet. B 41 14
[24]	Zhang H and Lewis F 2012 Automatica 48 1432
[25]	Khalil H 2002 Nonlinear System (NJ: Prentice-Hall)
[26]	Vamvoudakis K and Lewis F 2010 Automatica 46 878

A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm

A new approach of optimal control for a class of continuous-time chaotic systems by an online ADP algorithm

PDF (PC)

赞

可视化

摘要/Abstract

引用本文

使用本文

参考文献 26

相关文章 15

Metrics

本文评价

推荐阅读 0

[1]	Liang'an Huo(霍良安) and Yafang Dong(董雅芳). Dynamics and near-optimal control in a stochastic rumor propagation model incorporating media coverage and Lévy noise[J]. 中国物理B, 2022, 31(3): 30202-030202.
[2]	Anwarud Din and Yongjin Li(黎永锦). Stochastic optimal control for norovirus transmission dynamics by contaminated food and water[J]. 中国物理B, 2022, 31(2): 20202-020202.
[3]	Zhi-Ling Wang(王志凌), Leiyinan Liu(刘雷轶男), and Jian Cui(崔健). Optimized pulse for stimulated Raman adiabatic passage on noisy experimental platform[J]. 中国物理B, 2021, 30(8): 80305-080305.
[4]	Liang'an Huo(霍良安) and Xiaomin Chen(陈晓敏). Near-optimal control of a stochastic rumor spreading model with Holling II functional response function and imprecise parameters[J]. 中国物理B, 2021, 30(12): 120205-120205.
[5]	曲延华, 王安娜, 林盛. A novel stable value iteration-based approximate dynamic programming algorithm for discrete-time nonlinear systems[J]. 中国物理B, 2018, 27(1): 10203-010203.
[6]	宋睿卓, 魏庆来. Chaotic system optimal tracking using data-based synchronous method with unknown dynamics and disturbances[J]. 中国物理B, 2017, 26(3): 30505-030505.
[7]	魏庆来, 宋睿卓, 孙秋野, 肖文栋. Off-policy integral reinforcement learning optimal tracking control for continuous-time chaotic systems[J]. 中国物理B, 2015, 24(9): 90504-090504.
[8]	郭珊, 许珂, 许超, 任志刚, 肖炳甲. Start-up phase plasma discharge design of a tokamak via control parameterization method[J]. , 2015, 24(3): 35202-035202.
[9]	刘威, 陈书明, 张见, 吴春旺, 吴伟, 陈平形. Implementation of ternary Shor's algorithm based on vibrational states of an ion in anharmonic potential[J]. , 2015, 24(3): 33701-033701.
[10]	魏庆来, 刘德荣, 徐延才. Policy iteration optimal tracking control for chaotic systems by using an adaptive dynamic programming approach[J]. , 2015, 24(3): 30502-030502.
[11]	竺致文, 张庆昕, 许佳. Nonlinear dynamic characteristics and optimal control of a giant magnetostrictive film-shaped memory alloy composite plate subjected to in-plane stochastic excitation[J]. , 2014, 23(8): 88201-088201.
[12]	于欣, 任志刚, 许超. An approximation for the boundary optimal control problem of a heat equation defined in a variable domain[J]. 中国物理B, 2014, 23(4): 40201-040201.
[13]	宋睿卓, 肖文栋, 孙长银, 魏庆来. Approximation-error-ADP-based optimal tracking control for chaotic systems with convergence proof[J]. 中国物理B, 2013, 22(9): 90502-090502.
[14]	Giuseppe Grassi. Continuous-time chaotic systems：Arbitrary full-state hybrid projective synchronization via a scalar signal[J]. 中国物理B, 2013, 22(8): 80505-080505.
[15]	张为, 谢廷, 黄寅, 王高仁, 丛书林. Stabilizing photoassociated Cs₂ molecules by optimal control[J]. Chin. Phys. B, 2013, 22(1): 13301-013301.