Please wait a minute...
Chin. Phys. B, 2024, Vol. 33(1): 010202    DOI: 10.1088/1674-1056/ad071b
GENERAL Prev   Next  

A deep learning method based on prior knowledge with dual training for solving FPK equation

Denghui Peng(彭登辉), Shenlong Wang(王神龙), and Yuanchen Huang(黄元辰)
School of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
Abstract  The evolution of the probability density function of a stochastic dynamical system over time can be described by a Fokker—Planck—Kolmogorov (FPK) equation, the solution of which determines the distribution of macroscopic variables in the stochastic dynamic system. Traditional methods for solving these equations often struggle with computational efficiency and scalability, particularly in high-dimensional contexts. To address these challenges, this paper proposes a novel deep learning method based on prior knowledge with dual training to solve the stationary FPK equations. Initially, the neural network is pre-trained through the prior knowledge obtained by Monte Carlo simulation (MCS). Subsequently, the second training phase incorporates the FPK differential operator into the loss function, while a supervisory term consisting of local maximum points is specifically included to mitigate the generation of zero solutions. This dual-training strategy not only expedites convergence but also enhances computational efficiency, making the method well-suited for high-dimensional systems. Numerical examples, including two different two-dimensional (2D), six-dimensional (6D), and eight-dimensional (8D) systems, are conducted to assess the efficacy of the proposed method. The results demonstrate robust performance in terms of both computational speed and accuracy for solving FPK equations in the first three systems. While the method is also applicable to high-dimensional systems, such as 8D, it should be noted that computational efficiency may be marginally compromised due to data volume constraints.
Keywords:  deep learning      prior knowledge      FPK equation      probability density function  
Received:  31 August 2023      Revised:  21 October 2023      Accepted manuscript online:  26 October 2023
PACS:  05.10.Gg (Stochastic analysis methods)  
  07.05.Mh (Neural networks, fuzzy logic, artificial intelligence)  
  05.10.Ln (Monte Carlo methods)  
Fund: Project supported by the National Natural Science Foundation of China (Grant No. 12172226).
Corresponding Authors:  Shenlong Wang     E-mail:  shenlongwang@usst.edu.cn

Cite this article: 

Denghui Peng(彭登辉), Shenlong Wang(王神龙), and Yuanchen Huang(黄元辰) A deep learning method based on prior knowledge with dual training for solving FPK equation 2024 Chin. Phys. B 33 010202

[1] Weigel A V, Fox P D, Akin E J, Ecklund K H, Tamkun M M and Krapf D 2012 Biophysical Journal 103 1727
[2] Nadler W and Schulten K 1986 J. Chem. Phys. 84 4015
[3] Belomestny D, Hübner T and Krätschmer V 2022 Finance and Stochastics 26 461
[4] Han B T and Jiang D Q 2022 Chaos, Solitons & Fractals 162 112458
[5] Fa K S 2017 Journal of Statistical Mechanics:Theory and Experiment 2017 033207
[6] Chakraborty I and Balachandran B 2011 Nonlinear Dyn. 66 427
[7] Galán R F, Ermentrout G B and Urban N N 2007 Phys. Rev. E 76 056110
[8] Sepehrian B and Karimi Radpoor M 2020 Computational Methods for Differential Equations 8 493
[9] Xu Y, Zan W R, Jia W T and Kurths J 2019 J. Comput. Phys. 394 41
[10] Biazar J, Gholamin P and Hosseini K 2010 Journal of the Franklin Institute 347 1137
[11] Hirvijoki E, Kurki-Suonio T, Äkäslompolo S, Varje J, Koskela T and Miettunen J 2015 J. Plasma Phys. 81 435810301
[12] Chen N and Majda A J 2018 J. Comput. Phys. 354 242
[13] Han J Q, Jentzen A and E W N 2018 Proc. Natl. Acad. Sci. USA 115 8505
[14] Raissi M 2023 Peter Carr Gedenkschrift:Research Advances in Mathematical Finance 18 637
[15] Raissi M, Perdikaris P and Karniadakis G E 2019 J. Comput. Phys. 378 686
[16] Berg J and Nyström K 2018 Neurocomputing 317 28
[17] Sirignano J and Spiliopoulos K 2018 J. Comput. Phys. 375 1339
[18] Xu Y, Zhang H, Li Y G, Zhou K, Liu Q and Kurths J 2020 Chaos:An Interdisciplinary Journal of Nonlinear Science 30 013133
[19] Zhang H, Xu Y, Liu Q, Wang X L and Li Y G 2022 Nonlinear Dyn. 108 4029
[20] Zhang H, Xu Y, Liu Q and Li Y G 2023 Engineering Applications of Artificial Intelligence 121 106036
[21] Wang X, Jiang J, Hong L, Chen L C and Sun J Q 2023 Probabilistic Engineering Mechanics 73 103470
[22] Chen X L, Yang L, Duan J Q and Karniadakis G E 2021 SIAM Journal on Scientific Computing 43 B811
[23] Zhai J Y, Dobson M and Li Y 2021 Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, August 16-19, 2021, Virtual Conference, p. 568
[24] Lin B, Li Q X and Ren W Q 2022 Journal of Scientific Computing 91 77
[25] Zhang Y and Yuen K V 2022 International Journal of Nonlinear Mechanics 147 104202
[26] Tang K J, Wan X L and Liao Q F 2022 J. Comput. Phys. 457 111080
[27] Zhang H, Xu Y, Li Y G and Kurths J 2020 International Journal of Dynamics and Control 8 1129
[28] Lepage G P 2021 J. Comput. Phys. 439 110386
[29] Newby J M 2012 Physical Biology 9 026002
[1] Image segmentation of exfoliated two-dimensional materials by generative adversarial network-based data augmentation
Xiaoyu Cheng(程晓昱), Chenxue Xie(解晨雪), Yulun Liu(刘宇伦), Ruixue Bai(白瑞雪), Nanhai Xiao(肖南海), Yanbo Ren(任琰博), Xilin Zhang(张喜林), Hui Ma(马惠), and Chongyun Jiang(蒋崇云). Chin. Phys. B, 2024, 33(3): 030703.
[2] Generation of orbital angular momentum hologram using a modified U-net
Zhi-Gang Zheng(郑志刚), Fei-Fei Han(韩菲菲), Le Wang(王乐), and Sheng-Mei Zhao(赵生妹). Chin. Phys. B, 2024, 33(3): 034207.
[3] Classification and structural characteristics of amorphous materials based on interpretable deep learning
Jiamei Cui(崔佳梅), Yunjie Li(李韵洁), Cai Zhao(赵偲), and Wen Zheng(郑文). Chin. Phys. B, 2023, 32(9): 096101.
[4] Crysformer: An attention-based graph neural network for properties prediction of crystals
Tian Wang(王田), Jiahui Chen(陈家辉), Jing Teng(滕婧), Jingang Shi(史金钢),Xinhua Zeng(曾新华), and Hichem Snoussi. Chin. Phys. B, 2023, 32(9): 090703.
[5] Disruption prediction based on fusion feature extractor on J-TEXT
Wei Zheng(郑玮), Fengming Xue(薛凤鸣), Zhongyong Chen(陈忠勇), Chengshuo Shen(沈呈硕), Xinkun Ai(艾鑫坤), Yu Zhong(钟昱), Nengchao Wang(王能超), Ming Zhang(张明),Yonghua Ding(丁永华), Zhipeng Chen(陈志鹏), Zhoujun Yang(杨州军), and Yuan Pan(潘垣). Chin. Phys. B, 2023, 32(7): 075203.
[6] Modeling differential car-following behavior under normal and rainy conditions: A memory-based deep learning method with attention mechanism
Hai-Jian Bai(柏海舰), Chen-Chen Guo(过晨晨), Heng Ding(丁恒), Li-Yang Wei(卫立阳), Ting Sun(孙婷), and Xing-Yu Chen(陈星宇). Chin. Phys. B, 2023, 32(6): 060507.
[7] Semi-analytical steady-state response prediction for multi-dimensional quasi-Hamiltonian systems
Wen-Wei Ye(叶文伟), Lin-Cong Chen(陈林聪), Zi Yuan(原子), Jia-Min Qian(钱佳敏), and Jian-Qiao Sun(孙建桥). Chin. Phys. B, 2023, 32(6): 060506.
[8] A probability theory for filtered ghost imaging
Zhong-Yuan Liu(刘忠源), Shao-Ying Meng(孟少英), and Xi-Hao Chen(陈希浩). Chin. Phys. B, 2023, 32(4): 044204.
[9] Applications and potentials of machine learning in optoelectronic materials research: An overview and perspectives
Cheng-Zhou Zhang(张城洲) and Xiao-Qian Fu(付小倩). Chin. Phys. B, 2023, 32(12): 126103.
[10] Inatorial forecasting method considering macro and micro characteristics of chaotic traffic flow
Yue Hou(侯越), Di Zhang(张迪), Da Li(李达), and Ping Yang(杨萍). Chin. Phys. B, 2023, 32(10): 100508.
[11] Deep-learning-based cryptanalysis of two types of nonlinear optical cryptosystems
Xiao-Gang Wang(汪小刚) and Hao-Yu Wei(魏浩宇). Chin. Phys. B, 2022, 31(9): 094202.
[12] Development of an electronic stopping power model based on deep learning and its application in ion range prediction
Xun Guo(郭寻), Hao Wang(王浩), Changkai Li(李长楷),Shijun Zhao(赵仕俊), Ke Jin(靳柯), and Jianming Xue(薛建明). Chin. Phys. B, 2022, 31(7): 073402.
[13] Data-driven parity-time-symmetric vector rogue wave solutions of multi-component nonlinear Schrödinger equation
Li-Jun Chang(常莉君), Yi-Fan Mo(莫一凡), Li-Ming Ling(凌黎明), and De-Lu Zeng(曾德炉). Chin. Phys. B, 2022, 31(6): 060201.
[14] Fringe removal algorithms for atomic absorption images: A survey
Gaoyi Lei(雷高益), Chencheng Tang(唐陈成), and Yueyang Zhai(翟跃阳). Chin. Phys. B, 2022, 31(5): 050313.
[15] Review on typical applications and computational optimizations based on semiclassical methods in strong-field physics
Xun-Qin Huo(火勋琴), Wei-Feng Yang(杨玮枫), Wen-Hui Dong(董文卉), Fa-Cheng Jin(金发成), Xi-Wang Liu(刘希望), Hong-Dan Zhang(张宏丹), and Xiao-Hong Song(宋晓红). Chin. Phys. B, 2022, 31(3): 033101.
No Suggested Reading articles found!