中国物理B ›› 2025, Vol. 34 ›› Issue (4): 40701-040701.doi: 10.1088/1674-1056/adacd0

• • 上一篇    下一篇

Causally enhanced initial conditions: A novel soft constraints strategy for physics informed neural networks

Wenshu Zha(查文舒), Dongsheng Chen(陈东升)†, Daolun Li(李道伦), Luhang Shen(沈路航), and Enyuan Chen(陈恩源)   

  1. School of Mathematic, Hefei University of Technology, Hefei 230009, China
  • 收稿日期:2024-12-18 修回日期:2025-01-10 接受日期:2025-01-22 出版日期:2025-04-15 发布日期:2025-04-15
  • 通讯作者: Dongsheng Chen E-mail:2022111481@mail.hfut.edu.cn
  • 基金资助:
    This work was supported by the National Natural Science Foundation of China (Grant Nos. 1217211 and 12372244).

Causally enhanced initial conditions: A novel soft constraints strategy for physics informed neural networks

Wenshu Zha(查文舒), Dongsheng Chen(陈东升)†, Daolun Li(李道伦), Luhang Shen(沈路航), and Enyuan Chen(陈恩源)   

  1. School of Mathematic, Hefei University of Technology, Hefei 230009, China
  • Received:2024-12-18 Revised:2025-01-10 Accepted:2025-01-22 Online:2025-04-15 Published:2025-04-15
  • Contact: Dongsheng Chen E-mail:2022111481@mail.hfut.edu.cn
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (Grant Nos. 1217211 and 12372244).

摘要: Physics informed neural networks (PINNs) are a deep learning approach designed to solve partial differential equations (PDEs). Accurately learning the initial conditions is crucial when employing PINNs to solve PDEs. However, simply adjusting weights and imposing hard constraints may not always lead to better learning of the initial conditions; sometimes it even makes it difficult for the neural networks to converge. To enhance the accuracy of PINNs in learning the initial conditions, this paper proposes a novel strategy named causally enhanced initial conditions (CEICs). This strategy works by embedding a new loss in the loss function: the loss is constructed by the derivative of the initial condition and the derivative of the neural network at the initial condition. Furthermore, to respect the causality in learning the derivative, a novel causality coefficient is introduced for the training when selecting multiple derivatives. Additionally, because CEICs can provide more accurate pseudo-labels in the first subdomain, they are compatible with the temporal-marching strategy. Experimental results demonstrate that CEICs outperform hard constraints and improve the overall accuracy of pre-training PINNs. For the 1D-Korteweg-de Vries, reaction and convection equations, the CEIC method proposed in this paper reduces the relative error by at least 60% compared to the previous methods.

关键词: initial condition, physics informed neural networks, temporal march, causality coefficient

Abstract: Physics informed neural networks (PINNs) are a deep learning approach designed to solve partial differential equations (PDEs). Accurately learning the initial conditions is crucial when employing PINNs to solve PDEs. However, simply adjusting weights and imposing hard constraints may not always lead to better learning of the initial conditions; sometimes it even makes it difficult for the neural networks to converge. To enhance the accuracy of PINNs in learning the initial conditions, this paper proposes a novel strategy named causally enhanced initial conditions (CEICs). This strategy works by embedding a new loss in the loss function: the loss is constructed by the derivative of the initial condition and the derivative of the neural network at the initial condition. Furthermore, to respect the causality in learning the derivative, a novel causality coefficient is introduced for the training when selecting multiple derivatives. Additionally, because CEICs can provide more accurate pseudo-labels in the first subdomain, they are compatible with the temporal-marching strategy. Experimental results demonstrate that CEICs outperform hard constraints and improve the overall accuracy of pre-training PINNs. For the 1D-Korteweg-de Vries, reaction and convection equations, the CEIC method proposed in this paper reduces the relative error by at least 60% compared to the previous methods.

Key words: initial condition, physics informed neural networks, temporal march, causality coefficient

中图分类号:  (Neural networks, fuzzy logic, artificial intelligence)

  • 07.05.Mh
02.30.Jr (Partial differential equations) 84.35.+i (Neural networks)