中国物理B ›› 2024, Vol. 33 ›› Issue (5): 50701-050701.doi: 10.1088/1674-1056/ad21f3

• • 上一篇    下一篇

TCAS-PINN: Physics-informed neural networks with a novel temporal causality-based adaptive sampling method

Jia Guo(郭嘉), Haifeng Wang(王海峰), Shilin Gu(古仕林), and Chenping Hou(侯臣平)†   

  1. College of Science, National University of Defense Technology, Changsha 410073, China
  • 收稿日期:2023-10-18 修回日期:2024-01-08 接受日期:2024-01-24 出版日期:2024-05-20 发布日期:2024-05-20
  • 通讯作者: Chenping Hou E-mail:hcpnudt@hotmail.com
  • 基金资助:
    Project supported by the Key National Natural Science Foundation of China (Grant No. 62136005) and the National Natural Science Foundation of China (Grant Nos. 61922087, 61906201, and 62006238).

TCAS-PINN: Physics-informed neural networks with a novel temporal causality-based adaptive sampling method

Jia Guo(郭嘉), Haifeng Wang(王海峰), Shilin Gu(古仕林), and Chenping Hou(侯臣平)†   

  1. College of Science, National University of Defense Technology, Changsha 410073, China
  • Received:2023-10-18 Revised:2024-01-08 Accepted:2024-01-24 Online:2024-05-20 Published:2024-05-20
  • Contact: Chenping Hou E-mail:hcpnudt@hotmail.com
  • Supported by:
    Project supported by the Key National Natural Science Foundation of China (Grant No. 62136005) and the National Natural Science Foundation of China (Grant Nos. 61922087, 61906201, and 62006238).

摘要: Physics-informed neural networks (PINNs) have become an attractive machine learning framework for obtaining solutions to partial differential equations (PDEs). PINNs embed initial, boundary, and PDE constraints into the loss function. The performance of PINNs is generally affected by both training and sampling. Specifically, training methods focus on how to overcome the training difficulties caused by the special PDE residual loss of PINNs, and sampling methods are concerned with the location and distribution of the sampling points upon which evaluations of PDE residual loss are accomplished. However, a common problem among these original PINNs is that they omit special temporal information utilization during the training or sampling stages when dealing with an important PDE category, namely, time-dependent PDEs, where temporal information plays a key role in the algorithms used. There is one method, called Causal PINN, that considers temporal causality at the training level but not special temporal utilization at the sampling level. Incorporating temporal knowledge into sampling remains to be studied. To fill this gap, we propose a novel temporal causality-based adaptive sampling method that dynamically determines the sampling ratio according to both PDE residual and temporal causality. By designing a sampling ratio determined by both residual loss and temporal causality to control the number and location of sampled points in each temporal sub-domain, we provide a practical solution by incorporating temporal information into sampling. Numerical experiments of several nonlinear time-dependent PDEs, including the Cahn-Hilliard, Korteweg-de Vries, Allen-Cahn and wave equations, show that our proposed sampling method can improve the performance. We demonstrate that using such a relatively simple sampling method can improve prediction performance by up to two orders of magnitude compared with the results from other methods, especially when points are limited.

关键词: partial differential equation, physics-informed neural networks, residual-based adaptive sampling, temporal causality

Abstract: Physics-informed neural networks (PINNs) have become an attractive machine learning framework for obtaining solutions to partial differential equations (PDEs). PINNs embed initial, boundary, and PDE constraints into the loss function. The performance of PINNs is generally affected by both training and sampling. Specifically, training methods focus on how to overcome the training difficulties caused by the special PDE residual loss of PINNs, and sampling methods are concerned with the location and distribution of the sampling points upon which evaluations of PDE residual loss are accomplished. However, a common problem among these original PINNs is that they omit special temporal information utilization during the training or sampling stages when dealing with an important PDE category, namely, time-dependent PDEs, where temporal information plays a key role in the algorithms used. There is one method, called Causal PINN, that considers temporal causality at the training level but not special temporal utilization at the sampling level. Incorporating temporal knowledge into sampling remains to be studied. To fill this gap, we propose a novel temporal causality-based adaptive sampling method that dynamically determines the sampling ratio according to both PDE residual and temporal causality. By designing a sampling ratio determined by both residual loss and temporal causality to control the number and location of sampled points in each temporal sub-domain, we provide a practical solution by incorporating temporal information into sampling. Numerical experiments of several nonlinear time-dependent PDEs, including the Cahn-Hilliard, Korteweg-de Vries, Allen-Cahn and wave equations, show that our proposed sampling method can improve the performance. We demonstrate that using such a relatively simple sampling method can improve prediction performance by up to two orders of magnitude compared with the results from other methods, especially when points are limited.

Key words: partial differential equation, physics-informed neural networks, residual-based adaptive sampling, temporal causality

中图分类号:  (Neural networks, fuzzy logic, artificial intelligence)

  • 07.05.Mh
02.60.Cb (Numerical simulation; solution of equations) 02.30.Jr (Partial differential equations) 84.35.+i (Neural networks)