arrow
Volume 30, Issue 3
Enforcing Imprecise Constraints on Generative Adversarial Networks for Emulating Physical Systems

Yang Zeng, Jin-Long Wu & Heng Xiao

Commun. Comput. Phys., 30 (2021), pp. 635-665.

Published online: 2021-07

Export citation
  • Abstract

Generative adversarial networks (GANs) were initially proposed to generate images by learning from a large number of samples. Recently, GANs have been used to emulate complex physical systems such as turbulent flows. However, a critical question must be answered before GANs can be considered trusted emulators for physical systems: do GANs-generated samples conform to the various physical constraints? These include both deterministic constraints (e.g., conservation laws) and statistical constraints (e.g., energy spectrum of turbulent flows). The latter have been studied in a companion paper (Wu et al., Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems. Journal of Computational Physics. 406, 109209, 2020). In the present work, we enforce deterministic yet imprecise constraints on GANs by incorporating them into the loss function of the generator. We evaluate the performance of physics-constrained GANs on two representative tasks with geometrical constraints (generating points on circles) and differential constraints (generating divergence-free flow velocity fields), respectively. In both cases, the constrained GANs produced samples that conform to the underlying constraints rather accurately, even though the constraints are only enforced up to a specified interval. More importantly, the imposed constraints significantly accelerate the convergence and improve the robustness in the training, indicating that they serve as a physics-based regularization. These improvements are noteworthy, as the convergence and robustness are two well-known obstacles in the training of GANs.

  • AMS Subject Headings

76F99, 62P35, 91A05

  • Copyright

COPYRIGHT: © Global Science Press

  • Email address
  • BibTex
  • RIS
  • TXT
@Article{CiCP-30-635, author = {Zeng , YangWu , Jin-Long and Xiao , Heng}, title = {Enforcing Imprecise Constraints on Generative Adversarial Networks for Emulating Physical Systems}, journal = {Communications in Computational Physics}, year = {2021}, volume = {30}, number = {3}, pages = {635--665}, abstract = {

Generative adversarial networks (GANs) were initially proposed to generate images by learning from a large number of samples. Recently, GANs have been used to emulate complex physical systems such as turbulent flows. However, a critical question must be answered before GANs can be considered trusted emulators for physical systems: do GANs-generated samples conform to the various physical constraints? These include both deterministic constraints (e.g., conservation laws) and statistical constraints (e.g., energy spectrum of turbulent flows). The latter have been studied in a companion paper (Wu et al., Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems. Journal of Computational Physics. 406, 109209, 2020). In the present work, we enforce deterministic yet imprecise constraints on GANs by incorporating them into the loss function of the generator. We evaluate the performance of physics-constrained GANs on two representative tasks with geometrical constraints (generating points on circles) and differential constraints (generating divergence-free flow velocity fields), respectively. In both cases, the constrained GANs produced samples that conform to the underlying constraints rather accurately, even though the constraints are only enforced up to a specified interval. More importantly, the imposed constraints significantly accelerate the convergence and improve the robustness in the training, indicating that they serve as a physics-based regularization. These improvements are noteworthy, as the convergence and robustness are two well-known obstacles in the training of GANs.

}, issn = {1991-7120}, doi = {https://doi.org/10.4208/cicp.OA-2020-0106}, url = {http://global-sci.org/intro/article_detail/cicp/19306.html} }
TY - JOUR T1 - Enforcing Imprecise Constraints on Generative Adversarial Networks for Emulating Physical Systems AU - Zeng , Yang AU - Wu , Jin-Long AU - Xiao , Heng JO - Communications in Computational Physics VL - 3 SP - 635 EP - 665 PY - 2021 DA - 2021/07 SN - 30 DO - http://doi.org/10.4208/cicp.OA-2020-0106 UR - https://global-sci.org/intro/article_detail/cicp/19306.html KW - Generative adversarial networks, physics constraints, physics-informed machine learning. AB -

Generative adversarial networks (GANs) were initially proposed to generate images by learning from a large number of samples. Recently, GANs have been used to emulate complex physical systems such as turbulent flows. However, a critical question must be answered before GANs can be considered trusted emulators for physical systems: do GANs-generated samples conform to the various physical constraints? These include both deterministic constraints (e.g., conservation laws) and statistical constraints (e.g., energy spectrum of turbulent flows). The latter have been studied in a companion paper (Wu et al., Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems. Journal of Computational Physics. 406, 109209, 2020). In the present work, we enforce deterministic yet imprecise constraints on GANs by incorporating them into the loss function of the generator. We evaluate the performance of physics-constrained GANs on two representative tasks with geometrical constraints (generating points on circles) and differential constraints (generating divergence-free flow velocity fields), respectively. In both cases, the constrained GANs produced samples that conform to the underlying constraints rather accurately, even though the constraints are only enforced up to a specified interval. More importantly, the imposed constraints significantly accelerate the convergence and improve the robustness in the training, indicating that they serve as a physics-based regularization. These improvements are noteworthy, as the convergence and robustness are two well-known obstacles in the training of GANs.

Yang Zeng, Jin-Long Wu & Heng Xiao. (2021). Enforcing Imprecise Constraints on Generative Adversarial Networks for Emulating Physical Systems. Communications in Computational Physics. 30 (3). 635-665. doi:10.4208/cicp.OA-2020-0106
Copy to clipboard
The citation has been copied to your clipboard