A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Partial Differential Equations

Research output: Contribution to journalConference articlepeer-review

60 Scopus citations

Abstract

This paper concerns the a priori generalization analysis of the Deep Ritz Method (DRM) [W. E and B. Yu, 2017], a popular neural-network-based method for solving high dimensional partial differential equations. We derive the generalization error bounds of two-layer neural networks in the framework of the DRM for solving two prototype elliptic PDEs: Poisson equation and static Schrödinger equation on the d-dimensional unit hypercube. Specifically, we prove that the convergence rates of generalization errors are independent of the dimension d, under the a priori assumption that the exact solutions of the PDEs lie in a suitable low-complexity space called spectral Barron space. Moreover, we give sufficient conditions on the forcing term and the potential function which guarantee that the solutions are spectral Barron functions. We achieve this by developing a new solution theory for the PDEs on the spectral Barron space, which can be viewed as an analog of the classical Sobolev regularity theory for PDEs.

Original languageEnglish (US)
Pages (from-to)3196-3241
Number of pages46
JournalProceedings of Machine Learning Research
Volume134
StatePublished - 2021
Externally publishedYes
Event34th Conference on Learning Theory, COLT 2021 - Boulder, United States
Duration: Aug 15 2021Aug 19 2021

Bibliographical note

Publisher Copyright:
© 2021 J. Lu, Y. Lu & M. Wang.

Keywords

  • Barron Space
  • Generalization
  • Neural Networks
  • Partial Differential Equations
  • Regularity

Fingerprint

Dive into the research topics of 'A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Partial Differential Equations'. Together they form a unique fingerprint.

Cite this