Abstract
This paper concerns the a priori generalization analysis of the Deep Ritz Method (DRM) [W. E and B. Yu, 2017], a popular neural-network-based method for solving high dimensional partial differential equations. We derive the generalization error bounds of two-layer neural networks in the framework of the DRM for solving two prototype elliptic PDEs: Poisson equation and static Schrödinger equation on the d-dimensional unit hypercube. Specifically, we prove that the convergence rates of generalization errors are independent of the dimension d, under the a priori assumption that the exact solutions of the PDEs lie in a suitable low-complexity space called spectral Barron space. Moreover, we give sufficient conditions on the forcing term and the potential function which guarantee that the solutions are spectral Barron functions. We achieve this by developing a new solution theory for the PDEs on the spectral Barron space, which can be viewed as an analog of the classical Sobolev regularity theory for PDEs.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 3196-3241 |
| Number of pages | 46 |
| Journal | Proceedings of Machine Learning Research |
| Volume | 134 |
| State | Published - 2021 |
| Externally published | Yes |
| Event | 34th Conference on Learning Theory, COLT 2021 - Boulder, United States Duration: Aug 15 2021 → Aug 19 2021 |
Bibliographical note
Publisher Copyright:© 2021 J. Lu, Y. Lu & M. Wang.
Keywords
- Barron Space
- Generalization
- Neural Networks
- Partial Differential Equations
- Regularity