arXiv · 2410.16506
ReLU neural network approximation to piecewise constant functions
Abstract
This paper studies the approximation property of ReLU neural networks (NNs) to piecewise constant functions with unknown interfaces in bounded regions in $\mathbb{R}^d$. Under the assumption that the discontinuity interface $\Gamma$ may be approximated by a connected series of hyperplanes with a prescribed accuracy $\varepsilon >0$, we show that a three-layer ReLU NN is sufficient to accurately approximate any piecewise constant function and establish its error bound. Moreover, if the discontinuity interface is convex, an analytical formula of the ReLU NN approximation with exact weights and biases is provided.
Explore related subjects
Keep this discovery
Zhiqiang Cai, Junpyo Choi, Min Liu. 2024-10-21. ReLU neural network approximation to piecewise constant functions. https://arxiv.org/abs/2410.16506
Cite the original work for its findings. Save a collection to share your selection of sources.