SearcharxivSearch

arXiv subjects

Daili Sheng

Publications and source records attributed to Daili Sheng.

2 recordsLinked to original sources

Nonparametric Schr\"odinger Bridge Time Series Generator: Algorithm, Convergence Analysis and Applications

We conduct a convergence analysis for the Schr\"odinger Bridge Time Series (SBTS) data generator. Starting from a regularized formulation in which the data ensemble is mixed with a standard multivariate Gaussian distribution with a prescribed probability, we prove that the Euler-Maruyama discretization converges to the mixed target distribution with half-order convergence rate, provided that the ensemble size and kernel bandwidth are chosen appropriately. We further show that the regularized distribution converges to the original target distribution as the mixing probability tends to zero. The analysis simultaneously accounts for the ensemble approximation error, kernel approximation error, and time-discretization error, and therefore provides a full distributional convergence result for the SBTS generator. Empirically, we further examine the flexibility of the method by replacing the Wiener reference measure with the path measure induced by a more general SDE. The numerical experiments show that the schemes based on both the original Wiener reference measure and the SDE-induced reference measure achieve comparable performance, demonstrating the robustness and stability of the SBTS framework.

math.NA

A High-order Backpropagation Algorithm for Neural Stochastic Differential Equation Model

Neural stochastic differential equation model with a Brownian motion term can capture epistemic uncertainty of deep neural network from the perspective of a dynamical system. The goal of this paper is to improve the convergence rate of the sample-wise backpropagation algorithm in neural stochastic differential equation model which has been proposed in [Archibald et al., SIAM Journal on Numerical Analysis, 62 (2024), pp. 593-621]. It is necessary to emphasize that, improving the convergence order of the algorithm consisting of forward backward stochastic differential equations remains challenging, due to the loss of information of Z term in backward equations under sample-wise approximation and the limitations of the forward network form. In this paper, we develop a high-order backpropagation algorithm to improve the training accuracy. Under the convexity assumption, the result indicates that the first-order convergence is achieved when the number of training steps is proportional to the cubic number of layers. Finally, numerical examples illustrate our theoretical results.

math.NA