SearcharxivSearch

arXiv subjects

Frank Proske

Publications and source records attributed to Frank Proske.

At least 19 recordsLinked to original sources

Logarithmic derivatives of variational and singular stochastic partial differential equations

For a stochastic partial differential equation posed on a Gelfand triple and satisfying the fully local monotone conditions of R\"ockner, Shang and Zhang, we compute the logarithmic derivative of the law of the solution at a fixed time along a prescribed direction of the state space. The formula is intrinsic, being expressed through the Hilbert-Schmidt Malliavin derivative $\Phi_r = \mathcal{D}_r X(t)$ and the covariance $\gamma_t = \int_0^t \Phi_r \Phi_r^{*} \,\mathrm{d}r$ alone, so that neither the inversion of the first variation used in finite dimensions nor uniform Malliavin-Sobolev bounds on the Tikhonov family are called upon. It is obtained from an integration-by-parts identity on an abstract Hilbert space, a Moore-Penrose construction of a covering field on Wiener space, and a trace formula for the Tikhonov limit, specialised to the equation through the representation $\Phi_r = Y(t,r)\mathcal{B}(r,X(r))$ of the Malliavin derivative by the first variation; the stochastic $p$-Laplacian and the two-dimensional Navier-Stokes equation are treated in detail. Beyond the variational class, a scalar reduction gives an integration-by-parts identity for the law of a pairing $\langle u(t),\varphi\rangle$ which passes to the renormalised limit for the singular equations of Bruned, Chandra, Chevyrev and Hairer, and which is represented by a logarithmic derivative under second-order Malliavin smoothness and negative-moment hypotheses.

math.PR

Optimal Stopping for Systems Driven by the Brownian Sheet

We investigate optimal stopping problems for systems driven by the Brownian sheet. Our analysis is divided into two parts. In the first part we derive explicit solutions to two optimal stopping problems for the exponentially discounted Brownian sheet. The first problem consists in determining the optimal two-parameter first hitting point tau = (tau1,tau2) maximizing E[exp(-rho tau1 tau2) h(B(tau1,tau2))], where rho > 0 is a discount factor and h is a reward function. Restricting attention to first hitting points of levels, we obtain a closed-form characterization of the optimal stopping threshold. In particular, for linear rewards h(y)=y the optimal level is y_hat = (2 rho)^(-1/2). The second problem concerns optimal stopping of the integrated discounted Brownian sheet with payoff E[int_0^{tau1} int_0^{tau2} exp(-rho t x) B(t,x) dt dx]. We show that the optimal first hitting level is strictly positive and give an explicit representation of the value function in terms of the exponential integral function. The optimal threshold is characterized as the unique solution of a nonlinear equation derived from a Laplace transform identity for the product tau1 tau2. In the second and main part of the paper we develop a potential theoretic framework for two-parameter optimal stopping problems associated with stochastic partial differential equations driven by the Brownian sheet, proving that the value function is the least superharmonic majorant of the reward and establishing existence of optimal stopping points in the plane.

math.PR

Malliavin Calculus for Score-based Diffusion Models

We introduce a new framework based on Malliavin calculus to derive exact analytical expressions for the score function $\nabla \log p_t(x)$, i.e., the gradient of the log-density associated with the solution to stochastic differential equations (SDEs). Our approach combines classical integration-by-parts techniques with modern stochastic analysis tools, such as Bismut's formula and Malliavin calculus, and it works for both linear and nonlinear SDEs. In doing so, we establish a rigorous connection between the Malliavin derivative, its adjoint, the Malliavin divergence (Skorokhod integral), and diffusion generative models, thereby providing a systematic method for computing $\nabla \log p_t(x)$. In the linear case, we present a detailed analysis showing that our formula coincides with the analytical score function derived from the solution of the Fokker--Planck equation. For nonlinear SDEs with state-independent diffusion coefficients, we derive a closed-form expression for $\nabla \log p_t(x)$. We evaluate the proposed framework across multiple generative tasks and find that its performance is comparable to state-of-the-art methods. These results can be generalised to broader classes of SDEs, paving the way for new score-based diffusion generative models.

cs.LG

A Malliavin calculus approach to score functions in diffusion generative models

Score-based diffusion generative models have recently emerged as a powerful tool for modelling complex data distributions. These models aim at learning the score function, which defines a map from a known probability distribution to the target data distribution via deterministic or stochastic differential equations (SDEs). The score function is typically estimated from data using a variety of approximation techniques, such as denoising or sliced score matching, Hyvärien's method, or Schrödinger bridges. In this paper, we derive an exact, closed-form, expression for the score function for a broad class of nonlinear diffusion generative models. Our approach combines modern stochastic analysis tools such as Malliavin derivatives and their adjoint operators (Skorokhod integrals or Malliavin Divergence) with a new Bismut-type formula. The resulting expression for the score function can be written entirely in terms of the first and second variation processes, with all Malliavin derivatives systematically eliminated, thereby enhancing its practical applicability. The theoretical framework presented in this work offers a principled foundation for advancing score estimation methods in generative modelling, enabling the design of new sampling algorithms for complex probability distributions. Our results can be extended to broader classes of stochastic differential equations, opening new directions for the development of score-based diffusion generative models.

stat.ML

Score-Based Diffusion Models in Infinite Dimensions: A Malliavin Calculus Perspective

We study score-based diffusion modelling in infinite-dimensional separable Hilbert spaces through Malliavin calculus, extending the analysis of generative models beyond the finite-dimensional setting. The forward diffusion process is formulated as a linear stochastic partial differential equation (SPDE) driven by space--time coloured noise with a trace-class covariance operator, ensuring well-posedness in arbitrary spatial dimensions. Building on Malliavin calculus and an infinite-dimensional extension of the Bismut--Elworthy--Li formula, we derive a closed-form expression for the logarithmic derivative of the transition measure along Cameron--Martin directions, which serves as the natural infinite-dimensional analogue of the score function. Our operator-theoretic approach preserves the intrinsic geometry of Hilbert spaces and accommodates general trace-class operators, thereby incorporating spatially correlated noise without assuming semigroup invertibility. We validate the derived score formula numerically for several classes of linear SPDEs in both one and two spatial dimensions using spectral methods.

math.PR

Smoothness of solutions of hyperbolic stochastic partial differential equations with $L^{\infty}$-vector fields

In this paper we are interested in a quasi-linear hyperbolic stochastic differential equation (HSPDE) when the vector field is merely bounded and measurable. Although the deterministic counterpart of such equation may be ill-posed (in the sense that uniqueness or even existence might not be valid), we show for the first time that the corresponding HSPDE has a unique (Malliavin differentiable) strong solution. Our approach for proving this result rests on: 1) tools from Malliavin calculus and 2) variational techniques introduced in [Davie, Int. Math. Res. Not., Vol. 2007] non trivially extended to the case of SDEs in the plane by using an algorithm for the selection of certain rectangles. As a by product, we also obtain the Sobolev differentiability of the solution with respect to its initial value. The results derived here constitute a significant improvement of those in the current literature on SDEs on the plane and can be regarded as an analogous equivalent of the pioneering works by [Zvonkin, Math. URSS Sbornik, 22:129-149] and [Veretennikov, Theory Probab. Appl., 24:354-366] in the case of one-parameter SDEs with singular drift.

math.PR

SPDE Games Driven by a Brownian Sheet with Applications to Pollution Minimization

This paper studies a nonzero-sum stochastic differential game in the context of shared spatial-domain pollution control. The pollution dynamics are governed by a stochastic partial differential equation (SPDE) driven by a Brownian sheet, capturing the stochastic nature of environmental fluctuations. Two players, representing different regions, aim to minimize their respective cost functionals, which balance pollution penalties with the cost of implementing control strategies. The nonzero-sum framework reflects the interdependent yet conflicting objectives of the players, where both cooperation and competition influence the outcomes. We derive necessary and sufficient conditions for Nash equilibrium strategies, using a maximum principle approach. This approach involves the introduction of a new pair of adjoint variables, (L_1, L_2), which do not appear in a corresponding formulation with the classical (1-parameter) Brownian motion. Finally, we apply our results to two case studies in pollution control, demonstrating how spatial and stochastic dynamics shape the equilibrium strategies.

math.OC

Strong solutions of fractional Brownian sheet driven SDEs with integrable drift

We prove the existence of a unique Malliavin differentiable strong solution to a stochastic differential equation on the plane with merely integrable coefficients driven by the fractional Brownian sheet with Hurst parameters less than 1/2. The proof of this result relies on a compactness criterion for square integrable Wiener functionals from Malliavin calculus ([Da Prato, Malliavin and Nualart, 1992]), variational techniques developed in the case of fractional Brownian motion ([Baños, Nielssen, and Proske, 2020]) and the concept of sectorial local nondeterminism (introduced in [Khoshnevisan and Xiao, 2007]). The latter concept enable us to improve the bound of the Hurst parameter (compare with [Baños, Nielssen, and Proske, 2020]).

math.PR

Fokker-Planck equations for conditional McKean-Vlasov systems driven by Brownian sheets

We investigate conditional McKean-Vlasov equations driven by time-space white noise, motivated by the propagation of chaos in an N-particle system with space-time Ornstein-Uhlenbeck dynamics. The framework builds on the stochastic calculus of time-space white noise, utilizing tools such as the two-parameter Ito formula, Malliavin calculus, and orthogonal decompositions to analyze convergence and stochastic properties. Existence and uniqueness of solutions for the associated stochastic partial differential equations (SPDEs) are rigorously established. Additionally, an integral stochastic Fokker-Planck equation is derived for the conditional law, employing Fourier transform methods and stochastic analysis in the plane. The framework is further applied to a partial observation control problem, showcasing its potential for analyzing stochastic systems with conditional dynamics.

math.PR

A Kalman filter for linear systems driven by time-space Brownian sheet

We study a linear filtering problem where the signal and observation processes are described as solutions of linear stochastic differential equations driven by time-space Brownian sheets. We derive a stochastic integral equation for the conditional value of the signal given the observation, which can be considered a time-space analogue of the classical Kalman filter. The result is illustrated with examples of the filtering problem involving noisy observations.

math.PR

Stability, uniqueness and existence of solutions to McKean-Vlasov SDEs: a multidimensional Yamada-Watanabe approach

We establish stability and pathwise uniqueness of solutions to Wiener noise driven McKean-Vlasov equations with random non-Lipschitz continuous coefficients. In the deterministic case, we also obtain the existence of unique strong solutions. By using our approach, which is based on an extension of the Yamada-Watanabe ansatz to the multidimensional setting and which does not rely on the construction of Lyapunov functions, we prove first moment and pathwise exponential stability. Furthermore, Lyapunov exponents are computed explicitly.

math.PR

Fokker-Planck equation for McKean-Vlasov SPDEs driven by time-space Brownian sheet

In this paper, we consider a McKean-Vlasov (mean-field) stochastic partial differential equations (SPDEs) driven by a Brownian sheet. We study the propagation of chaos for a space-time Ornstein-Uhlenbeck SPDE type. Subsequently, we prove the existence and uniqueness of a nonlinear McKean-Vlasov SPDE. Finally, we establish a Fokker-Planck equation for the law of the solution of the McKean-Vlasov type SPDE driven by a time-space Brownian sheet, and we provide some examples to illustrate the results obtained.

math.PR

Optimal control of SPDEs driven by time-space Brownian motion

In this paper we study a Pontryagin type stochastic maximum principle for the optimal control of a system, where the state dynamics satisfy a stochastic partial differential equation (SPDE) driven by a two-parameter (time-space) Brownian motion (also called Brownian sheet). We first discuss some properties of a Brownian sheet driven linear SPDE which models the growth of an ecosystem. Further, applying time-space white noise calculus we derive sufficient conditions and necessary conditions of optimality of the control. Finally, we illustrate our results by solving a linear quadratic control problem and an optimal harvesting problem in the plane. We also study possible applications to machine learning.

math.OC

Anticorrelated Noise Injection for Improved Generalization

Injecting artificial noise into gradient descent (GD) is commonly employed to improve the performance of machine learning models. Usually, uncorrelated noise is used in such perturbed gradient descent (PGD) methods. It is, however, not known if this is optimal or whether other types of noise could provide better generalization performance. In this paper, we zoom in on the problem of correlating the perturbations of consecutive PGD steps. We consider a variety of objective functions for which we find that GD with anticorrelated perturbations ("Anti-PGD") generalizes significantly better than GD and standard (uncorrelated) PGD. To support these experimental findings, we also derive a theoretical analysis that demonstrates that Anti-PGD moves to wider minima, while GD and PGD remain stuck in suboptimal regions or even diverge. This new connection between anticorrelated noise and generalization opens the field to novel ways to exploit noise for training machine learning models.

stat.ML

Mean first exit times of Ornstein-Uhlenbeck processes in high-dimensional spaces

The $d$-dimensional Ornstein--Uhlenbeck process (OUP) describes the trajectory of a particle in a $d$-dimensional, spherically symmetric, quadratic potential. The OUP is composed of a drift term weighted by a constant $θ\geq 0$ and a diffusion coefficient weighted by $σ> 0$. In the absence of drift (i.e. $θ= 0$), the OUP simply becomes a standard Brownian motion (BM). This paper is concerned with estimating the mean first-exit time (MFET) of the OUP from a ball of finite radius $L$ for large $d \gg 0$. We prove that, asymptotically for $d \to \infty$, the OUP takes (on average) no longer to exit than BM. In other words, the mean-reverting drift of the OUP (scaled by $θ\geq 0$) has asymptotically no effect on its MFET. This finding might be surprising because, for small $d \in \mathbb{N}$, the OUP exit time is significantly larger than BM by a margin that depends on $θ$. As it allows for the drift to be ignored, it might simplify the analysis of high-dimensional exit-time problems in numerous areas. Finally, our short proof for the non-asymptotic MFET of OUP, using the Andronov--Vitt--Pontryagin formula, might be of independent interest.

math.PR

On the Theoretical Properties of Noise Correlation in Stochastic Optimization

Studying the properties of stochastic noise to optimize complex non-convex functions has been an active area of research in the field of machine learning. Prior work has shown that the noise of stochastic gradient descent improves optimization by overcoming undesirable obstacles in the landscape. Moreover, injecting artificial Gaussian noise has become a popular idea to quickly escape saddle points. Indeed, in the absence of reliable gradient information, the noise is used to explore the landscape, but it is unclear what type of noise is optimal in terms of exploration ability. In order to narrow this gap in our knowledge, we study a general type of continuous-time non-Markovian process, based on fractional Brownian motion, that allows for the increments of the process to be correlated. This generalizes processes based on Brownian motion, such as the Ornstein-Uhlenbeck process. We demonstrate how to discretize such processes which gives rise to the new algorithm fPGD. This method is a generalization of the known algorithms PGD and Anti-PGD. We study the properties of fPGD both theoretically and empirically, demonstrating that it possesses exploration abilities that, in some cases, are favorable over PGD and Anti-PGD. These results open the field to novel ways to exploit noise for training machine learning models.

math.OC

Stability, uniqueness and existence of solutions to McKean-Vlasov SDEs in arbitrary moments

We deduce stability and pathwise uniqueness for a McKean-Vlasov equation with random coefficients and a multidimensional Brownian motion as driver. Our analysis focuses on a non-Lipschitz drift coefficient and includes moment estimates for random Itô processes that are of independent interest. For deterministic coefficients we provide unique strong solutions, even if the drift fails to be of affine growth. The theory that we develop rests on Itô's formula and leads to $p$-th moment and pathwise $α$-exponential stability for $p\geq 2$ and $α> 0$ with explicit Lyapunov exponents, regardless of whether a Lyapunov function exists.

math.PR