Searcharxiv⌕ Search

arXiv subjects

Paweł Przybyłowicz

Publications and source records attributed to Paweł Przybyłowicz.

At least 19 recordsLinked to original sources

Error of randomized Milstein scheme for scalar SDEs with noisy information about coefficients and Wiener process

We investigate the strong approximation of scalar stochastic differential equations when the available standard information about the drift coefficient, the diffusion coefficient, the derivative of the diffusion coefficient, and the observed Wiener path is corrupted by noise. The precision of the drift, diffusion-information, and Wiener-path observations is described by three nonnegative parameters $δ_1,δ_2,δ_3$, where $δ_2$ controls both the noisy diffusion coefficient and the separate noisy derivative oracle required in the Milstein correction. We analyze a randomized Milstein scheme based only on this noisy information and prove, for $r\geq 2$, that its $L^r$-error is bounded by $C(n^{-\min\{γ_1+1/2,γ_2\}}+δ_1+δ_2+δ_3)$, where $n$ is the number of time steps and $γ_1,γ_2$ are the temporal Hölder exponents of the coefficients. We also prove a matching minimax lower bound in the randomized standard-information model considered in the paper. In particular, the Wiener-path contribution proportional to $δ_3$ is unavoidable, and the noisy randomized Milstein scheme is minimax order-optimal.

math.NA↗

Neural Network-Based Estimation of Time-Dependent Parameters in AR(p) Processes

We investigate a forecasting framework based on a simple discrete-time dynamic model with coefficients varying in time. The parameters of the model are recovered within a deep learning framework, which makes it possible to retain a transparent parametric structure while simultaneously accounting for complex and nonstationary patterns in the observed phenomenon. Our analysis covers two specifications of the noise process. Besides the standard Gaussian setting, we also consider Laplace-distributed noise, which can offer a more adequate description in the presence of heavier tails and sharper local fluctuations. For both cases, we formulate the predictive scheme of the model and analyze the associated uncertainty quantification, including the construction of prediction intervals. The results illustrate that a relatively simple model, when combined with time-dependent parameter estimation, can serve as a mathematically tractable and practically flexible tool for forecasting complex dynamics under different noise assumptions. The general model is stated for TVAR($p$), while the prediction-interval formulas and the numerical experiments are developed for the TVAR(1) case.

stat.ML↗

On the randomized Euler scheme for SDEs with integral-form drift

In this paper, we investigate the problem of strong approximation of the solutions of stochastic differential equations (SDEs) when the drift coefficient is given in integral form. We investigate its upper error bounds, in terms of the discretization parameter $n$ and the size $M$ of the random sample drawn at each step of the algorithm, in different subclasses of coefficients of the underlying SDE presenting various rates of convergence. Integral-form drift often appears when analyzing stochastic dynamics of optimization procedures in machine learning (ML) problems. Hence, we additionally discuss connections of the defined randomized Euler approximation scheme with the perturbed version of the stochastic gradient descent (SGD) algorithm. Finally, the results of numerical experiments performed using GPU architecture are also reported, including a comparison with other popular optimizers used in ML.

math.NA↗

A Skorohod measurable universal functional representation of solutions to semimartingale SDEs

In this paper we show the existence of a universal Skorohod measurable functional representation for a large class of semimartingale-driven stochastic differential equations. For this we prove that paths of the strong solutions of stochastic differential equations can be written as measurable functions of the paths of their driving processes into the space of all càdlàg functions equipped with the Borel sigma-field generated by all open sets with respect to the Skorohod metric. This result can be applied to calculate Malliavin derivatives for SDEs driven by pure-jump Lévy processes with drift.

math.PR↗

Convergence and stability of randomized implicit two-stage Runge-Kutta schemes

We randomize the implicit two-stage Runge-Kutta scheme in order to improve the rate of convergence (with respect to a deterministic scheme) and stability of the approximate solution (with respect to the solution generated by the explicit scheme). For stability analysis, we use Dahlquist's concept of A-stability, adopted to randomized schemes by considering three notions of stability: asymptotic, mean-square, and in probability. The randomized implicit RK2 scheme proves to be A-stable asymptotically and in probability but not in the mean-square sense.

math.NA↗

Foundations of Monte Carlo methods and stochastic simulations -- From Monte Carlo Lebesgue integration to weak approximation of SDEs

In recent years dynamical systems (of deterministic and stochastic nature), describing many models in mathematics, physics, engineering and finances, become more and more complex. Numerical analysis narrowed only to deterministic algorithms seems to be insufficient for such systems, since, for example, curse of dimensionality affects deterministic methods. Therefore, we can observe increasing popularity of Monte Carlo algorithms and, closely related with them, stochastic simulations based on stochastic differential equations. In these lecture notes we present main ideas concerned with Monte Carlo methods and their theoretical properties. We apply them to such problems as integration and approximation of solutions of deterministic/stochastic differential equations. We also discuss implementation of exemplary algorithms in Python programming language and their application to option pricing. Part of these notes has been used during lectures for PhD students at AGH University of Science and Technology, Krakow, Poland, at summer semesters in the years 2020, 2021, 2023.

math.NA↗

A Randomized Runge-Kutta Method for time-irregular delay differential equations

In this paper we investigate the existence, uniqueness and approximation of solutions of delay differential equations (DDEs) with the right-hand side functions $f=f(t,x,z)$ that are Lipschitz continuous with respect to $x$ but only Hölder continuous with respect to $(t,z)$. We give a construction of the randomized two-stage Runge-Kutta scheme for DDEs and investigate its upper error bound in the $L^p(Ω)$-norm for $p\in [2,+\infty)$. Finally, we report on results of numerical experiments.

math.NA↗

Deep learning-based estimation of time-dependent parameters in Markov models with application to nonlinear regression and SDEs

We present a novel deep learning method for estimating time-dependent parameters in Markov processes through discrete sampling. Departing from conventional machine learning, our approach reframes parameter approximation as an optimization problem using the maximum likelihood approach. Experimental validation focuses on parameter estimation in multivariate regression and stochastic differential equations (SDEs). Theoretical results show that the real solution is close to SDE with parameters approximated using our neural network-derived under specific conditions. Our work contributes to SDE-based model parameter estimation, offering a versatile tool for diverse fields.

stat.ML↗

A higher order approximation method for jump-diffusion SDEs with discontinuous drift coefficient

We present the first higher-order approximation scheme for solutions of jump-diffusion stochastic differential equations with discontinuous drift. For this transformation-based jump-adapted quasi-Milstein scheme we prove $L^p$-convergence order 3/4. To obtain this result, we prove that under slightly stronger assumptions (but still weaker than anything known before) a related jump-adapted quasi-Milstein scheme has convergence order 3/4 - in a special case even order 1. Order 3/4 is conjectured to be optimal.

math.NA↗

Randomized Milstein algorithm for approximation of solutions of jump-diffusion SDEs

We investigate the error of the randomized Milstein algorithm for solving scalar jump-diffusion stochastic differential equations. We provide a complete error analysis under substantially weaker assumptions than known in the literature. In case the jump-commutativity condition is satisfied, we prove optimality of the randomized Milstein algorithm by proving a matching lower bound. Moreover, we give some insight into the multidimensional case by investigating the optimal convergence rate for the approximation of jump-diffusion type Lévys' areas. Finally, we report numerical experiments that support our theoretical findings.

math.NA↗

Lower error bounds and optimality of approximation for jump-diffusion SDEs with discontinuous drift

In this note we prove sharp lower error bounds for numerical methods for jump-diffusion stochastic differential equations (SDEs) with discontinuous drift. We study the approximation of jump-diffusion SDEs with non-adaptive as well as jump-adapted approximation schemes and provide lower error bounds of order $3/4$ for both classes of approximation schemes. This yields optimality of the transformation-based jump-adapted quasi-Milstein scheme.

math.NA↗

Euler scheme for approximation of solution of nonlinear ODEs under inexact information

We investigate error of the Euler scheme in the case when the right-hand side function of the underlying ODE satisfies nonstandard assumptions such as local one-sided Lipschitz condition and local Hölder continuity. Moreover, we assume two cases in regards to information availability: exact and noisy with respect to the right-hand side function. Optimality analysis of the Euler scheme is also provided. Finally, we present the results of some numerical experiments.

math.NA↗

On the randomized Euler algorithm under inexact information

This paper focuses on analyzing the error of the randomized Euler algorithm when only noisy information about the coefficients of the underlying stochastic differential equation (SDE) and the driving Wiener process is available. Two classes of disturbed Wiener process are considered, and the dependence of the algorithm's error on the regularity of the disturbing functions is investigated. The paper also presents results from numerical experiments to support the theoretical findings.

math.NA↗

On approximation of solutions of stochastic delay differential equations via randomized Euler scheme

We investigate existence, uniqueness and approximation of solutions to stochastic delay differential equations (SDDEs) under Carathéodory-type drift coefficients. Moreover, we also assume that both drift $f=f(t,x,z)$ and diffusion $g=g(t,x,z)$ coefficient are Lipschitz continuous with respect to the space variable $x$, but only Hölder continuous with respect to the delay variable $z$. We provide a construction of randomized Euler scheme for approximation of solutions of Carathéodory SDDEs, and investigate its upper error bound. Finally, we report results of numerical experiments that confirm our theoretical findings.

math.NA↗

Monte Carlo integration of $C^r$ functions with adaptive variance reduction: an asymptotic analysis

The theme of the present paper is numerical integration of $C^r$ functions using randomized methods. We consider variance reduction methods that consist in two steps. First the initial interval is partitioned into subintervals and the integrand is approximated by a piecewise polynomial interpolant that is based on the obtained partition. Then a randomized approximation is applied on the difference of the integrand and its interpolant. The final approximation of the integral is the sum of both. The optimal convergence rate is already achieved by uniform (nonadaptive) partition plus the crude Monte Carlo; however, special adaptive techniques can substantially lower the asymptotic factor depending on the integrand. The improvement can be huge in comparison to the nonadaptive method, especially for functions with rapidly varying $r$th derivatives, which has serious implications for practical computations. In addition, the proposed adaptive methods are easily implementable and can be well used for automatic integration.

math.NA↗