Searcharxiv⌕ Search

arXiv subjects

Amarjit Budhiraja

Publications and source records attributed to Amarjit Budhiraja.

At least 73 records · Page 4Linked to original sources

Uniform in Time Interacting Particle Approximations for Nonlinear Equations of Patlak-Keller-Segel type

We study a system of interacting diffusions that models chemotaxis of biological cells or microorganisms (referred to as particles) in a chemical field that is dynamically modified through the collective contributions from the particles. Such systems of reinforced diffusions have been widely studied and their hydrodynamic limits that are nonlinear non-local partial differential equations are usually referred to as Patlak-Keller-Segel (PKS) equations. Under the so-called "quasi-stationary hypothesis" on the chemical field the limit PDE is closely related to granular media equations that have been extensively studied probabilistically in recent years. Solutions of classical PKS solutions may blow up in finite time and much of the PDE literature has been focused on understanding this blow-up phenomenon. In this work we study a modified form of the PKS equation for which global existence and uniqueness of solutions holds. Our goal is to analyze the long-time behavior of the particle system approximating the equation. We establish, under suitable conditions, uniform in time convergence of the empirical measure of particle states to the solution of the PDE. We also provide uniform in time exponential concentration bounds for rate of the above convergence under additional integrability conditions. Finally, we introduce an Euler discretization scheme for the simulation of the interacting particle system and give error bounds that show that the scheme converges uniformly in time and in the size of the particle system as the discretization parameter approaches zero.

math.PR↗

Diffusion Approximations for Controlled Weakly Interacting Large Finite State Systems with Simultaneous Jumps

We consider a rate control problem for an $N$-particle weakly interacting finite state Markov process. The process models the state evolution of a large collection of particles and allows for multiple particles to change state simultaneously. Such models have been proposed for large communication systems (e.g. ad hoc wireless networks) but are also suitable for other settings such as chemical-reaction networks. An associated diffusion control problem is presented and we show that the value function of the $N$-particle controlled system converges to the value function of the limit diffusion control problem as $N\to\infty$. The diffusion coefficient in the limit model is typically degenerate, however under suitable conditions there is an equivalent formulation in terms of a controlled diffusion with a uniformly non-degenerate diffusion coefficient. Using this equivalence, we show that near optimal continuous feedback controls exist for the diffusion control problem. We then construct near asymptotically optimal control policies for the $N$-particle system based on such continuous feedback controls. Results from some numerical experiments are presented.

math.PR↗

Source detection algorithms for dynamic contaminants based on the analysis of a hydrodynamic limit

In this work we propose and numerically analyze an algorithm for detection of a contaminant source using a dynamic sensor network. The algorithm is motivated using a global probabilistic optimization problem and is based on the analysis of the hydrodynamic limit of a discrete time evolution equation on the lattice under a suitable scaling of time and space. Numerical results illustrating the effectiveness of the algorithm are presented.

math.PR↗

Moderate Deviation Principles for Weakly Interacting Particle Systems

Moderate deviation principles for empirical measure processes associated with weakly interacting Markov processes are established. Two families of models are considered: the first corresponds to a system of interacting diffusions whereas the second describes a collection of pure jump Markov processes with a countable state space. For both cases the moderate deviation principle is formulated in terms of a large deviation principle (LDP), with an appropriate speed function, for suitably centered and normalized empirical measure processes. For the first family of models the LDP is established in the path space of an appropriate Schwartz distribution space whereas for the second family the LDP is proved in the space of $l_2$ (the Hilbert space of square summable sequences)-valued paths. Proofs rely on certain variational representations for exponential functionals of Brownian motions and Poisson random measures.

math.PR↗

Some Fluctuation Results for Weakly Interacting Multi-type Particle System

A collection of $N$-diffusing interacting particles where each particle belongs to one of $K$ different populations is considered. Evolution equation for a particle from population $k$ depends on the $K$ empirical measures of particle states corresponding to the various populations and the form of this dependence may change from one population to another. In addition, the drift coefficients in the particle evolution equations may depend on a factor that is common to all particles and which is described through the solution of a stochastic differential equation coupled, through the empirical measures, with the $N$-particle dynamics. We are interested in the asymptotic behavior as $N\to \infty$. Although the full system is not exchangeable, particles in the same population have an exchangeable distribution. Using this structure, one can prove using standard techniques a law of large numbers result and a propagation of chaos property. In the current work we study fluctuations about the law of large number limit. For the case where the common factor is absent the limit is given in terms of a Gaussian field whereas in the presence of a common factor it is characterized through a mixture of Gaussian distributions. We also obtain, as a corollary, new fluctuation results for disjoint sub-families of single type particle systems, i.e. when $K=1$. Finally, we establish limit theorems for multi-type statistics of such weakly interacting particles, given in terms of multiple Wiener integrals.

math.PR↗

Limits of relative entropies associated with weakly interacting particle systems

The limits of scaled relative entropies between probability distributions associated with N-particle weakly interacting Markov processes are considered. The convergence of such scaled relative entropies is established in various settings. The analysis is motivated by the role relative entropy plays as a Lyapunov function for the (linear) Kolmogorov forward equation associated with an ergodic Markov process, and Lyapunov function properties of these scaling limits with respect to nonlinear finite-state Markov processes are studied in the companion paper [6].

math.PR↗

Local stability of Kolmogorov forward equations for finite state nonlinear Markov processes

The focus of this work is on local stability of a class of nonlinear ordinary differential equations (ODE) that describe limits of empirical measures associated with finite-state weakly interacting N-particle systems. Local Lyapunov functions are identified for several classes of such ODE, including those associated with systems with slow adaptation and Gibbs systems. Using results from [5] and large deviations heuristics, a partial differential equation (PDE) associated with the nonlinear ODE is introduced and it is shown that positive definite subsolutions of this PDE serve as local Lyapunov functions for the ODE. This PDE characterization is used to construct explicit Lyapunov functions for a broad class of models called locally Gibbs systems. This class of models is significantly larger than the family of Gibbs systems and several examples of such systems are presented, including models with nearest neighbor jumps and models with simultaneous jumps that arise in applications.

math.PR↗

Construction of Asymptotically Optimal Control for a Stochastic Network from a Free Boundary Problem

An asymptotic framework for optimal control of multiclass stochastic processing networks, using formal diffusion approximations under suitable temporal and spatial scaling, by Brownian control problems (BCP) and their equivalent workload formulations (EWF), has been developed by Harrison (1988). This framework has been implemented in many works for constructing asymptotically optimal control policies for a broad range of stochastic network models. To date all asymptotic optimality results for such networks correspond to settings where the solution of the EWF is a reflected Brownian motion in the positive orthant with normal reflections. In this work we consider a well studied stochastic network which is perhaps the simplest example of a model with more than one dimensional workload process. In the regime considered here, the singular control problem corresponding to the EWF does not have a simple form explicit solution, however by considering an associated free boundary problem one can give a representation for an optimal controlled process as a two dimensional reflected Brownian motion in a Lipschitz domain whose boundary is determined by the solution of the free boundary problem. Using the form of the optimal solution we propose a sequence of control policies, given in terms of suitable thresholds, for the scaled stochastic network control problems and prove that this sequence of policies is asymptotically optimal. As suggested by the solution of the EWF, the policy we propose requires a server to idle under certain conditions which are specified in terms of the thresholds determined from the free boundary.

math.PR↗

Large deviations for multidimensional state-dependent shot noise processes

Shot noise processes are used in applied probability to model a variety of physical systems in, for example, teletraffic theory, insurance and risk theory and in the engineering sciences. In this work we prove a large deviation principle for the sample-paths of a general class of multidimensional state-dependent Poisson shot noise processes. The result covers previously known large deviation results for one dimensional state-independent shot noise processes with light tails. We use the weak convergence approach to large deviations, which reduces the proof to establishing the appropriate convergence of certain controlled versions of the original processes together with relevant results on existence and uniqueness.

math.PR↗

Individual confidence intervals for true solutions to stochastic variational inequalities

Stochastic variational inequalities (SVI) provide a means for modeling various optimization and equilibrium problems where data are subject to uncertainty. Often it is necessary to estimate the true SVI solution by the solution of a sample average approximation (SAA) problem. This paper proposes three methods for building confidence intervals for components of the true solution, and those intervals are computable from a single SAA solution. The first two methods use an "indirect approach" that requires initially computing asymptotically exact confidence intervals for the solution to the normal map formulation of the SVI. The third method directly constructs confidence intervals for the true SVI solution; intervals produced with this method meet a minimum specified level of confidence in the same situations for which the first two methods are applicable. We justify the three methods theoretically with weak convergence results, discuss how to implement these methods, and test their performance using two numerical examples.

math.OC↗

Infinite Dimensional Forward-Backward Stochastic Differential Equations and the KPZ Equation

Kardar-Parisi-Zhang (KPZ) equation is a quasilinear stochastic partial differential equation(SPDE) driven by a space-time white noise. In recent years there have been several works directed towards giving a rigorous meaning to a solution of this equation. Bertini, Cancrini and Giacomin have proposed a notion of a solution through a limiting procedure and a certain renormalization of the nonlinearity. In this work we study connections between the KPZ equation and certain infinite dimensional forward-backward stochastic differential equations. Forward-backward equations with a finite dimensional noise have been studied extensively, mainly motivated by problems in mathematical finance. Equations considered here differ from the classical works in that, in addition to having an infinite dimensional driving noise, the associated SPDE involves a non-Lipschitz (namely a quadratic) function of the gradient. Existence and uniqueness of solutions of such infinite dimensional forward-backward equations is established and the terminal values of the solutions are then used to give a new probabilistic representation for the solution of the KPZ equation.

math.PR↗

On the multi-dimensional skew Brownian motion

We provide a new, concise proof of weak existence and uniqueness of solutions to the stochastic differential equation for the multidimensional skew Brownian motion. We also present an application to Brownian particles with skew-elastic collisions.

math.PR↗

Long Time Results for a Weakly Interacting Particle System in Discrete Time

We study long time behavior of a discrete time weakly interacting particle system, and the corresponding nonlinear Markov process in $\mathbb{R}^d$, described in terms of a general stochastic evolution equation. In a setting where the state space of the particles is compact such questions have been studied in previous works, however for the case of an unbounded state space very few results are available. Under suitable assumptions on the problem data we study several time asymptotic properties of the $N$-particle system and the associated nonlinear Markov chain. In particular we show that the evolution equation for the law of the nonlinear Markov chain has a unique fixed point and starting from an arbitrary initial condition convergence to the fixed point occurs at an exponential rate. The empirical measure $μ_{n}^{N}$ of the $N$-particles at time $n$ is shown to converge to the law $μ_{n}$ of the nonlinear Markov process at time $n$, in the Wasserstein-1 distance, in $L^{1}$, as $N\to \infty$, uniformly in $n$. Several consequences of this uniform convergence are studied, including the interchangeability of the limits $n\to \infty$ and $N\to\infty$ and the propagation of chaos property at $n = \infty$. Rate of convergence of $μ_{n}^{N}$ to $μ_{n}$ is studied by establishing uniform in time polynomial and exponential probability concentration estimates.

math.PR↗

Near critical catalyst reactant branching processes with controlled immigration

Near critical catalyst-reactant branching processes with controlled immigration are studied. The reactant population evolves according to a branching process whose branching rate is proportional to the total mass of the catalyst. The bulk catalyst evolution is that of a classical continuous time branching process; in addition there is a specific form of immigration. Immigration takes place exactly when the catalyst population falls below a certain threshold, in which case the population is instantaneously replenished to the threshold. Such models are motivated by problems in chemical kinetics where one wants to keep the level of a catalyst above a certain threshold in order to maintain a desired level of reaction activity. A diffusion limit theorem for the scaled processes is presented, in which the catalyst limit is described through a reflected diffusion, while the reactant limit is a diffusion with coefficients that are functions of both the reactant and the catalyst. Stochastic averaging principles under fast catalyst dynamics are established. In the case where the catalyst evolves "much faster" than the reactant, a scaling limit, in which the reactant is described through a one dimensional SDE with coefficients depending on the invariant distribution of the reflected diffusion, is obtained. Proofs rely on constrained martingale problem characterizations, Lyapunov function constructions, moment estimates that are uniform in time and the scaling parameter and occupation measure techniques.

math.PR↗

On Uniform Positivity of Transition Densities of Small Noise Constrained Diffusions

Constrained diffusions in convex polyhedral domains with a general oblique reflection field, and with a diffusion coefficient scaled by a small parameter, are considered. Using an interior Dirichlet heat kernel lower bound estimate for second order elliptic operators in bounded domains from [13], certain uniform in the scaling parameter lower bounds on transition densities of such constrained diffusions are established. These lower bounds together with results from [1] give, under additional stability conditions, an exponential leveling property, as the scaling parameter approaches zero, for exit times from suitable bounded domains.

math.PR↗

The augmented multiplicative coalescent and critical dynamic random graph models

Random graph models with limited choice have been studied extensively with the goal of understanding the mechanism of the emergence of the giant component. One of the standard models are the Achlioptas random graph processes on a fixed set of $n$ vertices. Here at each step, one chooses two edges uniformly at random and then decides which one to add to the existing configuration according to some criterion. An important class of such rules are the bounded-size rules where for a fixed $K\geq 1$, all components of size greater than $K$ are treated equally. While a great deal of work has gone into analyzing the subcritical and supercritical regimes, the nature of the critical scaling window, the size and complexity (deviation from trees) of the components in the critical regime and nature of the merging dynamics has not been well understood. In this work we study such questions for general bounded-size rules. Our first main contribution is the construction of an extension of Aldous's standard multiplicative coalescent process which describes the asymptotic evolution of the vector of sizes and surplus of all components. We show that this process, referred to as the standard augmented multiplicative coalescent (AMC) is `nearly' Feller with a suitable topology on the state space. Our second main result proves the convergence of suitably scaled component size and surplus vector, for any bounded-size rule, to the standard AMC. The key ingredients here are a precise analysis of the asymptotic behavior of various susceptibility functions near criticality and certain bounds from [8], on the size of the largest component in the barely subcritical regime.

math.PR↗

Bounded-size rules: The barely subcritical regime

Bounded-size rules are dynamic random graph processes which incorporate limited choice along with randomness in the evolution of the system. One starts with the empty graph and at each stage two edges are chosen uniformly at random. One of the two edges is then placed into the system according to a decision rule based on the sizes of the components containing the four vertices. For bounded-size rules, all components of size greater than some fixed $K\geq 1$ are accorded the same treatment. Writing $\BS(t)$ for the state of the system with nt/2 edges, Spencer and Wormald proved that for such rules, there exists a critical time t_c such that when t< t_c the size of the largest component is of order $\log{n}$ while for $t> t_c$, the size of the largest component is of order $n$. In this work we obtain upper bounds (that hold with high probability) of order $n^{2γ} \log ^4 n$, on the size of the largest component, at time instants $t_n = t_c-n^{-γ}$, where $γ\in (0,1/4)$. This result for the barely subcritical regime forms a key ingredient in the study undertaken in \cite{amc-2012}, of the asymptotic dynamic behavior of the process describing the vector of component sizes and associated complexity of the components for such random graph models in the critical scaling window. The proof uses a coupling of BSR processes with a certain family of inhomogeneous random graphs with vertices in the type space $\Rbold_+\times \cD([0,\infty):\NNN_0)$ where $\cD([0,\infty):\NNN_0)$ is the Skorohod $D$-space of functions that are right continuous and have left limits equipped with the usual Skorohod topology. The coupling construction also gives an alternative characterization (than the usual explosion time of the susceptibility function) of the critical time $t_c$ for the emergence of the giant component in terms of the operator norm of integral operators on certain $L^2$ spaces.

math.PR↗