Searcharxiv⌕ Search

arXiv subjects

David F. Anderson

Publications and source records attributed to David F. Anderson.

At least 55 records · Page 3Linked to original sources

Stochastic Representations of Ion Channel Kinetics and Exact Stochastic Simulation of Neuronal Dynamics

In this paper we provide two representations for stochastic ion channel kinetics, and compare the performance of exact simulation with a commonly used numerical approximation strategy. The first representation we present is a random time change representation, popularized by Thomas Kurtz, with the second being analogous to a "Gillespie" representation. Exact stochastic algorithms are provided for the different representations, which are preferable to either (a) fixed time step or (b) piecewise constant propensity algorithms, which still appear in the literature. As examples, we provide versions of the exact algorithms for the Morris-Lecar conductance based model, and detail the error induced, both in a weak and a strong sense, by the use of approximate algorithms on this model. We include ready-to-use implementations of the random time change algorithm in both XPP and Matlab. Finally, through the consideration of parametric sensitivity analysis, we show how the representations presented here are useful in the development of further computational methods. The general representations and simulation strategies provided here are known in other parts of the sciences, but less so in the present setting.

q-bio.NC↗

Complexity of Multilevel Monte Carlo Tau-Leaping

Tau-leaping is a popular discretization method for generating approximate paths of continuous time, discrete space, Markov chains, notably for biochemical reaction systems. To compute expected values in this context, an appropriate multilevel Monte Carlo form of tau-leaping has been shown to improve efficiency dramatically. In this work we derive new analytic results concerning the computational complexity of multilevel Monte Carlo tau-leaping that are significantly sharper than previous ones. We avoid taking asymptotic limits, and focus on a practical setting where the system size is large enough for many events to take place along a path, so that exact simulation of paths is expensive, making tau-leaping an attractive option. We use a general scaling of the system components that allows for the reaction rate constants and the abundances of species to vary over several orders of magnitude, and we exploit the random time change representation developed by Kurtz. The key feature of the analysis that allows for the sharper bounds is that when comparing relevant pairs of processes we analyze the variance of their difference directly rather than bounding via the second moment. Use of the second moment is natural in the setting of a diffusion equation, where multilevel was first developed and where strong convergence results for numerical methods are readily available, but is not optimal for the Poisson-driven jump systems that we consider here. We also present computational results that illustrate the new analysis.

math.NA↗

An asymptotic relationship between coupling methods for stochastically modeled population processes

This paper is concerned with elucidating a relationship between two common coupling methods for the continuous time Markov chain models utilized in the cell biology literature. The couplings considered here are primarily used in a computational framework by providing reductions in variance for different Monte Carlo estimators, thereby allowing for significantly more accurate results for a fixed amount of computational time. Common applications of the couplings include the estimation of parametric sensitivities via finite difference methods and the estimation of expectations via multi-level Monte Carlo algorithms. While a number of coupling strategies have been proposed for the models considered here, and a number of articles have experimentally compared the different strategies, to date there has been no mathematical analysis describing the connections between them. Such analyses are critical in order to determine the best use for each. In the current paper, we show a connection between the common reaction path (CRP) method and the split coupling (SC) method, which is termed coupled finite differences (CFD) in the parametric sensitivities literature. In particular, we show that the two couplings are both limits of a third coupling strategy we call the "local-CRP" coupling, with the split coupling method arising as a key parameter goes to infinity, and the common reaction path coupling arising as the same parameter goes to zero. The analysis helps explain why the split coupling method often provides a lower variance than does the common reaction path method, a fact previously shown experimentally.

math.NA↗

Stochastic analysis of biochemical reaction networks with absolute concentration robustness

It has recently been shown that structural conditions on the reaction network, rather than a 'fine-tuning' of system parameters, often suffice to impart 'absolute concentration robustness' on a wide class of biologically relevant, deterministically modeled mass-action systems [Shinar and Feinberg, Science, 2010]. We show here that fundamentally different conclusions about the long-term behavior of such systems are reached if the systems are instead modeled with stochastic dynamics and a discrete state space. Specifically, we characterize a large class of models that exhibit convergence to a positive robust equilibrium in the deterministic setting, whereas trajectories of the corresponding stochastic models are necessarily absorbed by a set of states that reside on the boundary of the state space, i.e. the system undergoes an extinction event. If the time to extinction is large relative to the relevant time-scales of the system, the process will appear to settle down to a stationary distribution long before the inevitable extinction will occur. This quasi-stationary distribution is considered for two systems taken from the literature, and results consistent with absolute concentration robustness are recovered by showing that the quasi-stationary distribution of the robust species approaches a Poisson distribution.

math.PR↗

A finite difference method for estimating second order parameter sensitivities of discrete stochastic chemical reaction networks

We present an efficient finite difference method for the approximation of second derivatives, with respect to system parameters, of expectations for a class of discrete stochastic chemical reaction networks. The method uses a coupling of the perturbed processes that yields a much lower variance than existing methods, thereby drastically lowering the computational complexity required to solve a given problem. Further, the method is simple to implement and will also prove useful in any setting in which continuous time Markov chains are used to model dynamics, such as population processes. We expect the new method to be useful in the context of optimization algorithms that require knowledge of the Hessian.

q-bio.QM↗

An Efficient Finite Difference Method for Parameter Sensitivities of Continuous Time Markov Chains

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed and nominal processes in a natural manner, and the analysis proceeds by utilizing a martingale representation for the coupled processes. The variance of the resulting estimator is shown to be an order of magnitude lower due to the coupling. We conclude that the proposed method produces an estimator with a lower variance than other methods, including the use of Common Random Numbers, in most situations. Often the variance reduction is substantial. The method is no harder to implement than any standard continuous time Markov chain algorithm, such as "Gillespie's algorithm." The motivating class of models, and the source of our examples, are the stochastic chemical kinetic models commonly used in the biosciences, though other natural application areas include population processes and queuing networks.

math.NA↗

Weak error analysis of numerical methods for stochastic models of population processes

The simplest, and most common, stochastic model for population processes, including those from biochemistry and cell biology, are continuous time Markov chains. Simulation of such models is often relatively straightforward as there are easily implementable methods for the generation of exact sample paths. However, when using ensemble averages to approximate expected values, the computational complexity can become prohibitive as the number of computations per path scales linearly with the number of jumps of the process. When such methods become computationally intractable, approximate methods, which introduce a bias, can become advantageous. In this paper, we provide a general framework for understanding the weak error, or bias, induced by different numerical approximation techniques in the current setting. The analysis takes into account both the natural scalings within a given system and the step-size of the numerical method. Examples are provided to demonstrate the main analytical results as well as the reduction in computational complexity achieved by the approximate methods.

math.PR↗

Error analysis of tau-leap simulation methods

We perform an error analysis for numerical approximation methods of continuous time Markov chain models commonly found in the chemistry and biochemistry literature. The motivation for the analysis is to be able to compare the accuracy of different approximation methods and, specifically, Euler tau-leaping and midpoint tau-leaping. We perform our analysis under a scaling in which the size of the time discretization is inversely proportional to some (bounded) power of the norm of the state of the system. We argue that this is a more appropriate scaling than that found in previous error analyses in which the size of the time discretization goes to zero independent of the rest of the model. Under the present scaling, we show that midpoint tau-leaping achieves a higher order of accuracy, in both a weak and a strong sense, than Euler tau-leaping; a result that is in contrast to previous analyses. We present examples that demonstrate our findings.

math.PR↗

Multi-level Monte Carlo for continuous time Markov chains, with applications in biochemical kinetics

We show how to extend a recently proposed multi-level Monte Carlo approach to the continuous time Markov chain setting, thereby greatly lowering the computational complexity needed to compute expected values of functions of the state of the system to a specified accuracy. The extension is non-trivial, exploiting a coupling of the requisite processes that is easy to simulate while providing a small variance for the estimator. Further, and in a stark departure from other implementations of multi-level Monte Carlo, we show how to produce an unbiased estimator that is significantly less computationally expensive than the usual unbiased estimator arising from exact algorithms in conjunction with crude Monte Carlo. We thereby dramatically improve, in a quantifiable manner, the basic computational complexity of current approaches that have many names and variants across the scientific literature, including the Bortz-Kalos-Lebowitz algorithm, discrete event simulation, dynamic Monte Carlo, kinetic Monte Carlo, the n-fold way, the next reaction method,the residence-time algorithm, the stochastic simulation algorithm, Gillespie's algorithm, and tau-leaping. The new algorithm applies generically, but we also give an example where the coupling idea alone, even without a multi-level discretization, can be used to improve efficiency by exploiting system structure. Stochastically modeled chemical reaction networks provide a very important application for this work. Hence, we use this context for our notation, terminology, natural scalings, and computational examples.

math.PR↗

Boundedness of trajectories for weakly reversible, single linkage class reaction systems

This paper is concerned with the dynamical properties of deterministically modeled chemical reaction systems with mass-action kinetics. Such models are ubiquitously found in chemistry, population biology, and the burgeoning field of systems biology. A basic question, whose answer remains largely unknown, is the following: for which network structures do trajectories of mass-action systems remain bounded in time? In this paper, we conjecture that the result holds when the reaction network is weakly reversible, and prove this conjecture in the case when the reaction network consists of a single linkage class, or connected component.

math.DS↗

A proof of the Global Attractor Conjecture in the single linkage class case

This paper is concerned with the dynamical properties of deterministically modeled chemical reaction systems. Specifically, this paper provides a proof of the Global Attractor Conjecture in the setting where the underlying reaction diagram consists of a single linkage class, or connected component. The conjecture dates back to the early 1970s and is the most well known and important open problem in the field of chemical reaction network theory. The resolution of the conjecture has important biological and mathematical implications in both the deterministic and stochastic settings. One of our main analytical tools, which is introduced here, will be a method for partitioning the relevant monomials of the dynamical system along sequences of trajectory points into classes with comparable growths. We will use this method to conclude that if a trajectory converges to the boundary, then a whole family of Lyapunov functions decrease along the trajectory. This will allow us to overcome the fact that the usual Lyapunov functions of chemical reaction network theory are bounded on the boundary of the positive orthant, which has been the technical sticking point to a proof of the Global Attractor Conjecture in the past.

math.DS↗

A weak trapezoidal method for a class of stochastic differential equations

We present a numerical method for the approximation of solutions for the class of stochastic differential equations driven by Brownian motions which induce stochastic variation in fixed directions. This class of equations arises naturally in the study of population processes and chemical reaction kinetics. We show that the method constructs paths that are second order accurate in the weak sense. The method is simpler than many second order methods in that it neither requires the construction of iterated Ito integrals nor the evaluation of any derivatives. The method consists of two steps. In the first an explicit Euler step is used to take a fractional step. This fractional point is then combined with the initial point to obtain a higher order, trapezoidal like, approximation. The higher order of accuracy stems from the fact that both the drift and the quadratic variation of the underlying SDE are approximated to second order.

math.NA↗

Product-form stationary distributions for deficiency zero chemical reaction networks

We consider stochastically modeled chemical reaction systems with mass-action kinetics and prove that a product-form stationary distribution exists for each closed, irreducible subset of the state space if an analogous deterministically modeled system with mass-action kinetics admits a complex balanced equilibrium. Feinberg's deficiency zero theorem then implies that such a distribution exists so long as the corresponding chemical network is weakly reversible and has a deficiency of zero. The main parameter of the stationary distribution for the stochastically modeled system is a complex balanced equilibrium value for the corresponding deterministically modeled system. We also generalize our main result to some non-mass-action kinetics.

math.PR↗

The dynamics of weakly reversible population processes near facets

This paper concerns the dynamical behavior of weakly reversible, deterministically modeled population processes near the facets (codimension-one faces) of their invariant manifolds and proves that the facets of such systems are "repelling." It has been conjectured that any population process whose network graph is weakly reversible (has strongly connected components) is persistent. We prove this conjecture to be true for the subclass of weakly reversible systems for which only facets of the invariant manifold are associated with semilocking sets, or siphons. An important application of this work pertains to chemical reaction systems that are complex-balancing. For these systems it is known that within the interior of each invariant manifold there is a unique equilibrium. The Global Attractor Conjecture states that each of these equilibria is globally asymptotically stable relative to the interior of the invariant manifold in which it lies. Our results pertaining to weakly reversible systems imply that this conjecture holds for all complex-balancing systems whose boundary equilibria lie in the relative interior of the boundary facets. As a corollary, we show that the Global Attractor Conjecture holds for those systems for which the associated invariant manifolds are two-dimensional.

math.DS↗

On $v$--domains and star operations

Let $\ast$ be a star operation on an integral domain $D$. Let $\f(D)$ be the set of all nonzero finitely generated fractional ideals of $D$. Call $D$ a $\ast$--Prüfer (respectively, $(\ast, v)$--Prüfer) domain if $(FF^{-1})^{\ast}=D$ (respectively, $(F^vF^{-1})^{\ast}=D$) for all $F\in \f(D)$. We establish that $\ast$--Prüfer domains (and $(\ast, v)$--Prüfer domains) for various star operations $\ast $ span a major portion of the known generalizations of Prüfer domains inside the class of $v$--domains. We also use Theorem 6.6 of the Larsen and McCarthy book [Multiplicative Theory of Ideals, Academic Press, New York--London, 1971], which gives several equivalent conditions for an integral domain to be a Prüfer domain, as a model, and we show which statements of that theorem on Prüfer domains can be generalized in a natural way and proved for $\ast$--Prüfer domains, and which cannot be. We also show that in a $\ast $--Prüfer domain, each pair of $\ast $-invertible $\ast $-ideals admits a GCD in the set of $\ast $-invertible $\ast $-ideals, obtaining a remarkable generalization of a property holding for the "classical" class of Prüfer $v$--multiplication domains. We also link $D$ being $\ast $--Prüfer (or $(\ast, v)$--Prüfer) with the group Inv$^{\ast}(D)$ of $\ast $-invertible $\ast $-ideals (under $\ast$-multiplication) being lattice-ordered.

math.AC↗

Incorporating postleap checks in tau-leaping

By explicitly representing the reaction times of discrete chemical systems as the firing times of independent, unit rate Poisson processes, we develop a new adaptive tau-leaping procedure. The procedure developed is novel in that accuracy is guaranteed by performing postleap checks. Because the representation we use separates the randomness of the model from the state of the system, we are able to perform the postleap checks in such a way that the statistics of the sample paths generated will not be biased by the rejections of leaps. Further, since any leap condition is ensured with a probability of one, the simulation method naturally avoids negative population values

q-bio.MN↗

Global asymptotic stability for a class of nonlinear chemical equations

We consider a class of nonlinear differential equations that arises in the study of chemical reaction systems that are known to be locally asymptotically stable and prove that they are in fact globally asymptotically stable. More specifically, we will consider chemical reaction systems that are weakly reversible, have a deficiency of zero, and are equipped with mass action kinetics. We show that if for each $c \in \R_{> 0}^m$ the intersection of the stoichiometric compatibility class $c + S$ with the subsets on the boundary that could potentially contain equilibria, $L_W$, are at most discrete, then global asymptotic stability follows. Previous global stability results for the systems considered in this paper required $(c + S) \cap L_W = \emptyset$ for each $c \in \R^m_{> 0}$, and so this paper can be viewed as an extension of those works.

math.DS↗

Some remarks on Prüfer $\star $--multiplication domains and class groups

Let $D$ be an integral domain with quotient field $K$ and let $X$ be an indeterminate over $D$. Also, let $\boldsymbol{\mathcal{T}}:=\{T_λ\mid λ \in Λ\}$ be a defining family of quotient rings of $D$ and suppose that $\ast $ is a finite type star operation on $D$ induced by $\boldsymbol{\mathcal{T}}$. We show that $D$ is a P$ \ast $MD (resp., P$v$MD) if and only if $(\co_D(fg))^{\ast}=(\co_D(f)\co_D(g))^{\ast}$ (resp., $(\co_D(fg))^{w}=(\co_D(f)\co_D(g))^{w}$) for all $0 \ne f,g \in K[X]$. A more general version of this result is given in the semistar operation setting. We give a method for recognizing P$v$MD's which are not P$\ast $MD's for a certain finite type star operation $\ast $. We study domains $D$ for which the $\ast $--class group $\Cl^{\ast}(D)$ equals the $t$--class group $\Cl^{t}(D)$ for any finite type star operation $\ast $, and we indicate examples of P$v$MD's $D$ such that $\Cl^{\ast}(D)\subsetneq \Cl^{t}(D)$. We also compute $\Cl^v(D)$ for certain valuation domains $D$.

math.AC↗