Searcharxiv⌕ Search

arXiv subjects

David M. Bortz

Publications and source records attributed to David M. Bortz.

At least 37 records · Page 2Linked to original sources

Learning diffusion coefficients, kinetic parameters, and the number of underlying states from a multi-state diffusion process: robustness results and application to PDK1/PKC$α$, dynamics

Systems driven by Brownian motion are ubiquitous. A prevailing challenge is inferring, from data, the diffusion and kinetic parameters that describe these stochastic processes. In this work, we investigate a multi-state diffusion process that arises in the context of single particle tracking (SPT), wherein the motion of a particle is governed by a discrete set of diffusive states, and the tendency of the particle to switch between these states is modeled as a random process. We consider two models for this behavior: a mixture model and a hidden Markov model (HMM). For both, we adopt a Bayesian approach to sample the distributions of the underlying parameters and implement a Markov Chain Monte Carlo (MCMC) scheme to compute the posterior distributions, as in Das, Cairo, Coombs (2009). The primary contribution of this work is a study of the robustness of this method to infer parameters of a three-state HMM, and a discussion of the challenges and degeneracies that arise from considering three states. Finally, we investigate the problem of determining the number of diffusive states using model selection criteria. We present results from simulated data that demonstrate proof of concept, as well as apply our method to experimentally measured single molecule diffusion trajectories of monomeric phosphoinositide-dependent kinase-1 (PDK1) on a synthetic target membrane where it can associate with its binding partner protein kinase C alpha isoform (PKC$α$) to form a heterodimer detected by its significantly lower diffusivity. All matlab software is available here: \url{https://github.com/MathBioCU/SingleMolecule}

q-bio.QM↗

Learning Anisotropic Interaction Rules from Individual Trajectories in a Heterogeneous Cellular Population

Interacting particle system (IPS) models have proven to be highly successful for describing the spatial movement of organisms. However, it has proven challenging to infer the interaction rules directly from data. In the field of equation discovery, the Weak form Sparse Identification of Nonlinear Dynamics (WSINDy) methodology has been shown to be very computationally efficient for identifying the governing equations of complex systems, even in the presence of substantial noise. Motivated by the success of IPS models to describe the spatial movement of organisms, we develop WSINDy for second order IPSs to model the movement of communities of cells. Specifically, our approach learns the directional interaction rules that govern the dynamics of a heterogeneous population of migrating cells. Rather than aggregating cellular trajectory data into a single best-fit model, we learn the models for each individual cell. These models can then be efficiently classified according to the active classes of interactions present in the model. From these classifications, aggregated models are constructed hierarchically to simultaneously identify different species of cells present in the population and determine best-fit models for each species. We demonstrate the efficiency and proficiency of the method on several test scenarios, motivated by common cell migration experiments.

q-bio.QM↗

Asymptotic Analysis of a General Multi-Structured Population Model

Structured populations are ubiquitous across the biological sciences. Mathematical models of these populations allow us to understand how individual physiological traits drive the overall dynamics in aggregate. For example, linear age- or age-and-size-structured models establish constraints on individual growth under which the age- or age-and-size- distribution stabilizes, even as the population continues to grow without bound. However, individuals in real-world populations exhibit far more structural features than simply age and size. Notably, cyanobacteria contain carboxysome organelles which are central to carbon fixation and can be older (if inherited from parent cells) or younger (if created after division) than the enveloping cell. Motivated by a desire to understand how carboxysome age impacts growth at the colony level, we develop a multi-structured model which allows for an arbitrary (but finite) number of structure variables. We then derive and solve the renewal equation for cell division to obtain an asymptotic solution, and show that, under certain conditions, a stable structural distribution is reached.

math.AP↗

Online Weak-form Sparse Identification of Partial Differential Equations

This paper presents an online algorithm for identification of partial differential equations (PDEs) based on the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy). The algorithm is online in a sense that if performs the identification task by processing solution snapshots that arrive sequentially. The core of the method combines a weak-form discretization of candidate PDEs with an online proximal gradient descent approach to the sparse regression problem. In particular, we do not regularize the $\ell_0$-pseudo-norm, instead finding that directly applying its proximal operator (which corresponds to a hard thresholding) leads to efficient online system identification from noisy data. We demonstrate the success of the method on the Kuramoto-Sivashinsky equation, the nonlinear wave equation with time-varying wavespeed, and the linear wave equation, in one, two, and three spatial dimensions, respectively. In particular, our examples show that the method is capable of identifying and tracking systems with coefficients that vary abruptly in time, and offers a streaming alternative to problems in higher dimensions.

math.OC↗

Learning Mean-Field Equations from Particle Data Using WSINDy

We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic noise. In particular, we use concepts from mean-field theory of IPS in combination with the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) to provide a fast and reliable system identification scheme for recovering the governing stochastic differential equations for an IPS when the number of particles per experiment $N$ is on the order of several thousand and the number of experiments $M$ is less than 100. This is in contrast to existing work showing that system identification for $N$ less than 100 and $M$ on the order of several thousand is feasible using strong-form methods. We prove that under some standard regularity assumptions the scheme converges with rate $\mathcal{O}(N^{-1/2})$ in the ordinary least squares setting and we demonstrate the convergence rate numerically on several systems in one and two spatial dimensions. Our examples include a canonical problem from homogenization theory (as a first step towards learning coarse-grained models), the dynamics of an attractive-repulsive swarm, and the IPS description of the parabolic-elliptic Keller-Segel model for chemotaxis.

stat.ML↗

Analytical singular value decomposition for a class of stoichiometry matrices

We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction-diffusion system on a one dimensional domain. The domain has two subregions which share a single common boundary. Each of the subregions is further partitioned into a finite number of compartments. Chemical reactions can occur within a compartment, whereas diffusion is represented as movement between adjacent compartments. Inspired by biology, we study both 1) the case where the reactions on each side of the boundary are different and only certain species diffuse across the boundary as well as 2) the case with spatially homogenous reactions and diffusion. We write the stoichiometry matrix for these two classes of systems using a Kronecker product formulation. For the first scenario, we apply linear perturbation theory to derive an approximate singular value decomposition in the limit as diffusion becomes much faster than reactions. For the second scenario, we derive an exact analytical singular value decomposition for all relative diffusion and reaction time scales. By writing the stoichiometry matrix using Kronecker products, we show that the singular vectors and values can also be written concisely using Kronecker products. Ultimately, we find that the singular value decomposition of the reaction-diffusion stoichiometry matrix depends on the singular value decompositions of smaller matrices. These smaller matrices represent modified versions of the reaction-only stoichiometry matrices and the analytically known diffusion-only stoichiometry matrix. Our results provide a mathematical framework that can be used to study complex biochemical systems with metabolic compartments. MATLAB code for calculating the SVD equations is available at \url{www.github.com/MathBioCU/ReacDiffStoicSVD}.

q-bio.QM↗

Weak SINDy For Partial Differential Equations

Sparse Identification of Nonlinear Dynamics (SINDy) is a method of system discovery that has been shown to successfully recover governing dynamical systems from data (Brunton et al., PNAS, '16; Rudy et al., Sci. Adv. '17). Recently, several groups have independently discovered that the weak formulation provides orders of magnitude better robustness to noise. Here we extend our Weak SINDy (WSINDy) framework introduced in (arXiv:2005.04339) to the setting of partial differential equations (PDEs). The elimination of pointwise derivative approximations via the weak form enables effective machine-precision recovery of model coefficients from noise-free data (i.e. below the tolerance of the simulation scheme) as well as robust identification of PDEs in the large noise regime (with signal-to-noise ratio approaching one in many well-known cases). This is accomplished by discretizing a convolutional weak form of the PDE and exploiting separability of test functions for efficient model identification using the Fast Fourier Transform. The resulting WSINDy algorithm for PDEs has a worst-case computational complexity of $\mathcal{O}(N^{D+1}\log(N))$ for datasets with $N$ points in each of $D+1$ dimensions (i.e. $\mathcal{O}(\log(N))$ operations per datapoint). Furthermore, our Fourier-based implementation reveals a connection between robustness to noise and the spectra of test functions, which we utilize in an \textit{a priori} selection algorithm for test functions. Finally, we introduce a learning algorithm for the threshold in sequential-thresholding least-squares (STLS) that enables model identification from large libraries, and we utilize scale-invariance at the continuum level to identify PDEs from poorly-scaled datasets. We demonstrate WSINDy's robustness, speed and accuracy on several challenging PDEs.

math.NA↗

Competitive Exclusion in a DAE Model for Microbial Electrolysis Cells

Microbial electrolysis cells (MECs) employ electroactive bacteria to perform extracellular electron transfer, enabling hydrogen generation from biodegradable substrates. In previous work, we developed and analyzed a differential-algebraic equation (DAE) model for MECs. The model resembles a chemostat with ordinary differential equations (ODEs) for concentrations of substrate, microorganisms, and an extracellular mediator involved in electron transfer. There is also an algebraic constraint for electric current and hydrogen production. Our goal is to determine the outcome of competition between methanogenic archaea and electroactive bacteria, because only the latter contribute to electric current and resulting hydrogen production. We investigate asymptotic stability in two industrially relevant versions of the model. An important aspect of chemostats models is the principle of competitive exclusion -- only microbes which grow at the lowest substrate concentration will survive as $t\to\infty$. We show that if methanogens grow at the lowest substrate concentration, then the equilibrium corresponding to competitive exclusion by methanogens is globally asymptotically stable. The analogous result for electroactive bacteria is not necessarily true. We show that local asymptotic stability of exclusion by electroactive bacteria is not guaranteed, even in a simplified version of the model. In this case, even if electroactive bacteria can grow at the lowest substrate concentration, a few additional conditions are required to guarantee local asymptotic stability. We also provide numerical simulations supporting these arguments. Our results suggest operating conditions that are most conducive to success of electroactive bacteria and the resulting current and hydrogen production in MECs. This will help identify when methane production or electricity and hydrogen production are favored.

q-bio.PE↗

Weak SINDy: Galerkin-Based Data-Driven Model Selection

We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative approximations with linear transformations and a variance reduction technique. Our approach improves on the standard SINDy algorithm by orders of magnitude. We first show that in the noise-free regime, this so-called Weak SINDy (WSINDy) framework is capable of recovering the dynamic coefficients to very high accuracy, with the number of significant digits equal to the tolerance of the data simulation scheme. Next we show that the weak form naturally accounts for white noise by identifying the correct nonlinearities with coefficient error scaling favorably with the signal-to-noise ratio while significantly reducing the size of linear systems in the algorithm. In doing so, we combine the ease of implementation of the SINDy algorithm with the natural noise-reduction of integration to arrive at a more robust and user-friendly method of sparse recovery that correctly identifies systems in both small-noise and large-noise regimes.

math.NA↗

Boundedness of a class of discretized reaction-diffusion systems

Although the spatially continuous version of the reaction-diffusion equation has been well studied, in some instances a spatially-discretized representation provides a more realistic approximation of biological processes. Indeed, mathematically the discretized and continuous systems can lead to different predictions of biological dynamics. It is well known in the continuous case that the incorporation of diffusion can cause diffusion-driven blow-up with respect to the $L^{\infty}$ norm. However, this does not imply diffusion-driven blow-up will occur in the discretized version of the system. For example, in a continuous reaction-diffusion system with Dirichlet boundary conditions and nonnegative solutions, diffusion-driven blow up occurs even when the total species concentration is non-increasing. For systems that instead have homogeneous Neumann boundary conditions, it is currently unknown whether this deviation between the continuous and discretized system can occur. Therefore, it is worth examining the discretized system independently of the continuous system. Since no criteria exist for the boundedness of the discretized system, the focus of this paper is to determine sufficient conditions to guarantee the system with diffusion remains bounded for all time. We consider reaction-diffusion systems on a 1D domain with homogeneous Neumann boundary conditions and non-negative initial data and solutions. We define a Lyapunov-like function and show that its existence guarantees that the discretized reaction-diffusion system is bounded. These results are considered in the context of three example systems for which Lyapunov-like functions can and cannot be found.

math.DS↗

A Posteriori Error Analysis of Fluid-Stucture Interactions: Time Dependent Error

A posteriori error analysis is a technique to quantify the error in particular simulations of a numerical approximation method. In this article, we use such an approach to analyze how various error components propagate in certain moving boundary problems. We study quasi-steady state simulations where slowly moving boundaries remain in mechanical equilibrium with a surrounding fluid. Such problems can be numerically approximated with the Method of Regularized Stokelets(MRS), a popular method used for studying viscous fluid-structure interactions, especially in biological applications. Our approach to monitoring the regularization error of the MRS is novel, along with the derivation of linearized adjoint equations to the governing equations of the MRS with a elastic elements. Our main numerical results provide a clear illustration of how the error evolves over time in several MRS simulations.

math.NA↗

On the existence of non-trivial steady-state size-distributions for a class of flocculation equations

Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of floc size distribution in an aqueous environment. Our work provides a unified treatment for many size-structured models in the environmental, industrial, medical, and marine engineering literature. In particular, the mathematical model considered in this work accounts for basic biological phenomena in a population of microorganisms including growth, death, sedimentation, predation, surface erosion, renewal, fragmentation and aggregation. The central objective of this work is to prove existence of positive steady states of this generalized flocculation model. Using results from fixed point theory we derive conditions for the existence of continuous, non-trivial stationary solutions. We further develop a numerical scheme based on spectral collocation method to approximate these positive stationary solutions. We explore the stationary solutions of the model for various biologically relevant parameters and give valuable insights for the efficient removal of suspended particles.

math.DS↗

Sensitivity and Bifurcation Analysis of a DAE Model for a Microbial Electrolysis Cell

Microbial electrolysis cells (MECs) are a promising new technology for producing hydrogen cheaply, efficiently, and sustainably. However, to scale up this technology, we need a better understanding of the processes in the devices. In this effort, we present a differential-algebraic equation (DAE) model of a microbial electrolysis cell with an algebraic constraint on current. We then perform sensitivity and bifurcation analysis for the DAE system. The model can be applied either to batch-cycle MECs or to continuous-flow MECs. We conduct differential-algebraic sensitivity analysis after fitting simulations to current density data for a batch-cycle MEC. The sensitivity analysis suggests which parameters have the greatest influence on the current density at particular times during the experiment. In particular, growth and consumption parameters for exoelectrogenic bacteria have a strong effect prior to the peak current density. An alternative strategy to maximizing peak current density is maintaining a long term stable equilibrium with non-zero current density in a continuous-flow MEC. We characterize the minimum dilution rate required for a stable nonzero current equilibrium and demonstrate transcritical bifurcations in the dilution rate parameter that exchange stability between several curves of equilibria. Specifically, increasing the dilution rate transitions the system through three regimes where the stable equilibrium exhibits (i) competitive exclusion by methanogens, (ii) coexistence, and (iii) competitive exclusion by exolectrogens. Positive long term current production is only feasible in the final two regimes. These results suggest how to modify system parameters to increase peak current density in a batch-cycle MEC or to increase the long term current density equilibrium value in a continuous-flow MEC.

math.DS↗

A Point Process Model for Generating Biofilms with Realistic Microstructure and Rheology

Biofilms are communities of bacteria that exhibit a multitude of multiscale biomechanical behaviors. Recent experimental advances have lead to characterizations of these behaviors in terms of measurements of the viscoelastic moduli of biofilms grown in bioreactors and the fracture and fragmentation properties of biofilms. These properties are macroscale features of biofilms; however, a previous work by our group has shown that heterogeneous microscale features are critical in predicting biofilm rheology. In this paper we use tools from statistical physics to develop a generative statistical model of the positions of bacteria in biofilms. We show through simulation that the macroscopic mechanical properties of biofilms depend on the choice of microscale spatial model. Our key finding is that a biologically inspired model of the locations of bacteria in a biofilm is critical to the simulation of biofilms with realistic in silico mechanical properties and statistical characteristics.

q-bio.CB↗

A numerical framework for computing steady states of size-structured population models and their stability

Structured population models are a class of general evolution equations which are widely used in the study of biological systems. Many theoretical methods are available for establishing existence and stability of steady states of general evolution equations. However, except for very special cases, finding an analytical form of stationary solutions for evolution equations is a challenging task. In the present paper, we develop a numerical framework for computing approximations to stationary solutions of general evolution equations, which can also be used to produce existence and stability regions for steady states. In particular, we use the Trotter-Kato Theorem to approximate the infinitesimal generator of an evolution equation on a finite dimensional space, which in turn reduces the evolution equation into a system of ordinary differential equations. Consequently, we approximate and study the asymptotic behavior of stationary solutions. We illustrate the convergence of our numerical framework by applying it to a linear Sinko-Streifer structured population model for which the exact form of the steady state is known. To further illustrate the utility of our approach, we apply our framework to nonlinear population balance equation, which is an extension of well-known Smoluchowksi coagulation-fragmentation model to biological populations. We also demonstrate that our numerical framework can be used to gain insight about the theoretical stability of the stationary solutions of the evolution equations. Furthermore, the open source Python program that we have developed for our numerical simulations is freely available from our Github repository (github.com/MathBioCU).

math.AP↗

Inverse Problems for a Class of Conditional Probability Measure-Dependent Evolution Equations

We investigate the inverse problem of identifying a conditional probability measure in a measure-dependent dynamical system. We provide existence and well-posedness results and outline a discretization scheme for approximating a measure. For this scheme, we prove general method stability. The work is motivated by Partial Differential Equation (PDE) models of flocculation for which the shape of the post-fragmentation conditional probability measure greatly impacts the solution dynamics. To illustrate our methodology, we apply the theory to a particular PDE model that arises in the study of population dynamics for flocculating bacterial aggregates in suspension, and provide numerical evidence for the utility of the approach.

math.ST↗

Stability of steady states for a class of flocculation equations with growth and removal

Flocculation is the process whereby particles (i.e., flocs) in suspension reversibly combine and separate. The process is widespread in soft matter and aerosol physics as well as environmental science and engineering. We consider a general size-structured flocculation model, which describes the evolution of flocs in an aqueous environment. Our work provides a unified treatment for many size-structured models in the environmental, industrial, medical, and marine engineering literature. In particular, our model accounts for basic biological phenomena in a population of microorganisms including growth, death, sedimentation, predation, renewal, fragmentation and aggregation. Our central goal in this paper is to rigorously investigate the long-term behavior of this generalized flocculation model. Using results from fixed point theory we derive conditions for the existence of continuous, non-trivial stationary solutions. We further apply the principle of linearized stability and semigroup compactness arguments to provide sufficient conditions for local exponential stability of stationary solutions as well as sufficient conditions for instability. Abstract. The end results of this analytical development are relatively simple inequality-criteria which thus allows for the rapid evaluation of the existence and stability of a non-trivial stationary solution. To our knowledge, this work is the first to derive precise existence and stability criteria for such a generalized model. Lastly, we also provide an illustrating application of this criteria to several flocculation models.

math.AP↗

Variable Viscosity and Density Biofilm Simulations using an Immersed Boundary Method, Part II: Experimental Validation and the Heterogeneous Rheology-IBM

The goal of this work is to develop a numerical simulation that accurately captures the biomechanical response of bacterial biofilms and their associated extracellular matrix (ECM). In this, the second of a two-part effort, the primary focus is on formally presenting the heterogeneous rheology Immersed Boundary Method (hrIBM) and validating our model against experimental results. With this extension of the Immersed Bounadry Method (IBM), we use the techniques originally developed in Part I, (Hammond et al. (2014) ) to treat the biofilm as a viscoelastic fluid possessing variable rheological properties anchored to a set of moving locations (i.e., the bacteria locations). We validate our modeling approach from Part I by comparing dynamic moduli and compliance moduli computed from our model to data from mechanical characterization experiments on Staphylococcus epidermidis biofilms. The experimental setup is described in Pavlovsky et al. (2013) in which biofilms are grown and tested in a parallel plate rheometer. Matlab code used to produce results in this paper will be available at https://github.com/MathBioCU/BiofilmSim.

math.NA↗