arXiv subjects

Mamikon Gulian

Publications and source records attributed to Mamikon Gulian.

16 recordsLinked to original sources

arXiv2023

Solving High-Dimensional Inverse Problems with Auxiliary Uncertainty via Operator Learning with Limited Data

In complex large-scale systems such as climate, important effects are caused by a combination of confounding processes that are not fully observable. The identification of sources from observations of system state is vital for attribution and prediction, which inform critical policy decisions. The difficulty of these types of inverse problems lies in the inability to isolate sources and the cost of simulating computational models. Surrogate models may enable the many-query algorithms required for source identification, but data challenges arise from high dimensionality of the state and source, limited ensembles of costly model simulations to train a surrogate model, and few and potentially noisy state observations for inversion due to measurement limitations. The influence of auxiliary processes adds an additional layer of uncertainty that further confounds source identification. We introduce a framework based on (1) calibrating deep neural network surrogates to the flow maps provided by an ensemble of simulations obtained by varying sources, and (2) using these surrogates in a Bayesian framework to identify sources from observations via optimization. Focusing on an atmospheric dispersion exemplar, we find that the expressive and computationally efficient nature of the deep neural network operator surrogates in appropriately reduced dimension allows for source identification with uncertainty quantification using limited data. Introducing a variable wind field as an auxiliary process, we find that a Bayesian approximation error approach is essential for reliable source inversion when uncertainty due to wind stresses the algorithm.

stat.ML↗

arXiv2022

Error-in-variables modelling for operator learning

Deep operator learning has emerged as a promising tool for reduced-order modelling and PDE model discovery. Leveraging the expressive power of deep neural networks, especially in high dimensions, such methods learn the mapping between functional state variables. While proposed methods have assumed noise only in the dependent variables, experimental and numerical data for operator learning typically exhibit noise in the independent variables as well, since both variables represent signals that are subject to measurement error. In regression on scalar data, failure to account for noisy independent variables can lead to biased parameter estimates. With noisy independent variables, linear models fitted via ordinary least squares (OLS) will show attenuation bias, wherein the slope will be underestimated. In this work, we derive an analogue of attenuation bias for linear operator regression with white noise in both the independent and dependent variables. In the nonlinear setting, we computationally demonstrate underprediction of the action of the Burgers operator in the presence of noise in the independent variable. We propose error-in-variables (EiV) models for two operator regression methods, MOR-Physics and DeepONet, and demonstrate that these new models reduce bias in the presence of noisy independent variables for a variety of operator learning problems. Considering the Burgers operator in 1D and 2D, we demonstrate that EiV operator learning robustly recovers operators in high-noise regimes that defeat OLS operator learning. We also introduce an EiV model for time-evolving PDE discovery and show that OLS and EiV perform similarly in learning the Kuramoto-Sivashinsky evolution operator from corrupted data, suggesting that the effect of bias in OLS operator learning depends on the regularity of the target operator.

cs.LG↗

arXiv2021

Connections between nonlocal operators: from vector calculus identities to a fractional Helmholtz decomposition

Nonlocal vector calculus, which is based on the nonlocal forms of gradient, divergence, and Laplace operators in multiple dimensions, has shown promising applications in fields such as hydrology, mechanics, and image processing. In this work, we study the analytical underpinnings of these operators. We rigorously treat compositions of nonlocal operators, prove nonlocal vector calculus identities, and connect weighted and unweighted variational frameworks. We combine these results to obtain a weighted fractional Helmholtz decomposition which is valid for sufficiently smooth vector fields. Our approach identifies the function spaces in which the stated identities and decompositions hold, providing a rigorous foundation to the nonlocal vector calculus identities that can serve as tools for nonlocal modeling in higher dimensions.

math.AP↗

arXiv2021

Fractional Modeling in Action: A Survey of Nonlocal Models for Subsurface Transport, Turbulent Flows, and Anomalous Materials

Modeling of phenomena such as anomalous transport via fractional-order differential equations has been established as an effective alternative to partial differential equations, due to the inherent ability to describe large-scale behavior with greater efficiency than fully-resolved classical models. In this review article, we first provide a broad overview of fractional-order derivatives with a clear emphasis on the stochastic processes that underlie their use. We then survey three exemplary application areas - subsurface transport, turbulence, and anomalous materials - in which fractional-order differential equations provide accurate and predictive models. For each area, we report on the evidence of anomalous behavior that justifies the use of fractional-order models, and survey both foundational models as well as more expressive state-of-the-art models. We also propose avenues for future research, including more advanced and physically sound models, as well as tools for calibration and discovery of fractional-order models.

math.AP↗

arXiv2021

Towards a Unified Theory of Fractional and Nonlocal Vector Calculus

Nonlocal and fractional-order models capture effects that classical partial differential equations cannot describe; for this reason, they are suitable for a broad class of engineering and scientific applications that feature multiscale or anomalous behavior. This has driven a desire for a vector calculus that includes nonlocal and fractional gradient, divergence and Laplacian type operators, as well as tools such as Green's identities, to model subsurface transport, turbulence, and conservation laws. In the literature, several independent definitions and theories of nonlocal and fractional vector calculus have been put forward. Some have been studied rigorously and in depth, while others have been introduced ad-hoc for specific applications. The goal of this work is to provide foundations for a unified vector calculus by (1) consolidating fractional vector calculus as a special case of nonlocal vector calculus, (2) relating unweighted and weighted Laplacian operators by introducing an equivalence kernel, and (3) proving a form of Green's identity to unify the corresponding variational frameworks for the resulting nonlocal volume-constrained problems. The proposed framework goes beyond the analysis of nonlocal equations by supporting new model discovery, establishing theory and interpretation for a broad class of operators, and providing useful analogues of standard tools from the classical vector calculus.

math.AP↗

arXiv2021

Probabilistic partition of unity networks: clustering based deep approximation

Partition of unity networks (POU-Nets) have been shown capable of realizing algebraic convergence rates for regression and solution of PDEs, but require empirical tuning of training parameters. We enrich POU-Nets with a Gaussian noise model to obtain a probabilistic generalization amenable to gradient-based minimization of a maximum likelihood loss. The resulting architecture provides spatial representations of both noiseless and noisy data as Gaussian mixtures with closed form expressions for variance which provides an estimator of local error. The training process yields remarkably sharp partitions of input space based upon correlation of function values. This classification of training points is amenable to a hierarchical refinement strategy that significantly improves the localization of the regression, allowing for higher-order polynomial approximation to be utilized. The framework scales more favorably to large data sets as compared to Gaussian process regression and allows for spatially varying uncertainty, leveraging the expressive power of deep neural networks while bypassing expensive training associated with other probabilistic deep learning methods. Compared to standard deep neural networks, the framework demonstrates hp-convergence without the use of regularizers to tune the localization of partitions. We provide benchmarks quantifying performance in high/low-dimensions, demonstrating that convergence rates depend only on the latent dimension of data within high-dimensional space. Finally, we introduce a new open-source data set of PDE-based simulations of a semiconductor device and perform unsupervised extraction of a physically interpretable reduced-order basis.

cs.LG↗

arXiv2021

Distribution and pressure of active Lévy swimmers under confinement

Many active matter systems are known to perform Lévy walks during migration or foraging. Such superdiffusive transport indicates long-range correlated dynamics. These behavior patterns have been observed for microswimmers such as bacteria in microfluidic experiments, where Gaussian noise assumptions are insufficient to explain the data. We introduce \textit{active Lévy swimmers} to model such behavior. The focus is on ideal swimmers that only interact with the walls but not with each other, which reduces to the classical Lévy walk model but now under confinement. We study the density distribution in the channel and force exerted on the walls by the Lévy swimmers, where the boundaries require proper explicit treatment. We analyze stronger confinement via a set of coupled kinetics equations and the swimmers' stochastic trajectories. Previous literature demonstrated that power-law scaling in a multiscale analysis in free space results in a fractional diffusion equation. We show that in a channel, in the weak confinement limit active Lévy swimmers are governed by a modified Riesz fractional derivative. Leveraging recent results on fractional fluxes, we derive steady state solutions for the bulk density distribution of active Lévy swimmers in a channel, and demonstrate that these solutions agree well with particle simulations. The profiles are non-uniform over the entire domain, in contrast to constant-in-the-bulk profiles of active Brownian and run-and-tumble particles. Our theory provides a mathematical framework for Lévy walks under confinement with sliding no-flux boundary conditions and provides a foundation for studies of interacting active Lévy swimmers.

cond-mat.soft↗

arXiv2021

Analysis of Anisotropic Nonlocal Diffusion Models: Well-posedness of Fractional Problems for Anomalous Transport

We analyze the well-posedness of an anisotropic, nonlocal diffusion equation. Establishing an equivalence between weighted and unweighted anisotropic nonlocal diffusion operators in the vein of unified nonlocal vector calculus, we apply our analysis to a class of fractional-order operators and present rigorous estimates for the solution of the corresponding anisotropic anomalous diffusion equation. Furthermore, we extend our analysis to the anisotropic diffusion-advection equation and prove well-posedness for fractional orders s in [0.5,1). We also present an application of the advection-diffusion equation to anomalous transport of solutes.

math.AP↗

arXiv2021

A Survey of Constrained Gaussian Process Regression: Approaches and Implementation Challenges

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a priori information within Gaussian process regression to supplement limited data and regularize the behavior of the model. We provide an overview and survey of several classes of Gaussian process constraints, including positivity or bound constraints, monotonicity and convexity constraints, differential equation constraints provided by linear PDEs, and boundary condition constraints. We compare the strategies behind each approach as well as the differences in implementation, concluding with a discussion of the computational challenges introduced by constraints.

cs.LG↗

arXiv2020

Gaussian Process Regression constrained by Boundary Value Problems

We develop a framework for Gaussian processes regression constrained by boundary value problems. The framework may be applied to infer the solution of a well-posed boundary value problem with a known second-order differential operator and boundary conditions, but for which only scattered observations of the source term are available. Scattered observations of the solution may also be used in the regression. The framework combines co-kriging with the linear transformation of a Gaussian process together with the use of kernels given by spectral expansions in eigenfunctions of the boundary value problem. Thus, it benefits from a reduced-rank property of covariance matrices. We demonstrate that the resulting framework yields more accurate and stable solution inference as compared to physics-informed Gaussian process regression without boundary condition constraints.

cs.LG↗

arXiv2020

Data-driven learning of robust nonlocal physics from high-fidelity synthetic data

A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. In this work we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting provably robust data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity. Our scheme allows extraction of provably invertible nonlocal models whose kernels may be partially negative. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints and ensure that models are robust, even in small-data regimes. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.

math.OC↗

arXiv2019

What Is the Fractional Laplacian?

The fractional Laplacian in R^d has multiple equivalent characterizations. Moreover, in bounded domains, boundary conditions must be incorporated in these characterizations in mathematically distinct ways, and there is currently no consensus in the literature as to which definition of the fractional Laplacian in bounded domains is most appropriate for a given application. The Riesz (or integral) definition, for example, admits a nonlocal boundary condition, where the value of a function u(x) must be prescribed on the entire exterior of the domain in order to compute its fractional Laplacian. In contrast, the spectral definition requires only the standard local boundary condition. These differences, among others, lead us to ask the question: "What is the fractional Laplacian?" We compare several commonly used definitions of the fractional Laplacian (the Riesz, spectral, directional, and horizon-based nonlocal definitions), and we use a joint theoretical and computational approach to examining their different characteristics by studying solutions of related fractional Poisson equations formulated on bounded domains. In this work, we provide new numerical methods as well as a self-contained discussion of state-of-the-art methods for discretizing the fractional Laplacian, and we present new results on the differences in features, regularity, and boundary behaviors of solutions to equations posed with these different definitions. We present stochastic interpretations and demonstrate the equivalence between some recent formulations. Through our efforts, we aim to further engage the research community in open problems and assist practitioners in identifying the most appropriate definition and computational approach to use for their mathematical models in addressing anomalous transport in diverse applications.

math.NA↗

arXiv2019

Machine Learning of Space-Fractional Differential Equations

Data-driven discovery of "hidden physics" -- i.e., machine learning of differential equation models underlying observed data -- has recently been approached by embedding the discovery problem into a Gaussian Process regression of spatial data, treating and discovering unknown equation parameters as hyperparameters of a modified "physics informed" Gaussian Process kernel. This kernel includes the parametrized differential operators applied to a prior covariance kernel. We extend this framework to linear space-fractional differential equations. The methodology is compatible with a wide variety of fractional operators in $\mathbb{R}^d$ and stationary covariance kernels, including the Matern class, and can optimize the Matern parameter during training. We provide a user-friendly and feasible way to perform fractional derivatives of kernels, via a unified set of d-dimensional Fourier integral formulas amenable to generalized Gauss-Laguerre quadrature. The implementation of fractional derivatives has several benefits. First, it allows for discovering fractional-order PDEs for systems characterized by heavy tails or anomalous diffusion, bypassing the analytical difficulty of fractional calculus. Data sets exhibiting such features are of increasing prevalence in physical and financial domains. Second, a single fractional-order archetype allows for a derivative of arbitrary order to be learned, with the order itself being a parameter in the regression. This is advantageous even when used for discovering integer-order equations; the user is not required to assume a "dictionary" of derivatives of various orders, and directly controls the parsimony of the models being discovered. We illustrate on several examples, including fractional-order interpolation of advection-diffusion and modeling relative stock performance in the S&P 500 with alpha-stable motion via a fractional diffusion equation.

cs.LG↗

arXiv2018

Stochastic Solution of Elliptic and Parabolic Boundary Value Problems for the Spectral Fractional Laplacian

We prove and implement stochastic solution (or Feynman-Kac) formulas for boundary value problems involving the spectral fractional Laplacian with nonzero Dirichlet boundary condition. The main tools used in the proofs are the abstract Cauchy problem for Feller semigroups together with Balakrishnan's theory of fractional powers. We show the the spectral fractional Laplacian with nonzero Dirichlet boundary conditions is the generator of an appropriate Feller semigroup for subordinate stopped Brownian motion, and obtain a stochastic solution formula for the fractional heat equation in a bounded domain. We then obtain precise regularity and steady-state convergence properties of the parabolic problem using the eigenfunction expansion of the classical solution, which leads to estimates for the survival probability of subordinate stopped Brownian motion. These results allow us to take the long-time limit in the parabolic formula to establish a stochastic solution formula for the Dirichlet boundary value problem. These stochastic solution formulas for the spectral fractional Laplacian with nonzero boundary conditions are novel, and allow for efficient, embarrassingly parallel local solution of the above boundary value problems. We discuss the discretization of these formulas, and verify them in dimensions two and three with benchmark examples. We study the effect of the number of path samples and the time step size for path discretization on the accuracy of the solution.

math.NA↗

arXiv2017

Fractional Path Integral Monte Carlo

Fractional derivatives are nonlocal differential operators of real order that often appear in models of anomalous diffusion and a variety of nonlocal phenomena. Recently, a version of the Schrödinger Equation containing a fractional Laplacian has been proposed. In this work, we develop a Fractional Path Integral Monte Carlo algorithm that can be used to study the finite temperature behavior of the time-independent Fractional Schrödinger Equation for a variety of potentials. In so doing, we derive an analytic form for the finite temperature fractional free particle density matrix and demonstrate how it can be sampled to acquire new sets of particle positions. We employ this algorithm to simulate both the free particle and $^{4}$He (Aziz) Hamiltonians. We find that the fractional Laplacian strongly encourages particle delocalization, even in the presence of interactions, suggesting that fractional Hamiltonians may manifest atypical forms of condensation. Our work opens the door to studying fractional Hamiltonians with arbitrarily complex potentials that escape analytical solutions.

cond-mat.stat-mech↗

arXiv2016

Free Boundary Minimal Surfaces in the Unit Ball With Low Cohomogeneity

We study free boundary minimal surfaces in the unit ball of low cohomogeneity. For each pair of positive integers $(m,n)$ such that $m, n >1$ and $m+n\geq 8$, we construct a free boundary minimal surface $Σ_{m, n} \subset B^{m+n}$(1) invariant under $O(m)\times O(n)$. When $m+n<8$, an instability of the resulting equation allows us to find an infinite family $\{Σ_{m,n, k}\}_{k\in \mathbb{N}}$ of such surfaces. In particular, $\{Σ_{2, 2, k}\}_{k\in \mathbb{N}}$ is a family of solid tori which converges to the cone over the Clifford Torus as $k$ goes to infinity. These examples indicate that a smooth compactness theorem for Free Boundary Minimal Surfaces due to Fraser and Li does not generally extend to higher dimensions. For each $n\geq 3$, we prove there is a unique nonplanar $SO(n)$-invariant free boundary minimal surface (a "catenoid") $Σ_n \subset B^n(1)$. These surfaces generalize the "critical catenoid" in $B^3(1)$ studied by Fraser and Schoen.

math.DG↗