SearcharxivSearch

arXiv subjects

Athanasios N. Yannacopoulos

Publications and source records attributed to Athanasios N. Yannacopoulos.

18 recordsLinked to original sources

Learning Contractive Integral Operators with Fredholm Integral Neural Operators

We generalize the framework of Fredholm Neural Networks, to learn non-expansive integral operators arising in Fredholm Integral Equations (FIEs) of the second kind in arbitrary dimensions. We first present the proposed Fredholm Integral Neural Operators (FREDINOs), for FIEs and prove that they are universal approximators of linear and non-linear integral operators and corresponding solution operators. We furthermore prove that the learned operators are guaranteed to be contractive, thereby strictly satisfying the mathematical property required for the convergence of the fixed point scheme. Finally, we also demonstrate how FREDINOs can be used to learn the solution operator of non-linear elliptic PDEs, via a Boundary Integral Equation (BIE) formulation. We assess the proposed methodology numerically, via several benchmark problems: linear and non-linear FIEs in arbitrary dimensions, as well as a non-linear elliptic PDE in 2D. Built on tailored mathematical/numerical analysis theory, FREDINOs offer high-accuracy approximations and interpretable schemes, making them well suited for scientific machine learning/numerical analysis computations.

math.NA

HEATNETs: Explainable Random Feature Neural Networks for High-Dimensional Parabolic PDEs

We deal with the solution of the forward problem for high-dimensional parabolic PDEs with random feature (projection) neural networks (RFNNs). We first prove that there exists a single-hidden layer neural network with randomized heat-kernels arising from the fundamental solution (Green's functions) of the heat operator, that we call HEATNET, that provides an unbiased universal approximator to the solution of parabolic PDEs in arbitrary (high) dimensions, with the rate of convergence being analogous to the ${O}(N^{-1/2})$, where $N$ is the size of HEATNET. Thus, HEATNETs are explainable schemes, based on the analytical framework of parabolic PDEs, exploiting insights from physics-informed neural networks aided by numerical and functional analysis, and the structure of the corresponding solution operators. Importantly, we show how HEATNETs can be scaled up for the efficient numerical solution of arbitrary high-dimensional parabolic PDEs using suitable transformations and importance Monte Carlo sampling of the integral representation of the solution, in order to deal with the singularities of the heat kernel around the collocation points. We evaluate the performance of HEATNETs through benchmark linear parabolic problems up to 2,000 dimensions. We show that HEATNETs result in remarkable accuracy with the order of the approximation error ranging from $1.0E-05$ to $1.0E-07$ for problems up to 500 dimensions, and of the order of $1.0E-04$ to $1.0E-03$ for 1,000 to 2,000 dimensions, with a relatively low number (up to 15,000) of features.

math.NA

Barycentric model aggregation in the Wasserstein space of distributions and a variational approach to consistency

We study the problem of model aggregation within the Wasserstein space for probability measures on the real line. Given a fixed finite collection of candidate probability models, we consider the associated class of Wasserstein barycenters and develop a data-driven calibration framework in which the aggregation weights are statistically learned from empirical information associated with a target distribution. From a variational perspective based on $\Gamma$-convergence, we establish consistency of the resulting aggregation scheme, showing that empirical minimizers converge to the minimizers of the actual problem, along with the associated barycentric estimators, under mild conditions. The performance of the proposed method is evaluated through synthetic experiments and illustrated on a real dataset from a temperature monitoring network of sensors.

stat.ME

Fredholm Neural Networks for inverse problems in elliptic PDEs

Building on our previous work on Fredholm Neural Networks (Fredholm NNs/ FNNs) for solving integral equations, we extend the framework to inverse problems for linear and nonlinear elliptic partial differential equations. The proposed scheme consists of a custom-designed deep neural network (DNN) in which the number of layers, weights, biases and hyperparameters are computed in an explainable manner based on a fixed-point scheme, and we therefore refer to this as the Potential Fredholm Neural Network (PFNN). We first build the PFNN as a method for solving the forward problem, showing that this approach ensures both a high accuracy and explainability, achieving small errors in the interior of the domain, and near machine-precision on the boundary. We then use this approach to solve inverse problems for elliptic PDEs, and provide a rigorous proof for the consistency of the scheme and error bounds for both the interior and boundary of the domain, tied directly to the architecture of the PFNN. In particular, we show that these error bounds depend on the approximation of the boundary function and the integral discretization scheme, both of which directly correspond to components of the Fredholm NN architecture. In this way, we construct an explainable scheme that provides accurate solutions to the inverse problems, whilst still explicitly respecting the boundary conditions, due to the architecture of the PFNN. We assess the performance of the proposed scheme for linear and semi-linear elliptic PDEs in two and three dimensions.

math.NA

Linear Stability Analysis of Physics-Informed Random Projection Neural Networks for ODEs

We present a linear stability analysis of physics-informed random projection neural networks (PI-RPNNs), for the numerical solution of {the initial value problem (IVP)} of (stiff) ODEs. We begin by proving that PI-RPNNs are uniform approximators of the solution to ODEs. We then provide a constructive proof demonstrating that PI-RPNNs offer consistent and asymptotically stable numerical schemes, thus convergent schemes. In particular, we prove that multi-collocation PI-RPNNs guarantee asymptotic stability. Our theoretical results are illustrated via numerical solutions of benchmark examples including indicative comparisons with the backward Euler method, the midpoint method, the trapezoidal rule, the 2-stage Gauss scheme, and the 2- and 3-stage Radau schemes.

math.NA

Fredholm Neural Networks

Within the family of explainable machine-learning, we present Fredholm neural networks (Fredholm NNs): deep neural networks (DNNs) architectures motivated by fixed-point iteration schemes for the solution of linear and nonlinear Fredholm integral equations (FIEs) of the second kind. We also show how the proposed framework can be used for the solution of inverse problems. Applications of FIEs include the solution of ordinary, as well as partial differential equations (ODEs, PDEs) and many more. We first prove that Fredholm NNs provide accurate solutions. We then provide insight into the values of the hyperparameters and trainable/explainable weights and biases of the DNN, by directly connecting their values to the underlying mathematical theory. For our illustrations, we use Fredholm NNs to solve both linear and nonlinear problems, including elliptic PDEs and boundary value problems. We show that the proposed scheme achieves significant numerical approximation accuracy across both the domain and boundary. The proposed methodology provides insight into the connection between neural networks and classical numerical methods, and we posit that it can have applications in fields such as Uncertainty Quantification (UQ) and explainable artificial intelligence (XAI). Thus, we believe that it will trigger further advances in the intersection between scientific machine learning and numerical analysis.

math.NA

RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators

Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space of parameters and hyperparameters. This fact, along with the requirement of substantial computational resources, poses a barrier to achieving high numerical accuracy. Here, inpsired by DeepONets and to address the above challenges, we present Random Projection-based Operator Networks (RandONets): shallow networks with random projections that learn linear and nonlinear operators. The implementation of RandONets involves: (a) incorporating random bases, thus enabling the use of shallow neural networks with a single hidden layer, where the only unknowns are the output weights of the network's weighted inner product; this reduces dramatically the dimensionality of the parameter space; and, based on this, (b) using established least-squares solvers (e.g., Tikhonov regularization and preconditioned QR decomposition) that offer superior numerical approximation properties compared to other optimization techniques used in deep-learning. In this work, we prove the universal approximation accuracy of RandONets for approximating nonlinear operators and demonstrate their efficiency in approximating linear nonlinear evolution operators (right-hand-sides (RHS)) with a focus on PDEs. We show, that for this particular task, RandONets outperform, both in terms of numerical approximation accuracy and computational cost, the ``vanilla" DeepOnets.

cs.LG

Probabilistic Scenario-Based Assessment of National Food Security Risks with Application to Egypt and Ethiopia

This study presents a novel approach to assessing food security risks at the national level, employing a probabilistic scenario-based framework that integrates both Shared Socioeconomic Pathways (SSP) and Representative Concentration Pathways (RCP). This innovative method allows each scenario, encompassing socio-economic and climate factors, to be treated as a model capable of generating diverse trajectories. This approach offers a more dynamic understanding of food security risks under varying future conditions. The paper details the methodologies employed, showcasing their applicability through a focused analysis of food security challenges in Egypt and Ethiopia, and underscores the importance of considering a spectrum of socio-economic and climatic factors in national food security assessments.

econ.EM

Consensus group decision making under model uncertainty with a view towards environmental policy making

In this paper we propose a consensus group decision making scheme under model uncertainty consisting of an iterative two-stage procedure and based on the concept of Fréchet barycenter. Each step consists of two stages: the agents first update their position in the opinion metric space by a local barycenter characterized by the agents' immediate interactions and then a moderator makes a proposal in terms of a global barycenter, checking for consensus at each step. In cases of large heterogeneous groups the procedure can be complemented by an auxiliary initial homogenization step, consisting of a clustering procedure in opinion space, leading to large homogeneous groups for which the aforementioned procedure will be applied. The scheme is illustrated in examples motivated from environmental economics.

cs.MA

Modelling of functional profiles and explainable shape shifts detection: An approach combining the notion of the Fréchet mean with the shape invariant model

A modelling framework suitable for detecting shape shifts in functional profiles combining the notion of Fréchet mean and the concept of deformation models is developed and proposed. The generalized mean sense offered by the Fréchet mean notion is employed to capture the typical pattern of the profiles under study, while the concept of deformation models, and in particular of the shape invariant model, allows for interpretable parameterizations of profile's deviations from the typical shape. EWMA-type control charts compatible with the functional nature of data and the employed deformation model are built and proposed, exploiting certain shape characteristics of the profiles under study with respect to the generalized mean sense, allowing for the identification of potential shifts concerning the shape and/or the deformation process. Potential shifts in the shape deformation process, are further distinguished to significant shifts with respect to amplitude and/or the phase of the profile under study. The proposed modelling and shift detection framework is implemented to a real world case study, where daily concentration profiles concerning air pollutants from an area in the city of Athens are modelled, while profiles indicating hazardous concentration levels are successfully identified in most of the cases.

stat.ME

Probability of Default modelling with Lévy-driven Ornstein-Uhlenbeck processes and applications in credit risk under the IFRS 9

In this paper we develop a framework for estimating Probability of Default (PD) based on stochastic models governing an appropriate asset value processes. In particular, we build upon a Lévy-driven Ornstein-Uhlenbeck process and consider a generalized model that incorporates multiple latent variables affecting the evolution of the process. We obtain an Integral Equation (IE) formulation for the corresponding PD as a function of the initial position of the asset value process and the time until maturity, from which we then prove that the PD function satisfies an appropriate Partial Integro-Differential Equation (PIDE). These representations allow us to show that appropriate weak (viscosity) as well as strong solutions exist, and develop subsequent numerical schemes for the estimation of the PD function. Such a framework is necessary under the newly introduced International Financial Reporting Standards (IFRS) 9 regulation, which has imposed further requirements on the sophistication and rigor underlying credit modelling methodologies. We consider special cases of the generalized model that can be used for applications to credit risk modelling and provide examples specific to provisioning under IFRS 9, and more.

q-fin.RM

On the impact of noise on quennching for a nonlocal diffusion model driven by a mixture of Brownian and fractional Brownian motions

In this paper, we study a stochastic parabolic problem involving a nonlocal diffusion operator associated with nonlocal Robin-type boundary conditions. The stochastic dynamics under consideration are driven by a mixture of a classical Brownian and a fractional Brownian motions with Hurst index $H\in(\frac{1}{2}, 1).$ We first establish local in existence result of the considered model and then explore conditions under which the resulting SPDE exhibits finite-time quenching. Using the probability distribution of perpetual integral functional of Brownian motion as well as tail estimates of fractional Brownian motion we provide analytic estimates for certain statistics of interest, such as quenching times and the corresponding quenching probabilities. The existence of global in time solutions is also investigated and as a consequence a lower estimate of the quenching time is also derived. Our analytical results demonstrate the non-trivial impact of the considered noise on the dynamics of the system. Next, a connection of a special case of the examined model is drawn in the context of MEMS technology. Finally, a numerical investigation of the considered model for a fractional Laplacian diffusion and Dirichlet-type boundary conditions is delivered.

math.PR

An optimal control problem with state constraints in a spatio-temporal economic growth model on networks

We introduce a spatial economic growth model where space is described as a network of interconnected geographic locations and we study a corresponding finite-dimensional optimal control problem on a graph with state constraints. Economic growth models on networks are motivated by the nature of spatial economic data, which naturally possess a graph-like structure: this fact makes these models well-suited for numerical implementation and calibration. The network setting is different from the one adopted in the related literature, where space is modeled as a subset of a Euclidean space, which gives rise to infinite dimensional optimal control problems. After introducing the model and the related control problem, we prove existence and uniqueness of an optimal control and a regularity result for the value function, which sets up the basis for a deeper study of the optimal strategies. Then, we focus on specific cases where it is possible to find, under suitable assumptions, an explicit solution of the control problem. Finally, we discuss the cases of networks of two and three geographic locations.

math.OC

Convex Risk Measures for the Aggregation of Multiple Information Sources and Applications in Insurance

We propose a novel class of convex risk measures, based on the concept of the Fréchet mean, designed in order to handle uncertainty which arises from multiple information sources regarding the risk factors of interest. The proposed risk measures robustly characterize the exposure of the firm, by filtering out appropriately the partial information available in individual sources into an aggregate model for the risk factors of interest. Importantly, the proposed risks can be expressed in closed analytic forms allowing for interesting qualitative interpretations as well as comparative statics and thus facilitate their use in the everyday risk management process of the insurance firms. The potential use of the proposed risk measures in insurance is illustrated by two concrete applications, capital risk allocation and premia calculation under uncertainty.

q-fin.RM

How do future expectations affect the financial sector? Expectations modeling, infinite horizon (controlled) random FBSDEs and stochastic viscosity solutions

In this paper we study a class of infinite horizon fully coupled forward-backward stochastic differential equations (FBSDEs), that are stimulated by various continuous time future expectations models with random coefficients. Under standard Lipschitz and monotonicity conditions, and by means of the contraction mapping principle, we establish existence, uniqueness, a comparison property and dependence on a parameter of adapted solutions. Making further the connection with infinite horizon quasilinear backward stochastic partial differential equations (BSPDEs) via a generalization of the well known four-step-scheme, we are led to the notion of stationary stochastic viscosity solutions. A stochastic maximum principle for the optimal control problem of such FBSDEs is also provided as an application to this framework.

math.PR

On contingent claims pricing in incomplete markets: A risk sharing approach

In an incomplete market setting, we consider two financial agents, who wish to price and trade a non-replicable contingent claim. Assuming that the agents are utility maximizers, we propose a transaction price which is a result of the minimization of a convex combination of their utility differences. We call this price the risk sharing price, we prove its existence for a large family of utility functions and we state some of its properties. As an example, we analyze extensively the case where both agents report exponential utility.

q-fin.CP

Asymptotic Behavior of Solutions of Complex Discrete Evolution Equations: The Discrete Ginzburg-Landau Equation

We study the asymptotic behavior of complex discrete evolution equations of Ginzburg- Landau type. Depending on the nonlinearity and the data of the problem, we find different dynamical behavior ranging from global existence of solutions and global attractors, to blow up in finite time. We provide estimates for the blow up time, depending not only on the initial data but also on the size of the lattice. Some of the theoretical results, are tested by numerical simulations.

math.CA

Global Existence and Compact Attractors for the Discrete Nonlinear Schrödinger equation

We study the asymptotic behavior of solutions of discrete nonlinear Schrödinger-type (DNLS) equations. For a conservative system, we consider the global in time solvability and the question of existence of standing wave solutions. Similarities and differences with the continuous counterpart (NLS-partial differential equation) are pointed out. For a dissipative system we prove existence of a global attractor and its stability under finite dimensional approximations. Similar questions are treated in a weighted phase space. Finally, we propose possible extensions for various types of DNLS equations.

math.CA