SearcharxivSearch

arXiv subjects

Nikolas Tapia

Publications and source records attributed to Nikolas Tapia.

At least 19 recordsLinked to original sources

Orthogonal polynomials on path-space

We consider the orthogonalisation of the signature of a stochastic process as the analogue of orthogonal polynomials on path-space. Under an infinite radius of convergence assumption, we prove density of linear functions on the signature in $L^p$ functions on grouplike elements, making it possible to represent a square-integrable function on (rough) paths as an $L^2$-convergent series. By viewing the shuffle algebra as commutative polynomials on the free Lie algebra, we revisit much of the theory of classical orthogonal polynomials in several variables, such as the recurrence relation and Favard's theorem. Finally, we restrict our attention to the case of Brownian motion with and without drift, and prove that dimension-independent orthogonal signature exists with drift but not without. We end with numerical examples of how orthogonal signature polynomials of Brownian motion can be applied for the approximation of functions on paths sampled from the Wiener measure.

math.PR

Explicit and Effectively Symmetric Runge-Kutta Methods

Symmetry is a key property of numerical methods. The geometric properties of symmetric schemes make them an attractive option for integrating Hamiltonian systems, whilst their ability to exactly recover the initial condition without the need to store the entire solution trajectory makes them ideal for the efficient implementation of Neural ODEs. In this work, we present a Hopf algebraic approach to the study of symmetric B-series methods. We show that every B-series method can be written as the composition of a symmetric and "antisymmetric" component, and explore the structure of this decomposition for Runge-Kutta schemes. A major bottleneck of symmetric Runge-Kutta schemes is their implicit nature, which requires solving a nonlinear system at each step. By introducing a new set of order conditions which minimise the antisymmetric component of a scheme, we derive what we call Explicit and Effectively Symmetric (EES) schemes -- a new class of explicit Runge-Kutta schemes with near-symmetric properties. We present examples of second-order EES schemes and demonstrate that, despite their low order, these schemes readily outperform higher-order explicit schemes such as RK4 and RK5, and achieve results comparable to implicit symmetric schemes at a significantly lower computational cost.

math.NA

Perturbative renormalisation of the $\Phi^4_{4-\varepsilon}$ model via generalized Wick maps

We consider the perturbative renormalisation of the $\Phi^4_d$ model from Euclidean Quantum Field Theory for any, possibly non-integer dimension $d<4$. The so-called BPHZ renormalisation, named after Bogoliubov, Parasiuk, Hepp and Zimmermann, is usually encoded into extraction-contraction operations on Feynman diagrams, which have a complicated combinatorics. We show that the same procedure can be encoded in the much simpler algebra of polynomials in two unknowns $X$ and $Y$, which represent the fourth and second Wick power of the field. In this setting, renormalisation takes the form of a \lq\lq Wick map\rq\rq\ which maps monomials into Bell polynomials. The construction makes use of recent results by Bruned and Hou on multiindices, which are algebraic objects of intermediate complexity between Feynman diagrams and polynomials.

math.PR

An introduction to tensors for path signatures

We present a fit-for-purpose introduction to tensors and their operations. It is envisaged to help the reader become acquainted with its underpinning concepts for the study of path signatures. The text includes exercises, solutions and many intuitive explanations. The material discusses direct sums and tensor products as two possible operations that make the Cartesian product of vectors spaces a vector space. The difference lies in linear Vs. multilinear structures -- the latter being the suitable one to deal with path signatures. The presentation is offered to understand tensors in a deeper sense than just a multidimensional array. The text concludes with the prime example of an algebra in relation to path signatures: the 'tensor algebra'. This manuscript is the extended version (with two extra sections) of a chapter to appear in Open Access in a forthcoming Springer volume ``Signatures Methods in Finance: An Introduction with Computational Applications". The two additional sections here discuss the factoring of tensor product expressions to a minimal number of terms. This problem is relevant for the path signatures theory but not necessary for what is presented in the book. Tensor factorization is an elegant way of becoming familiar with the language of tensors and tensor products. A GitHub repository is attached.

math.HO

On expected signatures and signature cumulants in semimartingale models

The concept of signatures and expected signatures is vital in data science, especially for sequential data analysis. The signature transform, a Cartan type development, translates paths into high-dimensional feature vectors, capturing their intrinsic characteristics. Under natural conditions, the expectation of the signature determines the law of the signature, providing a statistical summary of the data distribution. This property facilitates robust modeling and inference in machine learning and stochastic processes. Building on previous work by the present authors [Unified signature cumulants and generalized Magnus expansions, FoM Sigma '22] we here revisit the actual computation of expected signatures, in a general semimartingale setting. Several new formulae are given. A log-transform of (expected) signatures leads to log-signatures (signature cumulants), offering a significant reduction in complexity.

stat.ML

A multiplicative surface signature through its Magnus expansion

In the last decade, the concept of path signature has achieved significant success in data science applications. It offers a powerful set of features that effectively capture and describe the characteristics of paths or sequential data. This is partly explained by the fact that the signature of a path can be computed in linear time, using a dynamic programming principle based on Chen's identity. The path signature can be viewed as a specific example of a product or time-/path-ordered integral. In other words, it represents a one-parameter object built on iterated integrals over a path. Defining a signature over surfaces requires considering iterated integrals over these surfaces, effectively introducing an additional parameter, resulting in a two-parameter signature. This extended signature is intrinsically connected to a non-commutative generalization of Stokes' theorem, which is fundamentally connected to the concept of crossed modules of groups. The latter provides a well-established framework in higher gauge theory, where crossed modules with feedback maps exhibiting non-trivial kernels, combined with multiparameter iterated integrals, play a pivotal role. Building on Kapranov's work, we explore the surface analog of the log-signature for paths by introducing a Magnus-type formula for the logarithm of the surface signature. This expression takes values in a free crossed module of Lie algebras, defined over a free Lie algebra. We furthermore prove a non-commutative sewing lemma applicable to the crossed module setting and give a definition of rough surface in the so-called Young-H\"older regularity regime along with a corresponding continuous extension theorem. This approach enables the analysis and computation of surface features that go beyond what can be expressed by computing line integrals along the boundary of a surface.

math.RA

Free generators and Hoffman's isomorphism for the two-parameter shuffle algebra

Signature transforms have recently been extended to data indexed by two and more parameters. With free Lyndon generators, ideas from $\mathbf{B}_\infty$-algebras and a novel two-parameter Hoffman exponential, we provide three classes of isomorphisms between the underlying two-parameter shuffle and quasi-shuffle algebras. In particular, we provide a Hopf algebraic connection to the (classical, one-parameter) shuffle algebra over the extended alphabet of connected matrix compositions.

math.RA

Branched It\^o formula and natural It\^o-Stratonovich isomorphism

Branched rough paths, defined as paths with values in the character group of the Connes-Kreimer Hopf algebra $\mathcal{H}_\mathrm{CK}$, constitute integration theories that may fail to satisfy the usual integration by parts identity. Using known results on the primitive elements of $\mathcal{H}_\mathrm{CK}$ we can view it as a commutative cofree Hopf algebra (i.e. a commutative $\mathbf{B}_\infty$-algebra) and thus write an explicit change-of-variable formula for solutions to rough differential equations. This formula restricts to the well-known It\^o formula in the very special case of semimartingales. In addition, we establish an isomorphism between $\mathcal{H}_\mathrm{CK}$ and the shuffle algebra over its primitives, which extends Hoffman's exponential for the quasi-shuffle algebra, and can therefore be viewed as a far-reaching generalisation of the usual It\^o-Stratonovich correction formula for semimartingales. Indeed, this can be stated as a characterisation of the algebra structure of any commutative $\mathbf{B}_\infty$-algebra. Compared to previous approaches, this transformation has the key property of being natural in the decorating vector space. We study the one-dimensional case more closely, by introducing the branched analogue of the Kailath-Segall polynomials and Dol\'eans-Dade exponential, and conclude with some examples of branched rough path lifts of a stochastic process which are not quasi-geometric.

math.PR

Shifted Substitution in Non-Commutative Multivariate Power Series with a View Toward Free Probability

We study a particular group law on formal power series in non-commuting variables induced by their interpretation as linear forms on a suitable graded connected word Hopf algebra. This group law is left-linear and is therefore associated to a pre-Lie structure on formal power series. We study these structures and show how they can be used to recast in a group theoretic form various identities and transformations on formal power series that have been central in the context of non-commutative probability theory, in particular in Voiculescu's theory of free probability.

math.PR

The geometry of controlled rough paths

We prove that the spaces of controlled (branched) rough paths of arbitrary order form a continuous field of Banach spaces. This structure has many similarities to an (infinite-dimensional) vector bundle and allows to define a topology on the total space, the collection of all controlled path spaces, which turns out to be Polish in the geometric case. The construction is intrinsic and based on a new approximation result for controlled rough paths. This framework turns well-known maps such as the rough integration map and the It\^o-Lyons map into continuous (structure preserving) mappings. Moreover, it is compatible with previous constructions of interest in the stability theory for rough integration.

math.PR

Stability of Deep Neural Networks via discrete rough paths

Using rough path techniques, we provide a priori estimates for the output of Deep Residual Neural Networks in terms of both the input data and the (trained) network weights. As trained network weights are typically very rough when seen as functions of the layer, we propose to derive stability bounds in terms of the total $p$-variation of trained weights for any $p\in[1,3]$. Unlike the $C^1$-theory underlying the neural ODE literature, our estimates remain bounded even in the limiting case of weights behaving like Brownian motions, as suggested in [arXiv:2105.12245]. Mathematically, we interpret residual neural network as solutions to (rough) difference equations, and analyse them based on recent results of discrete time signatures and rough path theory.

cs.LG

Unified Signature Cumulants and Generalized Magnus Expansions

The signature of a path can be described as its full non-commutative exponential. Following T. Lyons we regard its expectation, the expected signature, as path space analogue of the classical moment generating function. The logarithm thereof, taken in the tensor algebra, defines the signature cumulant. We establish a universal functional relation in a general semimartingale context. Our work exhibits the importance of Magnus expansions in the algorithmic problem of computing expected signature cumulants, and further offers a far-reaching generalization of recent results on characteristic exponents dubbed diamond and cumulant expansions; with motivation ranging from financial mathematics to statistical physics. From an affine process perspective, the functional relation may be interpreted as infinite-dimensional, non-commutative ("Hausdorff") variation of Riccati's equation. Many examples are given.

math.PR

The moving frame method for iterated-integrals: orthogonal invariants

Geometric features, robust to noise, of curves in Euclidean space are of great interest for various applications such as machine learning and image analysis. We apply the Fels-Olver's moving frame method (for geometric features) paired with the log-signature transform (for robust features) to construct a set of integral invariants under rigid motions for curves in $\mathbb{R}^d$ from the iterated-integral signature. In particular we show that one can algorithmically construct a set of invariants that characterize the equivalence class of the truncated iterated-integrals signature under orthogonal transformations which yields a characterization of a curve in $\mathbb{R}^d$ under rigid motions (and tree-like extensions) and an explicit method to compare curves up to these transformations.

math.DG

Generalized iterated-sums signatures

We explore the algebraic properties of a generalized version of the iterated-sums signature, inspired by previous work of F.~Kir\'aly and H.~Oberhauser. In particular, we show how to recover the character property of the associated linear map over the tensor algebra by considering a deformed quasi-shuffle product of words on the latter. We introduce three non-linear transformations on iterated-sums signatures, close in spirit to Machine Learning applications, and show some of their properties.

math.RA

Tropical time series, iterated-sums signatures and quasisymmetric functions

Aiming for a systematic feature-extraction from time series, we introduce the iterated-sums signature over arbitrary commutative semirings. The case of the tropical semiring is a central, and our motivating example. It leads to features of (real-valued) time series that are not easily available using existing signature-type objects. We demonstrate how the signature extracts chronological aspects of a time series, and that its calculation is possible in linear time. We identify quasisymmetric expressions over semirings as the appropriate framework for iterated-sums signatures over semiring-valued time series.

math.RA

Time-warping invariants of multidimensional time series

In data science, one is often confronted with a time series representing measurements of some quantity of interest. Usually, as a first step, features of the time series need to be extracted. These are numerical quantities that aim to succinctly describe the data and to dampen the influence of noise. In some applications, these features are also required to satisfy some invariance properties. In this paper, we concentrate on time-warping invariants. We show that these correspond to a certain family of iterated sums of the increments of the time series, known as quasisymmetric functions in the mathematics literature. We present these invariant features in an algebraic framework, and we develop some of their basic properties.

math.RA

The geometry of the space of branched Rough Paths

We construct an explicit transitive free action of a Banach space of Hölder functions on the space of branched rough paths, which yields in particular a bijection between theses two spaces. This endows the space of branched rough paths with the structure of a principal homogeneous space over a Banach space and allows to characterize its automorphisms. The construction is based on the Baker-Campbell-Hausdorff formula, on a constructive version of the Lyons-Victoir extension theorem and on the Hairer-Kelly map, which allows to describe branched rough paths in terms of anisotropic geometric rough paths.

math.PR