SearcharxivSearch

arXiv subjects

Thomas Cass

Publications and source records attributed to Thomas Cass.

At least 19 recordsLinked to original sources

Topological Recursion and Quantum Path Signatures

We introduce a non-commutative Laplace transform between functionals on path space and formal series in a tensor algebra, under which a natural convolution of path functionals becomes an algebraic product of series. Applying it to a random unitary matrix-valued path development - the quantum path signature - we show that the governing planar loop equations take a non-commutative spectral form. We then extend the loop equations to a $1/N$ genus expansion, organised by topological recursion, and obtain a hierarchy of integral equations on path space for the corrections.

math-ph

Generating Financial Time Series by Matching Random Convolutional Features

Generating realistic financial time series is challenging as training data is often limited to a single historical path. With such scarce data, overfitting is hard to avoid, especially under adversarial training where a trained discriminator can memorize the training samples. To mitigate this, recent approaches train generators to minimize the discrepancy between untrained feature representations of real and generated time series. In these works, the feature maps are based on path signatures, which can fail to capture relevant time series properties at tractable truncation depths. In this work, we instead train generators by matching random convolutional features of real and generated time series. Existing random convolutional feature maps, such as Rocket and Hydra, have been shown to provide informative representations of real-world time series, but cannot supervise generative models because they are non-differentiable. We introduce SOCK (SOft Competing Kernels), a fully differentiable random convolutional feature map, suited to train generative time series models. We show that generators trained by matching random SOCK features consistently outperform signature and diffusion baselines across a wide range of small-sample financial datasets. We further demonstrate SOCK's expressiveness on two-sample hypothesis testing and time series classification tasks, where SOCK matches or outperforms existing unsupervised feature maps.

cs.LG

Signature Kernel and Schwinger-Dyson Kernel Equations as Two-Parameter Rough Differential Equations

We develop a rough-path framework for two-parameter rough differential equations on rectangular and simplicial domains, motivated by the signature kernel and Schwinger--Dyson kernel equations. The theory is formulated in spaces of jointly controlled rough paths and is based on a robust two-parameter rough integration framework. In particular, we introduce a notion of rough integration over two-dimensional simplices at low regularity extending previous results in the literature. Within this setting, we show that the signature kernel equation arises naturally as a two-parameter rough differential equation and establish well-posedness and stability. We also extend the Schwinger--Dyson kernel equation, previously formulated for bounded-variation paths, to rough driving signals, proving existence and uniqueness in appropriate controlled rough path spaces. In the smooth rough path regime, we relate the resulting equations to PDE and integro-differential formulations. Finally, we derive and analyse a numerical scheme for the rough Schwinger--Dyson equation, including runtime and memory complexity estimates, and illustrate its performance with numerical experiments.

math.PR

Gradient Regularized Newton Boosting Trees with Global Convergence

Gradient Boosting Decision Trees (GBDTs) dominate tabular machine learning, with modern implementations like XGBoost, LightGBM, and CatBoost being based on Newton boosting: a second-order descent step in the space of decision trees. Despite its empirical success, the global convergence of Newton boosting is poorly understood compared to first-order boosting. In this paper, we introduce Restricted Newton Descent, which studies convex optimization with Newton's method on Hilbert spaces with inexact iterates, based on the concepts of cosine angle and weak gradient edge. Within this framework, we recover Newton boosting with GBDTs and classical finite-dimensional theory as special cases. We first prove that vanilla Newton boosting achieves a linear rate of convergence for smooth, strongly convex losses that satisfy a Hessian-dominance condition. To handle general convex losses with Lipschitz Hessians, we extend a recent gradient regularized Newton scheme to the restricted weak learner setting. This scheme minimally modifies the classical algorithm by introducing an adaptive $\ell_2$-regularization term proportional to the square root of the gradient norm at each iteration. We establish a $\mathcal{O}(\frac{1}{k^2})$ rate for this scheme, thereby obtaining a globally convergent second-order GBDT algorithm with a rate matching that of first-order boosting with Nesterov momentum. In numerical experiments, we show that our scheme converges while vanilla Newton boosting may diverge.

stat.ML

Random Controlled Differential Equations

We introduce a training-efficient framework for time-series learning that combines random features with controlled differential equations (CDEs). In this approach, large randomly parameterized CDEs act as continuous-time reservoirs, mapping input paths to rich representations. Only a linear readout layer is trained, resulting in fast, scalable models with strong inductive bias. Building on this foundation, we propose two variants: (i) Random Fourier CDEs (RF-CDEs): these lift the input signal using random Fourier features prior to the dynamics, providing a kernel-free approximation of RBF-enhanced sequence models; (ii) Random Rough DEs (R-RDEs): these operate directly on rough-path inputs via a log-ODE discretization, using log-signatures to capture higher-order temporal interactions while remaining stable and efficient. We prove that in the infinite-width limit, these model induces the RBF-lifted signature kernel and the rough signature kernel, respectively, offering a unified perspective on random-feature reservoirs, continuous-time deep architectures, and path-signature theory. We evaluate both models across a range of time-series benchmarks, demonstrating competitive or state-of-the-art performance. These methods provide a practical alternative to explicit signature computations, retaining their inductive bias while benefiting from the efficiency of random features.

cs.LG

Path Signatures Enable Model-Free Mapping of RNA Modifications

Detecting chemical modifications on RNA molecules remains a key challenge in epitranscriptomics. Traditional reverse transcription-based sequencing methods introduce enzyme- and sequence-dependent biases and fragment RNA molecules, confounding the accurate mapping of modifications across the transcriptome. Nanopore direct RNA sequencing offers a powerful alternative by preserving native RNA molecules, enabling the detection of modifications at single-molecule resolution. However, current computational tools can identify only a limited subset of modification types within well-characterized sequence contexts for which ample training data exists. Here, we introduce a model-free computational method that reframes modification detection as an anomaly detection problem, requiring only canonical (unmodified) RNA reads without any other annotated data. For each nanopore read, our approach extracts robust, modification-sensitive features from the raw ionic current signal at a site using the signature transform, then computes an anomaly score by comparing the resulting feature vector to its nearest neighbors in an unmodified reference dataset. We convert anomaly scores into statistical p-values to enable anomaly detection at both individual read and site levels. Validation on densely-modified \textit{E. coli} rRNA demonstrates that our approach detects known sites harboring diverse modification types, without prior training on these modifications. We further applyied this framework to dengue virus (DENV) transcripts and mammalian mRNAs. For DENV sfRNA, it led to revealing a novel 2'-O-methylated site, which we validate orthogonally by qRT-PCR assays. These results demonstrate that our model-free approach operates robustly across different types of RNAs and datasets generated with different nanopore sequencing chemistries.

q-bio.GN

Quantum Path Signatures

We elucidate physical aspects of path signatures by formulating randomised path developments within the framework of matrix models in quantum field theory. Using tools from physics, we introduce a new family of randomised path developments and derive corresponding loop equations. We then interpret unitary randomised path developments as time evolution operators on a Hilbert space of qubits. This leads to a definition of a quantum path signature feature map and associated quantum signature kernel through a quantum circuit construction. In the case of the Gaussian matrix model, we study a random ensemble of Pauli strings and formulate a quantum algorithm to compute such kernel.

quant-ph

Nonlinear Stochastic Filtering with Volterra Gaussian noises

We develop a nonlinear filtering theory for signal-observation systems driven by Volterra Gaussian processes, covering both the Young and genuinely rough regimes. The dynamics are formulated as a rough differential equation in which the observation has a signal-dependent Volterra drift, a structure naturally induced by an equivalent change of measure. We establish global well-posedness of the coupled system and derive a Kallianpur-Striebel formula. We then obtain a robust pathwise representation of the filter. In the one-dimensional setting, we characterise the unnormalised conditional density through a rough Zakai equation and establish its well-posedness using an extension of the rough viscosity framework. Finally, under a partial H\"ormander-type condition, we prove that the conditional distribution of the signal admits a smooth density.

math.PR

Numerical Schemes for Signature Kernels

Signature kernels have emerged as a powerful tool within kernel methods for sequential data. In the paper "The Signature Kernel is the solution of a Goursat PDE", the authors identify a kernel trick that demonstrates that, for continuously differentiable paths, the signature kernel satisfies a Goursat problem for a hyperbolic partial differential equation (PDE) in two independent time variables. While finite difference methods have been explored for this PDE, they face limitations in accuracy and stability when handling highly oscillatory inputs. In this work, we introduce two advanced numerical schemes that leverage polynomial representations of boundary conditions through either approximation or interpolation techniques, and rigorously establish the theoretical convergence of the polynomial approximation scheme. Experimental evaluations reveal that our approaches yield improvements of several orders of magnitude in mean absolute percentage error (MAPE) compared to traditional finite difference schemes, without increasing computational complexity. Furthermore, like finite difference methods, our algorithms can be GPU-parallelized to reduce computational complexity from quadratic to linear in the length of the input sequences, thereby improving scalability for high-frequency data. We have implemented these algorithms in a dedicated Python library, which is publicly available at: https://github.com/FrancescoPiatti/polysigkernel.

math.NA

Random Feature Representation Boosting

We introduce Random Feature Representation Boosting (RFRBoost), a novel method for constructing deep residual random feature neural networks (RFNNs) using boosting theory. RFRBoost uses random features at each layer to learn the functional gradient of the network representation, enhancing performance while preserving the convex optimization benefits of RFNNs. In the case of MSE loss, we obtain closed-form solutions to greedy layer-wise boosting with random features. For general loss functions, we show that fitting random feature residual blocks reduces to solving a quadratically constrained least squares problem. Through extensive numerical experiments on tabular datasets for both regression and classification, we show that RFRBoost significantly outperforms RFNNs and end-to-end trained MLP ResNets in the small- to medium-scale regime where RFNNs are typically applied. Moreover, RFRBoost offers substantial computational benefits, and theoretical guarantees stemming from boosting theory.

stat.ML

Pathwise Optimal Control and Rough Fractional Hamilton-Jacobi-Bellman Equations for Rough-Fractional Dynamics

In this work, we investigate the degeneracy problem in pathwise control, extending the framework developed in \cite{allan2020pathwise} to a more general class of driving signals and a broader set of admissible controls. Our approach consists in choosing admissible controls from a suitable class of H\"older-continuous paths. This leads naturally to the use of fractional derivatives and transforms the original control equation into a fractional dynamics system. Within this setting, we derive sufficient conditions ensuring that the control problem remains non-degenerate. We then build on the analysis developed in \cite{gomoyunov2020dynamic,gomoyunov2020theory,gomoyunov2021viscosity} to study the resulting value function and the associated Hamilton--Jacobi--Bellman equation.

math.OC

Topologies on unparameterised rough path space

The signature of a $p$-weakly geometric rough path summarises a path up to a generalised notion of reparameterisation. The quotient space of equivalence classes on which the signature is constant yields unparameterised path space. The study of topologies on unparameterised path space, initiated in [CT24b] for paths of bounded variation, has practical bearing on the use of signature based methods in a variety applications. This note extends the majority of results from [CT24b] to unparameterised weakly geometric rough path space. We study three classes of topologies: metrisable topologies for which the quotient map is continuous; the quotient topology derived from the underlying path space; and an explicit metric between the tree-reduced representatives of each equivalence class. We prove that topologies of the first type (under an additional assumption) are separable and Lusin, but not locally compact or completely metrisable. The quotient topology is Hausdorff but not metrisable, while the metric generating the third topology is not complete and its topology is not locally compact. We also show that the third topology is Polish when $p=1$.

math.CA

Infinite-dimensional Mahalanobis Distance with Applications to Kernelized Novelty Detection

The Mahalanobis distance is a classical tool used to measure the covariance-adjusted distance between points in $\bbR^d$. In this work, we extend the concept of Mahalanobis distance to separable Banach spaces by reinterpreting it as a Cameron-Martin norm associated with a probability measure. This approach leads to a basis-free, data-driven notion of anomaly distance through the so-called variance norm, which can naturally be estimated using empirical measures of a sample. Our framework generalizes the classical $\bbR^d$, functional $(L^2[0,1])^d$, and kernelized settings; importantly, it incorporates non-injective covariance operators. We prove that the variance norm is invariant under invertible bounded linear transformations of the data, extending previous results which are limited to unitary operators. In the Hilbert space setting, we connect the variance norm to the RKHS of the covariance operator, and establish consistency and convergence results for estimation using empirical measures with Tikhonov regularization. Using the variance norm, we introduce the notion of a kernelized nearest-neighbour Mahalanobis distance, and study some of its finite-sample concentration properties. In an empirical study on 12 real-world data sets, we demonstrate that the kernelized nearest-neighbour Mahalanobis distance outperforms the traditional kernelized Mahalanobis distance for multivariate time series novelty detection, using state-of-the-art time series kernels such as the signature, global alignment, and Volterra reservoir kernels.

stat.ML

Lecture notes on rough paths and applications to machine learning

These notes expound the recent use of the signature transform and rough path theory in data science and machine learning. We develop the core theory of the signature from first principles and then survey some recent popular applications of this approach, including signature-based kernel methods and neural rough differential equations. The notes are based on a course given by the two authors at Imperial College London.

cs.LG

Novelty Detection on Radio Astronomy Data using Signatures

We introduce SigNova, a new semi-supervised framework for detecting anomalies in streamed data. While our initial examples focus on detecting radio-frequency interference (RFI) in digitized signals within the field of radio astronomy, it is important to note that SigNova's applicability extends to any type of streamed data. The framework comprises three primary components. Firstly, we use the signature transform to extract a canonical collection of summary statistics from observational sequences. This allows us to represent variable-length visibility samples as finite-dimensional feature vectors. Secondly, each feature vector is assigned a novelty score, calculated as the Mahalanobis distance to its nearest neighbor in an RFI-free training set. By thresholding these scores we identify observation ranges that deviate from the expected behavior of RFI-free visibility samples without relying on stringent distributional assumptions. Thirdly, we integrate this anomaly detector with Pysegments, a segmentation algorithm, to localize consecutive observations contaminated with RFI, if any. This approach provides a compelling alternative to classical windowing techniques commonly used for RFI detection. Importantly, the complexity of our algorithm depends on the RFI pattern rather than on the size of the observation window. We demonstrate how SigNova improves the detection of various types of RFI (e.g., broadband and narrowband) in time-frequency visibility data. We validate our framework on the Murchison Widefield Array (MWA) telescope and simulated data and the Hydrogen Epoch of Reionization Array (HERA).

astro-ph.IM

Free probability, path developments and signature kernels as universal scaling limits

Random developments of a path into a matrix Lie group $G_N$ have recently been used to construct signature-based kernels on path space. Two examples include developments into GL$(N;\mathbb{R})$ and $U(N;\mathbb{C})$, the general linear and unitary groups of dimension $N$. For the former, [MLS23] showed that the signature kernel is obtained via a scaling limit of developments with Gaussian vector fields. The second instance was used in [LLN23] to construct a metric between probability measures on path space. We present a unified treatment to obtaining large $N$ limits by leveraging the tools of free probability theory. An important conclusion is that the limiting kernels, while dependent on the choice of Lie group, are nonetheless universal limits with respect to how the development map is randomised. For unitary developments, the limiting kernel is given by the contraction of a signature against the monomials of freely independent semicircular random variables. Using the Schwinger-Dyson equations, we show that this kernel can be obtained by solving a novel quadratic functional equation. We provide a convergent numerical scheme for this equation, together with rates, which does not require computation of signatures themselves.

math.PR

Generative Modelling of L\'evy Area for High Order SDE Simulation

It is well understood that, when numerically simulating SDEs with general noise, achieving a strong convergence rate better than $O(\sqrt{h})$ (where h is the step size) requires the use of certain iterated integrals of Brownian motion, commonly referred to as its "L\'evy areas". However, these stochastic integrals are difficult to simulate due to their non-Gaussian nature and for a $d$-dimensional Brownian motion with $d > 2$, no fast almost-exact sampling algorithm is known. In this paper, we propose L\'evyGAN, a deep-learning-based model for generating approximate samples of L\'evy area conditional on a Brownian increment. Due to our "Bridge-flipping" operation, the output samples match all joint and conditional odd moments exactly. Our generator employs a tailored GNN-inspired architecture, which enforces the correct dependency structure between the output distribution and the conditioning variable. Furthermore, we incorporate a mathematically principled characteristic-function based discriminator. Lastly, we introduce a novel training mechanism termed "Chen-training", which circumvents the need for expensive-to-generate training data-sets. This new training procedure is underpinned by our two main theoretical results. For 4-dimensional Brownian motion, we show that L\'evyGAN exhibits state-of-the-art performance across several metrics which measure both the joint and marginal distributions. We conclude with a numerical experiment on the log-Heston model, a popular SDE in mathematical finance, demonstrating that high-quality synthetic L\'evy area can lead to high order weak convergence and variance reduction when using multilevel Monte Carlo (MLMC).

stat.ML

On the Wiener Chaos Expansion of the Signature of a Gaussian Process

We compute the Wiener chaos decomposition of the signature for a class of Gaussian processes, which contains fractional Brownian motion (fBm) with Hurst parameter H in (1/4, 1). At level 0, our result yields an expression for the expected signature of such processes, which determines their law [CL16]. In particular, this formula simultaneously extends both the one for 1/2 < H-fBm [BC07] and the one for Brownian motion (H = 1/2) [Faw03], to the general case H > 1/4, thereby resolving an established open problem. Other processes studied include continuous and centred Gaussian semimartingales.

math.PR