arXiv subjects

Zhen Shao

Publications and source records attributed to Zhen Shao.

12 recordsLinked to original sources

arXiv2025

Superconducting qubit readout enhanced by path signature

Quantum non-demolition measurement plays an essential role in quantum technology, crucial for quantum error correction, metrology, and sensing. Conventionally, the qubit state is classified from the raw or integrated time-domain measurement record. Here, we demonstrate a method to enhance the assignment fidelity of the readout by considering the "path signature" of this measurement record, where the path signature is a mathematical tool for analyzing stochastic time series. We evaluate this approach across five different hardware setups, including those with and without readout multiplexing and parametric amplifiers, and demonstrate a significant improvement in assignment fidelity across all setups. Moreover, we show that the path signature of the measurement record provides an expressive feature set that can be used to detect and classify state transitions that occurred during the measurement, improving the prediction of the qubit state at the end of the measurement. This method has the potential to become a foundational tool for quantum technology.

quant-ph↗

arXiv2025

Random Subspace Cubic-Regularization Methods, with Applications to Low-Rank Functions

We propose and analyze random subspace variants of the second-order Adaptive Regularization using Cubics (ARC) algorithm. These methods iteratively restrict the search space to some random subspace of the parameters, constructing and minimizing a local model only within this subspace. Thus, our variants only require access to (small-dimensional) projections of first- and second-order problem derivatives and calculate a reduced step inexpensively. Under suitable assumptions, the ensuing methods maintain the optimal first-order, and second-order, global rates of convergence of (full-dimensional) cubic regularization, while showing improved scalability both theoretically and numerically, particularly when applied to low-rank functions. When applied to the latter, our adaptive variant naturally adapts the subspace size to the true rank of the function, without knowing it a priori.

math.OC↗

arXiv2024

Neural Controlled Differential Equations with Quantum Hidden Evolutions

We introduce a class of neural controlled differential equation inspired by quantum mechanics. Neural quantum controlled differential equations (NQDEs) model the dynamics by analogue of the Schrödinger equation. Specifically, the hidden state represents the wave function, and its collapse leads to an interpretation of the classification probability. We implement and compare the results of four variants of NQDEs on a toy spiral classification problem.

cs.LG↗

arXiv2023

Dimensionless Anomaly Detection on Multivariate Streams with Variance Norm and Path Signature

In this paper, we propose a dimensionless anomaly detection method for multivariate streams. Our method is independent of the unit of measurement for the different stream channels, therefore dimensionless. We first propose the variance norm, a generalisation of Mahalanobis distance to handle infinite-dimensional feature space and singular empirical covariance matrix rigorously. We then combine the variance norm with the path signature, an infinite collection of iterated integrals that provide global features of streams, to propose SigMahaKNN, a method for anomaly detection on (multivariate) streams. We show that SigMahaKNN is invariant to stream reparametrisation, stream concatenation and has a graded discrimination power depending on the truncation level of the path signature. We implement SigMahaKNN as an open-source software, and perform extensive numerical experiments, showing significantly improved anomaly detection on streams compared to isolation forest and local outlier factors in applications ranging from language analysis, hand-writing analysis, ship movement paths analysis and univariate time-series analysis.

cs.LG↗

arXiv2022

Randomised subspace methods for non-convex optimization, with applications to nonlinear least-squares

We propose a general random subspace framework for unconstrained nonconvex optimization problems that requires a weak probabilistic assumption on the subspace gradient, which we show to be satisfied by various random matrix ensembles, such as Gaussian and sparse sketching, using Johnson-Lindenstrauss embedding properties. We show that, when safeguarded with trust region or quadratic regularization, this random subspace approach satisfies, with high probability, a complexity bound of order $\mathcal{O}(ε^{-2})$ to drive the (full) gradient below $ε$; matching in the accuracy order, deterministic counterparts of these methods and securing almost sure convergence. Furthermore, no problem dimension dependence appears explicitly in the projection size of the sketching matrix, allowing the choice of low-dimensional subspaces. We particularise this framework to Random Subspace Gauss-Newton (RS-GN) methods for nonlinear least squares problems, that only require the calculation of the Jacobian in the subspace; with similar complexity guarantees. Numerical experiments with RS-GN on CUTEst nonlinear least squares are also presented, with some encouraging results.

math.OC↗

arXiv2022

A Randomised Subspace Gauss-Newton Method for Nonlinear Least-Squares

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on each iteration. A sublinear global rate of convergence result is presented for a trust-region variant of R-SGN, with high probability, which matches deterministic counterpart results in the order of the accuracy tolerance. Promising preliminary numerical results are presented for R-SGN on logistic regression and on nonlinear regression problems from the CUTEst collection.

math.OC↗

arXiv2022

Johnson-Lindenstrauss embeddings for noisy vectors -- taking advantage of the noise

This paper investigates theoretical properties of subsampling and hashing as tools for approximate Euclidean norm-preserving embeddings for vectors with (unknown) additive Gaussian noises. Such embeddings are sometimes called Johnson-lindenstrauss embeddings due to their celebrated lemma. Previous work shows that as sparse embeddings, the success of subsampling and hashing closely depends on the $l_\infty$ to $l_2$ ratios of the vector to be mapped. This paper shows that the presence of noise removes such constrain in high-dimensions, in other words, sparse embeddings such as subsampling and hashing with comparable embedding dimensions to dense embeddings have similar approximate norm-preserving dimensionality-reduction properties. The key is that the noise should be treated as an information to be exploited, not simply something to be removed. Theoretical bounds for subsampling and hashing to recover the approximate norm of a high dimension vector in the presence of noise are derived, with numerical illustrations showing better performances are achieved in the presence of noise.

cs.DS↗

arXiv2022

On random embeddings and their application to optimisation

Random embeddings project high-dimensional spaces to low-dimensional ones; they are careful constructions which allow the approximate preservation of key properties, such as the pair-wise distances between points. Often in the field of optimisation, one needs to explore high-dimensional spaces representing the problem data or its parameters and thus the computational cost of solving an optimisation problem is connected to the size of the data/variables. This thesis studies the theoretical properties of norm-preserving random embeddings, and their application to several classes of optimisation problems.

math.OC↗

arXiv2021

Hashing embeddings of optimal dimension, with applications to linear least squares

The aim of this paper is two-fold: firstly, to present subspace embedding properties for $s$-hashing sketching matrices, with $s\geq 1$, that are optimal in the projection dimension $m$ of the sketch, namely, $m=\mathcal{O}(d)$, where $d$ is the dimension of the subspace. A diverse set of results are presented that address the case when the input matrix has sufficiently low coherence (thus removing the $\log^2 d$ factor dependence in $m$, in the low-coherence result of Bourgain et al (2015) at the expense of a smaller coherence requirement); how this coherence changes with the number $s$ of column nonzeros (allowing a scaling of $\sqrt{s}$ of the coherence bound), or is reduced through suitable transformations (when considering hashed -- instead of subsampled -- coherence reducing transformations such as randomised Hadamard). Secondly, we apply these general hashing sketching results to the special case of Linear Least Squares (LLS), and develop Ski-LLS, a generic software package for these problems, that builds upon and improves the Blendenpik solver on dense input and the (sequential) LSRN performance on sparse problems. In addition to the hashing sketching improvements, we add suitable linear algebra tools for rank-deficient and for sparse problems that lead Ski-LLS to outperform not only sketching-based routines on randomly generated input, but also state of the art direct solver SPQR and iterative code HSL on certain subsets of the sparse Florida matrix collection; namely, on least squares problems that are significantly overdetermined, or moderately sparse, or difficult.

math.NA↗

arXiv2015

Shear accelerated crystallization in a supercooled atomic liquid

A bulk metallic glass forming alloy is subjected to shear flow in its supercooled state by compression of a short rod to produce a flat disc. The resulting material exhibits enhanced crystallization kinetics during isothermal annealing as reflected in the decrease of the crystallization time relative to the non-deformed case. The transition from quiescent to shear-accelerated crystallization is linked to strain accumulated during shear flow above a critical shear rate $\dotγ_c\approx 0.3$ s$^{-1}$ which corresponds to Péclet number, $Pe\sim\mathcal{O}(1)$. The observation of shear accelerated crystallization in an atomic system at modest shear rates is uncommon. It is made possible here by the substantial viscosity of the supercooled liquid which increases strongly with temperature in the approach to the glass transition. We may therefore anticipate the encounter of non-trivial shear-related effects during thermoplastic deformation of similar systems.

cond-mat.mtrl-sci↗

arXiv2009

Dynamics-Driven Evolution to Structural Heterogeneity in Complex Networks

The mutual influence of dynamics and structure is a central issue in complex systems. In this paper we study by simulation slow evolution of network under the feedback of a local-majority-rule opinion process. If performance-enhancing local mutations have higher chances of getting integrated into its structure, the system can evolve into a highly heterogeneous small-world with a global hub (whose connectivity is proportional to the network size), strong local connection correlations and power law-like degree distribution. Networks with better dynamical performance are achieved if structural evolution occurs much slower than the network dynamics. Structural heterogeneity of many biological and social dynamical systems may also be driven by various dynamics-structure coupling mechanisms.

physics.soc-ph↗

arXiv2009

Evolve Networks Towards Better Performance: a Compromise between Mutation and Selection

The interaction between natural selection and random mutation is frequently debated in recent years. Does similar dilemma also exist in the evolution of real networks such as biological networks? In this paper, we try to discuss this issue by a simple model system, in which the topological structure of networks is repeatedly modified and selected in order to make them have better performance in dynamical processes. Interestingly, when the networks with optimal performance deviate from the steady state networks under pure mutations, we find the evolution behaves as a balance between mutation and selection. Furthermore, when the timescales of mutations and dynamical processes are comparable with each other, the steady state of evolution is mainly determined by mutation. On the opposite side, when the timescale of mutations is much longer than that of dynamical processes, selection dominates the evolution and the steady-state networks turn to have much improved performance and highly heterogeneous structures. Despite the simplicity of our model system, this finding could give useful indication to detect the underlying mechanisms that rein the evolution of real systems.

cond-mat.stat-mech↗