arXiv subjects

Anand Rajagopalan

Publications and source records attributed to Anand Rajagopalan.

9 recordsLinked to original sources

arXiv2026

The Shift Operator Calculus for Stationary Time Series Analysis

The article establishes a rigorous shift operator calculus for stationary time series modeling, addressing a certain gap in the literature. It provides proofs of existence and isometry for the transfer function operators $f(B)$ and $f(T)$ where $B$ is the bilateral shift operator and $T$ is the unilateral shift operator for different families of functions $f$. The article establishes convergence of the power series of $f(B)$ and $f(T)$ under the operator norm for the Wiener algebra $\mathbb{W}_+$, and convergence under strong operator topology for $f$ in $H^{\infty}$, based on the use of Abel sums. Based on this calculus, it unifies the notion of stationary process invertibility with the operator invertibility of the transfer function $f(T)$.

math.FA↗

arXiv2026

On an $L^2$ norm for stationary ARMA processes

We propose an $L^2$ norm for stationary Autoregressive Moving Average (ARMA) models. We look at ARMA models within the Hilbert space of the past with present of a true purely linearly non-deterministic stationary process $X_t$, and compute the $L^2$ norm based on its Wold decomposition. As an application of this $L^2$ norm, we derive bounds on the mean square prediction error for AR(1) models of MA(1) processes, and verify these bounds empirically for sample data.

cs.LG↗

arXiv2025

Schauder Bases for $C[0, 1]$ Using ReLU, Softplus and Two Sigmoidal Functions

We construct four Schauder bases for the space $C[0,1]$, one using ReLU functions, another using Softplus functions, and two more using sigmoidal versions of the ReLU and Softplus functions. This establishes the existence of a basis using these functions for the first time, and improves on the universal approximation property associated with them. We also show an $O(\frac{1}{n})$ approximation bound based on our ReLU basis, and a negative result on constructing multivariate functions using finite combinations of ReLU functions.

cs.LG↗

arXiv2025

A Singular Integral for a Simplified Clairaut Equation

This expository article on the Lagrange singular integral contains two novelties. The first novelty involves a connection between the Lagrange singular integral for a simplified Clairaut equation, and Euler's homogeneous function theorem. The paper presents a formal derivation of Euler's solution from Lagrange's complete integral, though with some caveats, and also constructs more general surfaces from the complete integral which go beyond Euler's solutions. The first rather complicated construction is based directly on Goursat's definition of a general integral, while the subsequent simpler constructions are based on a suitably expanded notion of the general integral. This generalized general integral is our second novelty. It bridges some of the gap between the the general integral, and the complete integral, partially addressing Evans' remarks (Partial Differential Equations, AMS Graduate Studies in Mathematics, 1998) on the limitations of the general integral. Finally we discuss some subtleties around complete integrals as noted by Chojnacki (Proceedings of the AMS, 1995) and some around general integrals as noted by Evans, and how they apply to our examples. We aim to present these classical PDE concepts to readers with a basic knowledge of multivariable calculus.

math.CA↗

arXiv2021

Batch Active Learning at Scale

The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched queries to a labeling oracle, is a common approach for addressing this problem. The practical benefits of batch sampling come with the downside of less adaptivity and the risk of sampling redundant examples within a batch -- a risk that grows with the batch size. In this work, we analyze an efficient active learning algorithm, which focuses on the large batch setting. In particular, we show that our sampling method, which combines notions of uncertainty and diversity, easily scales to batch sizes (100K-1M) several orders of magnitude larger than used in previous studies and provides significant improvements in model training efficiency compared to recent baselines. Finally, we provide an initial theoretical analysis, proving label complexity guarantees for a related sampling method, which we show is approximately equivalent to our sampling method in specific settings.

cs.LG↗

arXiv2021

Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets

Hierarchical Agglomerative Clustering (HAC) is one of the oldest but still most widely used clustering methods. However, HAC is notoriously hard to scale to large data sets as the underlying complexity is at least quadratic in the number of data points and many algorithms to solve HAC are inherently sequential. In this paper, we propose {Reciprocal Agglomerative Clustering (RAC)}, a distributed algorithm for HAC, that uses a novel strategy to efficiently merge clusters in parallel. We prove theoretically that RAC recovers the exact solution of HAC. Furthermore, under clusterability and balancedness assumption we show provable speedups in total runtime due to the parallelism. We also show that these speedups are achievable for certain probabilistic data models. In extensive experiments, we show that this parallelism is achieved on real world data sets and that the proposed RAC algorithm can recover the HAC hierarchy on billions of data points connected by trillions of edges in less than an hour.

cs.LG↗

arXiv2021

Hierarchical Clustering via Sketches and Hierarchical Correlation Clustering

Recently, Hierarchical Clustering (HC) has been considered through the lens of optimization. In particular, two maximization objectives have been defined. Moseley and Wang defined the \emph{Revenue} objective to handle similarity information given by a weighted graph on the data points (w.l.o.g., $[0,1]$ weights), while Cohen-Addad et al. defined the \emph{Dissimilarity} objective to handle dissimilarity information. In this paper, we prove structural lemmas for both objectives allowing us to convert any HC tree to a tree with constant number of internal nodes while incurring an arbitrarily small loss in each objective. Although the best-known approximations are 0.585 and 0.667 respectively, using our lemmas we obtain approximations arbitrarily close to 1, if not all weights are small (i.e., there exist constants $ε, δ$ such that the fraction of weights smaller than $δ$, is at most $1 - ε$); such instances encompass many metric-based similarity instances, thereby improving upon prior work. Finally, we introduce Hierarchical Correlation Clustering (HCC) to handle instances that contain similarity and dissimilarity information simultaneously. For HCC, we provide an approximation of 0.4767 and for complementary similarity/dissimilarity weights (analogous to $+/-$ correlation clustering), we again present nearly-optimal approximations.

cs.DS↗

arXiv2019

Flattening a Hierarchical Clustering through Active Learning

We investigate active learning by pairwise similarity over the leaves of trees originating from hierarchical clustering procedures. In the realizable setting, we provide a full characterization of the number of queries needed to achieve perfect reconstruction of the tree cut. In the non-realizable setting, we rely on known important-sampling procedures to obtain regret and query complexity bounds. Our algorithms come with theoretical guarantees on the statistical error and, more importantly, lend themselves to linear-time implementations in the relevant parameters of the problem. We discuss such implementations, prove running time guarantees for them, and present preliminary experiments on real-world datasets showing the compelling practical performance of our algorithms as compared to both passive learning and simple active learning baselines.

cs.LG↗

arXiv2019

Online Hierarchical Clustering Approximations

Hierarchical clustering is a widely used approach for clustering datasets at multiple levels of granularity. Despite its popularity, existing algorithms such as hierarchical agglomerative clustering (HAC) are limited to the offline setting, and thus require the entire dataset to be available. This prohibits their use on large datasets commonly encountered in modern learning applications. In this paper, we consider hierarchical clustering in the online setting, where points arrive one at a time. We propose two algorithms that seek to optimize the Moseley and Wang (MW) revenue function, a variant of the Dasgupta cost. These algorithms offer different tradeoffs between efficiency and MW revenue performance. The first algorithm, OTD, is a highly efficient Online Top Down algorithm which provably achieves a 1/3-approximation to the MW revenue under a data separation assumption. The second algorithm, OHAC, is an online counterpart to offline HAC, which is known to yield a 1/3-approximation to the MW revenue, and produce good quality clusters in practice. We show that OHAC approximates offline HAC by leveraging a novel split-merge procedure. We empirically show that OTD and OHAC offer significant efficiency and cluster quality gains respectively over baselines.

cs.LG↗