SearcharxivSearch

arXiv subjects

Nalini Ravishanker

Publications and source records attributed to Nalini Ravishanker.

9 recordsLinked to original sources

Detection of Structural Distortions in Functional Time Series

In the era of modern data science, the rapid proliferation of high-dimensional and functional datasets has fostered increasing interest in the investigation of paradigm shifts and structural breaks. Unlike classical univariate time series, structural changes in functional data need not occur simultaneously across the entire domain; instead, they may emerge locally, producing heterogeneous distortions across the underlying functional structure. The patterns of instability often exhibit sparsity, where it is not known \textit{a priori} which specific parameters are undergoing a transition. However, in functional contexts, these shifts are often "localised". The difficulty lies in the high dimensionality of the parameter space, where the signal-to-noise ratio may be low for individual components, necessitating the aggregation of information across dimensions to detect a global change. This paper addresses the problem of detecting structural shifts in a functional time series from a Bayesian perspective. We have developed various novel methodologies that capture the inherent structural distortion in a sequence of random functions, both individually and simultaneously. The formulation of the problem is based on the state-space representation of a functional time series. Efficient Blocked Gibbs Sampling algorithms have been proposed to identify these locations accurately. Further, we demonstrate the effectiveness of our methods on several financial and temperature datasets.

stat.ME

Modeling Multiple Irregularly Spaced Financial Time Series

In this paper we propose univariate volatility models for irregularly spaced financial time series by modifying the regularly spaced stochastic volatility models. We also extend this approach to propose multivariate stochastic volatility (MSV) models for multiple irregularly spaced time series by modifying the MSV model that was used with daily data. We use these proposed models for modeling intraday logarithmic returns from health sector stocks data obtained from Trade and Quotes (TAQ) database at Wharton Research Data Services (WRDS).

stat.AP

Modeling Multivariate Positive-Valued Time Series Using R-INLA

In this paper we describe fast Bayesian statistical analysis of vector positive-valued time series, with application to interesting financial data streams. We discuss a flexible level correlated model (LCM) framework for building hierarchical models for vector positive-valued time series. The LCM allows us to combine marginal gamma distributions for the positive-valued component responses, while accounting for association among the components at a latent level. We use integrated nested Laplace approximation (INLA) for fast approximate Bayesian modeling via the R-INLA package, building custom functions to handle this setup. We use the proposed method to model interdependencies between realized volatility measures from several stock indexes.

stat.ME

Anomaly Detection in Energy Usage Patterns

Energy usage monitoring on higher education campuses is an important step for providing satisfactory service, lowering costs and supporting the move to green energy. We present a collaboration between the Department of Statistics and Facilities Operations at an R1 research university to develop statistically based approaches for monitoring monthly energy usage and proportional yearly usage for several hundred utility accounts on campus. We compare the interpretability and power of model-free and model-based methods for detection of anomalous energy usage patterns in statistically similar groups of accounts. Ongoing conversation between the academic and operations teams enhances the practical utility of the project and enables implementation for the university. Our work highlights an application of thoughtful and continuing collaborative analysis using easy-to-understand statistical principles for real-world deployment.

stat.AP

Spatiotemporal Analysis of Ridesourcing and Taxi Demand by Taxi zones in New York City

The burst of demand for TNCs has significantly changed the transportation landscape and dramatically disrupted the Vehicle for Hire (VFH) market that used to be dominated by taxicabs for many years. Since first being introduced by Uber in 2009, ridesourcing companies have rapidly penetrated the market. This paper aims to investigate temporal and spatial patterns in taxi and TNC usage based on data at the taxi zone level in New York City. Specifically, we fit suitable time series models to estimate the temporal patterns. Next, we filter out the temporal effects and investigate spatial dependence in the residuals using global and local Moran's I statistics. We discuss the relationship between the spatial correlations and the demographic and land use effects at the taxi zone level. Estimating and removing these effects via a multiple linear regression (MLR) model and recomputing the Moran's I statistics on the resulting residuals enables us to investigate spatial dependence after accounting for these effects. Our analysis indicates interesting patterns in spatial correlations between taxi zones in NYC and over time, indicating that predictive modeling of ridesourcing usage must incorporate both temporal and spatial dependence.

stat.AP

Nonlinear Time Series Classification Using Bispectrum-based Deep Convolutional Neural Networks

Time series classification using novel techniques has experienced a recent resurgence and growing interest from statisticians, subject-domain scientists, and decision makers in business and industry. This is primarily due to the ever increasing amount of big and complex data produced as a result of technological advances. A motivating example is that of Google trends data, which exhibit highly nonlinear behavior. Although a rich literature exists for addressing this problem, existing approaches mostly rely on first and second order properties of the time series, since they typically assume linearity of the underlying process. Often, these are inadequate for effective classification of nonlinear time series data such as Google Trends data. Given these methodological deficiencies and the abundance of nonlinear time series that persist among real-world phenomena, we introduce an approach that merges higher order spectral analysis (HOSA) with deep convolutional neural networks (CNNs) for classifying time series. The effectiveness of our approach is illustrated using simulated data and two motivating industry examples that involve Google trends data and electronic device energy consumption data.

stat.ML

Topological Data Analysis (TDA) for Time Series

The study of topology is strictly speaking, a topic in pure mathematics. However in only a few years, Topological Data Analysis (TDA), which refers to methods of utilizing topological features in data (such as connected components, tunnels, voids, etc.) has gained considerable momentum. More recently, TDA is being used to understand time series. This article provides a review of TDA for time series, with examples using R functions. Features derived from TDA are useful in classification and clustering of time series and in detecting breaks in patterns.

stat.AP

Clustering Activity-Travel Behavior Time Series using Topological Data Analysis

Over the last few years, traffic data has been exploding and the transportation discipline has entered the era of big data. It brings out new opportunities for doing data-driven analysis, but it also challenges traditional analytic methods. This paper proposes a new Divide and Combine based approach to do K means clustering on activity-travel behavior time series using features that are derived using tools in Time Series Analysis and Topological Data Analysis. Clustering data from five waves of the National Household Travel Survey ranging from 1990 to 2017 suggests that activity-travel patterns of individuals over the last three decades can be grouped into three clusters. Results also provide evidence in support of recent claims about differences in activity-travel patterns of different survey cohorts. The proposed method is generally applicable and is not limited only to activity-travel behavior analysis in transportation studies. Driving behavior, travel mode choice, household vehicle ownership, when being characterized as categorical time series, can all be analyzed using the proposed method.

stat.ML

Efficient Sequential and Parallel Algorithms for Estimating Higher Order Spectra

Polyspectral estimation is a problem of great importance in the analysis of nonlinear time series that has applications in biomedical signal processing, communications, geophysics, image, radar, sonar and speech processing, etc. Higher order spectra (HOS) have been used in unsupervised and supervised clustering in big data scenarios, in testing for Gaussianity, to suppress Gaussian noise, to characterize nonlinearities in time series data, and so on . Any algorithm for computing the $k$th order spectra of a time series of length $n$ needs $Ω(n^{k-1})$ time since the output size will be $Ω(n^{k-1})$ as well. Given that we live in an era of big data, $n$ could be very large. In this case, sequential algorithms might take unacceptable amounts of time. Thus it is essential to develop parallel algorithms. There is also room for improving existing sequential algorithms. In addition, parallel algorithms in the literature are nongeneric. In this paper we offer generic sequential algorithms for computing higher order spectra that are asymptotically faster than any published algorithm for HOS. Further, we offer memory efficient algorithms. We also present optimal parallel implementations of these algorithms on parallel computing models such as the PRAM and the mesh. We provide experimental results on our sequential and parallel algorithms. Our parallel implementation achieves very good speedups.

cs.DC