Searcharxiv⌕ Search

arXiv subjects

Richard A. Davis

Publications and source records attributed to Richard A. Davis.

33 records · Page 2Linked to original sources

Measures of serial extremal dependence and their estimation

The goal of this paper is two-fold: 1. We review classical and recent measures of serial extremal dependence in a strictly stationary time series as well as their estimation. 2. We discuss recent concepts of heavy-tailed time series, including regular variation and max-stable processes. Serial extremal dependence is typically characterized by clusters of exceedances of high thresholds in the series. We start by discussing the notion of extremal index of a univariate sequence, i.e. the reciprocal of the expected cluster size, which has attracted major attention in the extremal value literature. Then we continue by introducing the extremogram which is an asymptotic auto-correlation function for sequences of extremal events in a time series. In this context, we discuss regular variation of a time series. This notion has been useful for describing serial extremal dependence and heavy tails in a strictly stationary sequence. We briefly discuss the tail process coined by Basrak and Segers to describe the dependence structure of regularly varying sequences in a probabilistic way. Max-stable processes with Frechet marginals are an important class of reg- ularly varying sequences. Recently, this class has attracted attention for modeling and statistical purposes. We apply the extremogram to max-stable processes. Finally, we discuss estimation of the extremogram both in the time and frequency domains.

math.ST↗

Approximating the conditional density given large observed values via a multivariate extremes framework, with application to environmental data

Phenomena such as air pollution levels are of greatest interest when observations are large, but standard prediction methods are not specifically designed for large observations. We propose a method, rooted in extreme value theory, which approximates the conditional distribution of an unobserved component of a random vector given large observed values. Specifically, for $\mathbf{Z}=(Z_1,...,Z_d)^T$ and $\mathbf{Z}_{-d}=(Z_1,...,Z_{d-1})^T$, the method approximates the conditional distribution of $[Z_d|\mathbf{Z}_{-d}=\mathbf{z}_{-d}]$ when $|\mathbf{z}_{-d}|>r_*$. The approach is based on the assumption that $\mathbf{Z}$ is a multivariate regularly varying random vector of dimension $d$. The conditional distribution approximation relies on knowledge of the angular measure of $\mathbf{Z}$, which provides explicit structure for dependence in the distribution's tail. As the method produces a predictive distribution rather than just a point predictor, one can answer any question posed about the quantity being predicted, and, in particular, one can assess how well the extreme behavior is represented. Using a fitted model for the angular measure, we apply our method to nitrogen dioxide measurements in metropolitan Washington DC. We obtain a predictive distribution for the air pollutant at a location given the air pollutant's measurements at four nearby locations and given that the norm of the vector of the observed measurements is large.

stat.AP↗

Limit Theory for the largest eigenvalues of sample covariance matrices with heavy-tails

We study the joint limit distribution of the $k$ largest eigenvalues of a $p\times p$ sample covariance matrix $XX^\T$ based on a large $p\times n$ matrix $X$. The rows of $X$ are given by independent copies of a linear process, $X_{it}=\sum_j c_j Z_{i,t-j}$, with regularly varying noise $(Z_{it})$ with tail index $α\in(0,4)$. It is shown that a point process based on the eigenvalues of $XX^\T$ converges, as $n\to\infty$ and $p\to\infty$ at a suitable rate, in distribution to a Poisson point process with an intensity measure depending on $α$ and $\sum c_j^2$. This result is extended to random coefficient models where the coefficients of the linear processes $(X_{it})$ are given by $c_j(θ_i)$, for some ergodic sequence $(θ_i)$, and thus vary in each row of $X$. As a by-product of our techniques we obtain a proof of the corresponding result for matrices with iid entries in cases where $p/n$ goes to zero or infinity and $α\in(0,2)$.

math.PR↗

Sparse Vector Autoregressive Modeling

The vector autoregressive (VAR) model has been widely used for modeling temporal dependence in a multivariate time series. For large (and even moderate) dimensions, the number of AR coefficients can be prohibitively large, resulting in noisy estimates, unstable predictions and difficult-to-interpret temporal dependence. To overcome such drawbacks, we propose a 2-stage approach for fitting sparse VAR (sVAR) models in which many of the AR coefficients are zero. The first stage selects non-zero AR coefficients based on an estimate of the partial spectral coherence (PSC) together with the use of BIC. The PSC is useful for quantifying the conditional relationship between marginal series in a multivariate process. A refinement second stage is then applied to further reduce the number of parameters. The performance of this 2-stage approach is illustrated with simulation results. The 2-stage approach is also applied to two real data examples: the first is the Google Flu Trends data and the second is a time series of concentration levels of air pollutants.

stat.AP↗

Statistical inference for max-stable processes in space and time

Max-stable processes have proved to be useful for the statistical modelling of spatial extremes. Several representations of max-stable random fields have been proposed in the literature. One such representation is based on a limit of normalized and scaled pointwise maxima of stationary Gaussian processes that was first introduced by Kabluchko, Schlather and de Haan (2009). This paper deals with statistical inference for max-stable space-time processes that are defined in an analogous fashion. We describe pairwise likelihood estimation, where the pairwise density of the process is used to estimate the model parameters and prove strong consistency and asymptotic normality of the parameter estimates for an increasing space-time dimension, i.e., as the joint number of spatial locations and time points tends to infinity. A simulation study shows that the proposed method works well for these models.

stat.ME↗

Theory and Inference for a Class of Observation-driven Models with Application to Time Series of Counts

This paper studies theory and inference related to a class of time series models that incorporates nonlinear dynamics. It is assumed that the observations follow a one-parameter exponential family of distributions given an accompanying process that evolves as a function of lagged observations. We employ an iterated random function approach and a special coupling technique to show that, under suitable conditions on the parameter space, the conditional mean process is a geometric moment contracting Markov chain and that the observation process is absolutely regular with geometrically decaying coefficients. Moreover the asymptotic theory of the maximum likelihood estimates of the parameters is established under some mild assumptions. These models are applied to two examples; the first is the number of transactions per minute of Ericsson stock and the second is related to return times of extreme events of Goldman Sachs Group stock.

math.ST↗

Unit roots in moving averages beyond first order

The asymptotic theory of various estimators based on Gaussian likelihood has been developed for the unit root and near unit root cases of a first-order moving average model. Previous studies of the MA(1) unit root problem rely on the special autocovariance structure of the MA(1) process, in which case, the eigenvalues and eigenvectors of the covariance matrix of the data vector have known analytical forms. In this paper, we take a different approach to first consider the joint likelihood by including an augmented initial value as a parameter and then recover the exact likelihood by integrating out the initial value. This approach by-passes the difficulty of computing an explicit decomposition of the covariance matrix and can be used to study unit root behavior in moving averages beyond first order. The asymptotics of the generalized likelihood ratio (GLR) statistic for testing unit roots are also studied. The GLR test has operating characteristics that are competitive with the locally best invariant unbiased (LBIU) test of Tanaka for some local alternatives and dominates for all other alternatives.

math.ST↗

Estimating Extremal Dependence in Univariate and Multivariate Time Series via the Extremogram

Davis and Mikosch [7] introduced the extremogram as a flexible quantitative tool for measuring various types of extremal dependence in a stationary time series. There we showed some standard statistical properties of the sample extremogram. A major difficulty was the construction of credible confidence bands for the extremogram. In this paper, we employ the stationary bootstrap to overcome this problem. Moreover, we introduce the cross extremogram as a measure of extremal serial dependence between two or more time series. We also study the extremogram for return times between extremal events. The use of the stationary bootstrap for the extremogram and the resulting interpretations are illustrated in several univariate and multivariate financial time series examples.

stat.ME↗

Max-stable processes for modelling extremes observed in space and time

Max-stable processes have proved to be useful for the statistical modelling of spatial extremes. Several representations of max-stable random fields have been proposed in the literature. For statistical inference it is often assumed that there is no temporal dependence, i.e., the observations at spatial locations are independent in time. We use two representations of stationary max-stable spatial random fields and extend the concepts to the space-time domain. In a first approach, we extend the idea of constructing max-stable random fields as limits of normalized and rescaled pointwise maxima of independent Gaussian random fields, which was introduced by Kabluchko, Schlather and de Haan [2009], who construct max-stable random fields associated to a class of variograms. We use a similar approach based on a well-known result by Hüsler and Reiss and apply specific spatio-temporal covariance models for the underlying Gaussian random field, which satisfy weak regularity assumptions. Furthermore, we extend Smith's storm profile model to a space-time setting and provide explicit expressions for the bivariate distribution functions. The tail dependence coefficient is an important measure of extremal dependence. We show how the spatio-temporal covariance function underlying the Gaussian random field can be interpreted in terms of the tail dependence coefficient. Within this context, we examine different concepts for constructing spatio-temporal covariance models and analyse several specific examples, including Gneiting's class of nonseparable stationary covariance functions.

stat.ME↗

The extremogram: A correlogram for extreme events

We consider a strictly stationary sequence of random vectors whose finite-dimensional distributions are jointly regularly varying with some positive index. This class of processes includes, among others, ARMA processes with regularly varying noise, GARCH processes with normally or Student-distributed noise and stochastic volatility models with regularly varying multiplicative noise. We define an analog of the autocorrelation function, the extremogram, which depends only on the extreme values in the sequence. We also propose a natural estimator for the extremogram and study its asymptotic properties under $α$-mixing. We show asymptotic normality, calculate the extremogram for various examples and consider spectral analysis related to the extremogram.

math.ST↗

A Conversation with Murray Rosenblatt

On an exquisite March day in 2006, David Brillinger and Richard Davis sat down with Murray and Ady Rosenblatt at their home in La Jolla, California for an enjoyable day of reminiscences and conversation. Our mentor, Murray Rosenblatt, was born on September 7, 1926 in New York City and attended City College of New York before entering graduate school at Cornell University in 1946. After completing his Ph.D. in 1949 under the direction of the renowned probabilist Mark Kac, the Rosenblatts' moved to Chicago where Murray became an instructor/assistant professor in the Committee of Statistics at the University of Chicago. Murray's academic career then took him to the University of Indiana and Brown University before his joining the University of California at San Diego in 1964. Along the way, Murray established himself as one of the most celebrated and leading figures in probability and statistics with particular emphasis on time series and Markov processes. In addition to being a fellow of the Institute of Mathematical Statistics and American Association for the Advancement of Science, he was a Guggenheim fellow (1965--1966, 1971--1972) and was elected to the National Academy of Sciences in 1984. Among his many contributions, Murray conducted seminal work on density estimation, central limit theorems under strong mixing, spectral domain methods and long memory processes. Murray and Ady Rosenblatt were married in 1949 and have two children, Karin and Daniel.

stat.ME↗

Maximum likelihood estimation for $α$-stable autoregressive processes

We consider maximum likelihood estimation for both causal and noncausal autoregressive time series processes with non-Gaussian $α$-stable noise. A nondegenerate limiting distribution is given for maximum likelihood estimators of the parameters of the autoregressive model equation and the parameters of the stable noise distribution. The estimators for the autoregressive parameters are $n^{1/α}$-consistent and converge in distribution to the maximizer of a random function. The form of this limiting distribution is intractable, but the shape of the distribution for these estimators can be examined using the bootstrap procedure. The bootstrap is asymptotically valid under general conditions. The estimators for the parameters of the stable noise distribution have the traditional $n^{1/2}$ rate of convergence and are asymptotically normal. The behavior of the estimators for finite samples is studied via simulation, and we use maximum likelihood estimation to fit a noncausal autoregressive model to the natural logarithms of volumes of Wal-Mart stock traded daily on the New York Stock Exchange.

math.ST↗

Rank-based estimation for all-pass time series models

An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models are useful for identifying and modeling noncausal and noninvertible autoregressive-moving average processes. We establish asymptotic normality and consistency for rank-based estimators of all-pass model parameters. The estimators are obtained by minimizing the rank-based residual dispersion function given by Jaeckel [Ann. Math. Statist. 43 (1972) 1449--1458]. These estimators can have the same asymptotic efficiency as maximum likelihood estimators and are robust. The behavior of the estimators for finite samples is studied via simulation and rank estimation is used in the deconvolution of a simulated water gun seismogram.

math.ST↗

Pile-up probabilities for the Laplace likelihood estimator of a non-invertible first order moving average

The first-order moving average model or MA(1) is given by $X_t=Z_t-θ_0Z_{t-1}$, with independent and identically distributed $\{Z_t\}$. This is arguably the simplest time series model that one can write down. The MA(1) with unit root ($θ_0=1$) arises naturally in a variety of time series applications. For example, if an underlying time series consists of a linear trend plus white noise errors, then the differenced series is an MA(1) with unit root. In such cases, testing for a unit root of the differenced series is equivalent to testing the adequacy of the trend plus noise model. The unit root problem also arises naturally in a signal plus noise model in which the signal is modeled as a random walk. The differenced series follows a MA(1) model and has a unit root if and only if the random walk signal is in fact a constant. The asymptotic theory of various estimators based on Gaussian likelihood has been developed for the unit root case and nearly unit root case ($θ=1+β/n,β\le0$). Unlike standard $1/\sqrt{n}$-asymptotics, these estimation procedures have $1/n$-asymptotics and a so-called pile-up effect, in which P$(\hatθ=1)$ converges to a positive value. One explanation for this pile-up phenomenon is the lack of identifiability of $θ$ in the Gaussian case. That is, the Gaussian likelihood has the same value for the two sets of parameter values $(θ,σ^2)$ and $(1/θ,θ^2σ^2$). It follows that $θ=1$ is always a critical point of the likelihood function. In contrast, for non-Gaussian noise, $θ$ is identifiable for all real values. Hence it is no longer clear whether or not the same pile-up phenomenon will persist in the non-Gaussian case. In this paper, we focus on limiting pile-up probabilities for estimates of $θ_0$ based on a Laplace likelihood. In some cases, these estimates can be viewed as Least Absolute Deviation (LAD) estimates. Simulation results illustrate the limit theory.

math.ST↗