arXiv subjects

Leonie Selk

Publications and source records attributed to Leonie Selk.

13 recordsLinked to original sources

arXiv2026

Analysis of gradual changes in nonparametric regression based on a new optimization method in the non-unique case

Consider a nonparametric regression model with one-dimensional covariates and a continuous regression function. Assume that the regression function from the left of the covariate support starts equal to zero and then changes at some unknown point. Our aim is to estimate this gradual change point. We define and compare various consistent estimators based on a new general optimization method in the case where the aim is to estimate the largest minimization point of some objective function. We discuss rates of convergence and estimating the regression function based on the gradual change structure. Bootstrap bias approximation is discussed. Further applications in a two sample case are considered, where two continuous regression functions first equal and then change at some point of interest.

math.ST↗

arXiv2025

Goodness-of-fit testing for the error distribution in functional linear models

We consider the error distribution in functional linear models with scalar response and functional covariate. Different asymptotic expansions of the empirical distribution function and the empirical characteristic function based on estimated residuals under different model assumptions are discussed. The results are applied for simple and composite goodness-of-fit testing for the error distribution, in particular testing for normal distribution.

stat.ME↗

arXiv2024

Testing for changes in the error distribution in functional linear models

We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those estimated functions are more challenging in models with infinite-dimensional covariates than in regression models with scalar or vector-valued covariates due to a slower rate of convergence of the parameter estimators. Yet the suggested change point test is asymptotically distribution-free and consistent for one-change point alternatives. In the latter case we also show consistency of a change point estimator.

math.ST↗

arXiv2023

Uniform convergence rates and automatic variable selection in nonparametric regression with functional and categorical covariates

In Selk and Gertheiss (2022) a nonparametric prediction method for models with multiple functional and categorical covariates is introduced. The dependent variable can be categorical (binary or multi-class) or continuous, thus both classification and regression problems are considered. In the paper at hand the asymptotic properties of this method are developed. A uniform rate of convergence for the regression / classification estimator is given. Further it is shown that, asymptotically, a data-driven least squares cross-validation method can automatically remove irrelevant, noise variables.

math.ST↗

arXiv2022

Nonparametric Regression and Classification with Functional, Categorical, and Mixed Covariates

We consider nonparametric prediction with multiple covariates, in particular categorical or functional predictors, or a mixture of both. The method proposed bases on an extension of the Nadaraya-Watson estimator where a kernel function is applied on a linear combination of distance measures each calculated on single covariates, with weights being estimated from the training data. The dependent variable can be categorical (binary or multi-class) or continuous, thus we consider both classification and regression problems. The methodology presented is illustrated and evaluated on artificial and real world data. Particularly it is observed that prediction accuracy can be increased, and irrelevant, noise variables can be identified/removed by `downgrading' the corresponding distance measures in a completely data-driven way.

stat.ME↗

arXiv2021

Multivariate boundary regression models

In this work, we consider a multivariate regression model with one-sided errors. We assume for the regression function to lie in a general Hölder class and estimate it via a nonparametric local polynomial approach that consists of minimization of the local integral of a polynomial approximation lying above the data points. While the consideration of multivariate covariates offers an undeniable opportunity from an application-oriented standpoint, it requires a new method of proof to replace the established ones for the univariate case. The main purpose of this paper is to show the uniform consistency and to provide the rates of convergence of the considered nonparametric estimator for both multivariate random covariates and multivariate deterministic design points. To demonstrate the performance of the estimators, the small sample behavior is investigated in a simulation study in dimension two and three.

math.ST↗

arXiv2019

Estimating change points in nonparametric time series regression models

In this paper we consider a regression model that allows for time series covariates as well as heteroscedasticity with a regression function that is modelled nonparametrically. We assume that the regression function changes at some unknown time $\lfloor ns_0\rfloor$, $s_0\in(0,1)$, and our aim is to estimate the (rescaled) change point $s_0$. The considered estimator is based on a Kolmogorov-Smirnov functional of the marked empirical process of residuals. We show consistency of the estimator and prove a rate of convergence of $O_P(n^{-1})$ which in this case is clearly optimal as there are only $n$ points in the sequence. Additionally we investigate the case of lagged dependent covariates, that is, autoregression models with a change in the nonparametric (auto-) regression function and give a consistency result. The method of proof also allows for different kinds of functionals such that Cramér-von Mises type estimators can be considered similarly. The approach extends existing literature by allowing nonparametric models, time series data as well as heteroscedasticity. Finite sample simulations indicate the good performance of our estimator in regression as well as autoregression models and a real data example shows its applicability in practise.

math.ST↗

arXiv2019

Semi-parametric transformation boundary regression models

In the context of nonparametric regression models with one-sided errors, we consider parametric transformations of the response variable in order to obtain independence between the errors and the covariates. We focus in this paper on stritcly increasing and continuous transformations. In view of estimating the tranformation parameter, we use a minimum distance approach and show the uniform consistency of the estimator under mild conditions. The boundary curve, i.e. the regression function, is estimated applying a smoothed version of a local constant approximation for which we also prove the uniform consistency. We deal with both cases of random covariates and deterministic (fixed) design points. To highlight the applicability of the procedures and to demonstrate their performance, the small sample behavior is investigated in a simulation study using the so-called Yeo-Johnson transformations.

math.ST↗

arXiv2016

Hypotheses tests in boundary regression models

Consider a nonparametric regression model with one-sided errors and regression function in a general Hölder class. We estimate the regression function via minimization of the local integral of a polynomial approximation. We show uniform rates of convergence for the simple regression estimator as well as for a smooth version. These rates carry over to mean regression models with a symmetric and bounded error distribution. In such a setting, one obtains faster rates for irregular error distributions concentrating sufficient mass near the endpoints than for the usual regular distributions. The results are applied to prove asymptotic $\sqrt{n}$-equivalence of a residual-based (sequential) empirical distribution function to the (sequential) empirical distribution function of unobserved errors in the case of irregular error distributions. This result is remarkably different from corresponding results in mean regression with regular errors. It can readily be applied to develop goodness-of-fit tests for the error distribution. We present some examples and investigate the small sample performance in a simulation study. We further discuss asymptotically distribution-free hypotheses tests for independence of the error distribution from the points of measurement and for monotonicity of the boundary function as well.

stat.ME↗

arXiv2016

Specification testing in nonparametric AR-ARCH models

In this paper an autoregressive time series model with conditional heteroscedasticity is considered, where both conditional mean and conditional variance function are modeled nonparametrically. A test for the model assumption of independence of innovations from past time series values is suggested. The test is based on an weighted $L^2$-distance of empirical characteristic functions. The asymptotic distribution under the null hypothesis of independence is derived and consistency against fixed alternatives is shown. A smooth autoregressive residual bootstrap procedure is suggested and its performance is shown in a simulation study.

math.ST↗

arXiv2015

Efficient estimation of functionals in nonparametric boundary models

For nonparametric regression with one-sided errors and a boundary curve model for Poisson point processes we consider the problem of efficient estimation for linear functionals. The minimax optimal rate is obtained by an unbiased estimation method which nevertheless depends on a Hölder condition or monotonicity assumption for the underlying regression or boundary function. We first construct a simple blockwise estimator and then build up a nonparametric maximum-likelihood approach for exponential noise variables and the point process model. In that approach also non-asymptotic efficiency is obtained (UMVU: uniformly minimum variance among all unbiased estimators).The proofs rely essentially on martingale stopping arguments for counting processes and the point process geometry. The estimators are easily computable and a small simulation study confirms their applicability.

math.ST↗

arXiv2012

A note on nonparametric testing for Gaussian innovations in AR-ARCH models

In this paper we consider autoregressive models with conditional autoregressive variance, including the case of homoscedastic AR-models and the case of ARCH models. Our aim is to test the hypothesis of normality for the innovations in a completely nonparametric way, i. e. without imposing parametric assumptions on the conditional mean and volatility functions. To this end the Cramér-von Mises test based on the empirical distribution function of nonparametrically estimated residuals is shown to be asymptotically distribution-free. We demonstrate its good performance for finite sample sizes in a simulation study.

stat.ME↗

arXiv2012

Testing for a change of the innovation distribution in nonparametric autoregression - the sequential empirical process approach

We consider a nonparametric autoregression model under conditional heteroscedasticity with the aim to test whether the innovation distribution changes in time. To this end we develop an asymptotic expansion for the sequential empirical process of nonparametrically estimated innovations (residuals). We suggest a Kolmogorov-Smirnov statistic based on the difference of the estimated innovation distributions built from the first ns and the last n-ns residuals, respectively. Weak convergence of the underlying stochastic process to a Gaussian process is proved under the null hypothesis of no change point. The result implies that the test is asymptotically distribution-free. Consistency against fixed alternatives is shown. The small sample performances of the proposed test is investigated in a simulation study and the test is applied to data examples.

stat.ME↗