arXiv subjects

Jinhong You

Publications and source records attributed to Jinhong You.

13 recordsLinked to original sources

arXiv2026

FreDN: Spectral Disentanglement for Time Series Forecasting via Learnable Frequency Decomposition

Time series forecasting is essential in a wide range of real world applications. Recently, frequency-domain methods have attracted increasing interest for their ability to capture global dependencies. However, when applied to non-stationary time series, these methods encounter the $\textit{spectral entanglement}$ and the computational burden of complex-valued learning. The $\textit{spectral entanglement}$ refers to the overlap of trends, periodicities, and noise across the spectrum due to $\textit{spectral leakage}$ and the presence of non-stationarity. However, existing decompositions are not suited to resolving spectral entanglement. To address this, we propose the Frequency Decomposition Network (FreDN), which introduces a learnable Frequency Disentangler module to separate trend and periodic components directly in the frequency domain. Furthermore, we propose a theoretically supported ReIm Block to reduce the complexity of complex-valued operations while maintaining performance. We also re-examine the frequency-domain loss function and provide new theoretical insights into its effectiveness. Extensive experiments on seven long-term forecasting benchmarks demonstrate that FreDN outperforms state-of-the-art methods by up to 10\%. Furthermore, compared with standard complex-valued architectures, our real-imaginary shared-parameter design reduces the parameter count and computational cost by at least 50\%.

stat.ML↗

arXiv2025

Convolution-smoothing based locally sparse estimation for functional quantile regression

Motivated by an application to study the impact of temperature, precipitation and irrigation on soybean yield, this article proposes a sparse semi-parametric functional quantile model. The model is called ``sparse'' because the functional coefficients are only nonzero in the local time region where the functional covariates have significant effects on the response under different quantile levels. To tackle the computational and theoretical challenges in optimizing the quantile loss function added with a concave penalty, we develop a novel Convolution-smoothing based Locally Sparse Estimation (CLoSE) method, to do three tasks in one step, including selecting significant functional covariates, identifying the nonzero region of functional coefficients to enhance the interpretability of the model and estimating the functional coefficients. We establish the functional oracle properties and simultaneous confidence bands for the estimated functional coefficients, along with the asymptotic normality for the estimated parameters. In addition, because it is difficult to estimate the conditional density function given the scalar and functional covariates, we propose the split wild bootstrap method to construct the confidence interval of the estimated parameters and simultaneous confidence band for the functional coefficients. We also establish the consistency of the split wild bootstrap method. The finite sample performance of the proposed CLoSE method is assessed with simulation studies. The proposed model and estimation procedure are also illustrated by identifying the active time regions when the daily temperature influences the soybean yield.

stat.ME↗

arXiv2025

SID: A Novel Class of Nonparametric Tests of Independence for Censored Outcomes

We propose a new class of metrics, called the survival independence divergence (SID), to test dependence between a right-censored outcome and covariates. A key technique for deriving the SIDs is to use a counting process strategy, which equivalently transforms the intractable independence test due to the presence of censoring into a test problem for complete observations. The SIDs are equal to zero if and only if the right-censored response and covariates are independent, and they are capable of detecting various types of nonlinear dependence. We propose empirical estimates of the SIDs and establish their asymptotic properties. We further develop a wild bootstrap method to estimate the critical values and show the consistency of the bootstrap tests. The numerical studies demonstrate that our SID-based tests are highly competitive with existing methods in a wide range of settings.

stat.ME↗

arXiv2025

Two Sample Testing for High-dimensional Functional Data: A Multi-resolution Projection Method

It is of great interest to test the equality of the means in two samples of functional data. Past research has predominantly concentrated on low-dimensional functional data, a focus that may not hold up in high-dimensional scenarios. In this article, we propose a novel two-sample test for the mean functions of high-dimensional functional data, employing a multi-resolution projection (MRP) method. We establish the asymptotic normality of the proposed MRP test statistic and investigate its power performance when the dimension of the functional variables is high. In practice, functional data are observed only at discrete and usually asynchronous points. We further explore the influence of function reconstruction on our test statistic theoretically. Finally, we assess the finite-sample performance of our test through extensive simulation studies and demonstrate its practicality via two real data applications. Specifically, our analysis of global climate data uncovers significant differences in the functional means of climate variables in the years 2020-2069 when comparing intermediate greenhouse gas emission pathways (e.g., RCP4.5) to high greenhouse gas emission pathways (e.g., RCP8.5).

stat.ME↗

arXiv2025

Similarity-Informed Transfer Learning for Multivariate Functional Censored Quantile Regression

To address the challenge of utilizing patient data from other organ transplant centers (source cohorts) to improve survival time estimation and inference for a target center (target cohort) with limited samples and strict data-sharing privacy constraints, we propose the Similarity-Informed Transfer Learning (SITL) method. This approach estimates multivariate functional censored quantile regression by flexibly leveraging information from each source cohort based on its similarity to the target cohort. Furthermore, the method is adaptable to continuously updated real-time data. We establish the asymptotic properties of the estimators obtained using the SITL method, demonstrating improved convergence rates. Additionally, we develop an enhanced approach that combines the SITL method with a resampling technique to construct more accurate confidence intervals for functional coefficients, backed by theoretical guarantees. Extensive simulation studies and an application to kidney transplant data illustrate the significant advantages of the SITL method. Compared to methods that rely solely on the target cohort or indiscriminately pool data across source and target cohorts, the SITL method substantially improves both estimation and inference performance.

stat.ME↗

arXiv2025

Change-plane analysis in functional response quantile regression

Change-plane analysis is a pivotal tool for identifying subgroups within a heterogeneous population, yet it presents challenges when applied to functional data. In this paper, we consider a change-plane model within the framework of functional response quantile regression, capable of identifying and testing subgroups in non-Gaussian functional responses with scalar predictors. The proposed model naturally extends the change-plane method to account for the heterogeneity in functional data. To detect the existence of subgroups, we develop a weighted average of the squared score test statistic, which has a closed form and thereby reduces the computational stress. An alternating direction method of multipliers algorithm is formulated to estimate the functional coefficients and the grouping parameters. We establish the asymptotic theory for the estimates based on the reproducing kernel Hilbert space and derive the asymptotic distributions of the proposed test statistic under both null and alternative hypotheses. Simulation studies are conducted to evaluate the performance of the proposed approach in subgroup identification and hypothesis test. The proposed methods are also applied to two datasets, one from a study on China stocks and another from the COVID-19 pandemic.

stat.ME↗

arXiv2025

Subgroup learning in functional regression models under the RKHS framework

Motivated by the inherent heterogeneity observed in many functional or imaging datasets, this paper focuses on subgroup learning in functional or image responses. While change-plane analysis has demonstrated empirical success in practice, the existing methodology is confined to scalar or longitudinal data. In this paper, we propose a novel framework for estimation, identifying, and testing the existence of subgroups in the functional or image response through the change-plane method. The asymptotic theories of the functional parameters are established based on the vector-valued Reproducing Kernel Hilbert Space (RKHS), and the asymptotic properties of the change-plane estimators are derived by a smoothing method since the objective function is nonconvex concerning the change-plane. A novel test statistic is proposed for testing the existence of subgroups, and its asymptotic properties are established under both the null hypothesis and local alternative hypotheses. Numerical studies have been conducted to elucidate the finite-sample performance of the proposed estimation and testing algorithms. Furthermore, an empirical application to the COVID-19 dataset is presented for comprehensive illustration.

stat.ME↗

arXiv2023

A Flexible and Parsimonious Modelling Strategy for Clustered Data Analysis

Statistical modelling strategy is the key for success in data analysis. The trade-off between flexibility and parsimony plays a vital role in statistical modelling. In clustered data analysis, in order to account for the heterogeneity between the clusters, certain flexibility is necessary in the modelling, yet parsimony is also needed to guard against the complexity and account for the homogeneity among the clusters. In this paper, we propose a flexible and parsimonious modelling strategy for clustered data analysis. The strategy strikes a nice balance between flexibility and parsimony, and accounts for both heterogeneity and homogeneity well among the clusters, which often come with strong practical meanings. In fact, its usefulness has gone beyond clustered data analysis, it also sheds promising lights on transfer learning. An estimation procedure is developed for the unknowns in the resulting model, and asymptotic properties of the estimators are established. Intensive simulation studies are conducted to demonstrate how well the proposed methods work, and a real data analysis is also presented to illustrate how to apply the modelling strategy and associated estimation procedure to answer some real problems arising from real life.

stat.ME↗

arXiv2021

Functional L-Optimality Subsampling for Massive Data

Massive data bring the big challenges of memory and computation for analysis. These challenges can be tackled by taking subsamples from the full data as a surrogate. For functional data, it is common to collect multiple measurements over their domains, which require even more memory and computation time when the sample size is large. The computation would be much more intensive when statistical inference is required through bootstrap samples. To the best of our knowledge, this article is the first attempt to study the subsampling method for the functional linear model. We propose an optimal subsampling method based on the functional L-optimality criterion. When the response is a discrete or categorical variable, we further extend our proposed functional L-optimality subsampling (FLoS) method to the functional generalized linear model. We establish the asymptotic properties of the estimators by the FLoS method. The finite sample performance of our proposed FLoS method is investigated by extensive simulation studies. The FLoS method is further demonstrated by analyzing two large-scale datasets: the global climate data and the kidney transplant data. The analysis results on these data show that the FLoS method is much better than the uniform subsampling approach and can well approximate the results based on the full data while dramatically reducing the computation time and memory.

stat.ME↗

arXiv2021

Individual Heterogeneity Learning in Distributional Data Response Additive Models

In many complex applications, data heterogeneity and homogeneity exist simultaneously. Ignoring either one will result in incorrect statistical inference. In addition, coping with complex data that are non-Euclidean becomes more common. To address these issues we consider a distributional data response additive model in which the response is a distributional density function and the individual effect curves are homogeneous within a group but heterogeneous across groups, the covariates capturing the variation share common additive bivariate functions. A transformation approach is first utilized to map density functions into a linear space. We then apply the B-spline series approximating method to estimate the unknown subject-specific and additive bivariate functions, and identify the latent group structures by hierarchical agglomerative clustering (HAC) algorithm. Our method is demonstrated to identify the true latent group structures with probability approaching one. To improve the efficiency, we further construct the backfitted local linear estimators for grouped structures and additive bivariate functions in post-grouping model. We establish the asymptotic properties of the resultant estimators including the convergence rates, asymptotic distributions and the post-grouping oracle efficiency. The performance of the proposed method is illustrated by simulation studies and empirical analysis with some interesting results.

stat.ME↗

arXiv2020

Unified statistical inference for a novel nonlinear dynamic functional/longitudinal data model

In light of recent work studying massive functional/longitudinal data, such as the resulting data from the COVID-19 pandemic, we propose a novel functional/longitudinal data model which is a combination of the popular varying coefficient (VC) model and additive model. We call it Semi-VCAM in which the response could be a functional/longitudinal variable, and the explanatory variables could be a mixture of functional/longitudinal and scalar variables. Notably some of the scalar variables could be categorical variables as well. The Semi-VCAM simultaneously allows for both substantial flexibility and the maintaining of one-dimensional rates of convergence. A local linear smoothing with the aid of an initial B spline series approximation is developed to estimate the unknown functional effects in the model. To avoid the subjective choice between the sparse and dense cases of the data, we establish the asymptotic theories of the resultant Pilot Estimation Based Local Linear Estimators (PEBLLE) on a unified framework of sparse, dense and ultra-dense cases of the data. Moreover, we construct unified consistent tests to justify whether a parsimony submodel is sufficient or not. These test methods also avoid the subjective choice between the sparse, dense and ultra dense cases of the data. Extensive Monte Carlo simulation studies investigating the finite sample performance of the proposed methodologies confirm our asymptotic results. We further illustrate our methodologies via analyzing the COVID-19 data from China and the CD4 data.

stat.ME↗

arXiv2016

Estimation and Model Identification of Locally Stationary Varying-Coefficient Additive Models

Nonparametric regression models with locally stationary covariates have received increasing interest in recent years. As a nice relief of "curse of dimensionality" induced by large dimension of covariates, additive regression model is commonly used. However, in locally stationary context, to catch the dynamic nature of regression function, we adopt a flexible varying-coefficient additive model where the regression function has the form $α_{0}\left(u\right)+\sum_{k=1}^{p}α_{k}\left(u\right)β_{k}\left(x_{k}\right).$ For this model, we propose a three-step spline estimation method for each univariate nonparametric function, and show its consistency and $L_{2}$ rate of convergence. Furthermore, based upon the three-step estimators, we develop a two-stage penalty procedure to identify pure additive terms and varying-coefficient terms in varying-coefficient additive model. As expected, we demonstrate that the proposed identification procedure is consistent, and the penalized estimators achieve the same $L_{2}$ rate of convergence as the polynomial spline estimators. Simulation studies are presented to illustrate the finite sample performance of the proposed three-step spline estimation method and two-stage model selection procedure.

math.ST↗

arXiv2012

Estimation for an additive growth curve model with orthogonal design matrices

An additive growth curve model with orthogonal design matrices is proposed in which observations may have different profile forms. The proposed model allows us to fit data and then estimate parameters in a more parsimonious way than the traditional growth curve model. Two-stage generalized least-squares estimators for the regression coefficients are derived where a quadratic estimator for the covariance of observations is taken as the first-stage estimator. Consistency, asymptotic normality and asymptotic independence of these estimators are investigated. Simulation studies and a numerical example are given to illustrate the efficiency and parsimony of the proposed model for model specifications in the sense of minimizing Akaike's information criterion (AIC).

math.ST↗