SearcharxivSearch

arXiv subjects

Yanhang Zhang

Publications and source records attributed to Yanhang Zhang.

11 recordsLinked to original sources

A Unified Descriptive-Complexity Framework for Model Selection under Correlated Designs

Model selection becomes particularly challenging under strong predictor dependence and model-class uncertainty, especially when there are exponentially many models. We propose a Descriptive-Complexity Information Criterion (DCIC) that regularizes large candidate model collections through Kraft-admissible code lengths. Under sub-Weibull noise, we establish selection consistency through approximation-error separation without relying on RIP-type conditions, together with nonasymptotic oracle risk bounds that remain valid under model misspecification. The same coding principle places heterogeneous classes on a common complexity scale at a small additional class-identification cost. This extension yields class--model recovery under suitable identifiability conditions and risk adaptation across classes. We further develop a complexity-guided search path that makes the computation--statistics trade-off explicit. Large penalties yield polynomial-size retained search regions with high probability, whereas smaller penalties sharpen the oracle risk benchmark. Numerical experiments illustrate stable support recovery and favorable estimation performance under strong dependence and model-class uncertainty.

stat.ML

Comprehensive characterization of nonlinear viscoelastic properties of arterial tissues using guided-wave optical coherence elastography

The mechanical properties of arterial walls are critical for maintaining vascular function under pulsatile pressure and are closely linked to the development of cardiovascular diseases. Despite advances in imaging and elastography, comprehensive characterization of the complex mechanical behavior of arterial tissues remains challenging. Here, we present a broadband guided-wave optical coherence elastography (OCE) technique, grounded in viscoelasto-acoustic theory, for quantifying the nonlinear viscoelastic, anisotropic, and layer-specific properties of arterial walls with high spatial and temporal resolution. Our results reveal a strong stretch dependence of arterial viscoelasticity, with increasing prestress leading to a reduction in tissue viscosity. Under mechanical loading, the adventitia becomes significantly stiffer than the media, attributable to engagement of collagen fibers. Chemical degradation of collagen fibers highlighted their role in nonlinear viscoelasticity. This study demonstrates the potential of OCE as a powerful tool for detailed profiling of vascular biomechanics, with applications in basic research and future clinical diagnosis.

physics.bio-ph

Learning Joint Graphical Model with Computational Efficiency, Dynamic Regularization, and Adaptation

Multi-sourced datasets are common in studies of variable interactions, for example, individual-level fMRI integration, cross-domain recommendation, etc, where each source induces a related but distinct dependency structure. Joint learning of multiple graphical models (i.e., multiple precision matrices) has emerged as an important tool in analyzing such data. Unlike separate learning, joint learning can leverage shared structural patterns across graphs to yield more accurate results. In this paper, we present an efficient and adaptive method named MIGHT (\textbf{M}ulti-task \textbf{I}terative \textbf{G}raphical \textbf{H}ard \textbf{T}hresholding) to estimate multiple graphs jointly. We reformulate the joint model into a series of multi-task learning problems through a column-by-column manner, and solve these problems using a dynamic regularized algorithm based on iterative hard thresholding. This framework is inherently parallelizable and therefore efficient in computation. Theoretically, we derive the non-asymptotic error bound for the resulting estimator. Furthermore, the proposed algorithm is adaptive to heterogeneous column-wise signal strengths: for nodes with strong signals, our estimator achieves improved error bounds and selection consistency adaptively, and also exhibits asymptotic normality -- properties rarely explored in existing joint learning methods. The performance of our method is illustrated through numerical simulations and real data analysis on a cancer gene-expression RNA-seq dataset.

stat.ME

Exact recovery in the double sparse model: sufficient and necessary signal conditions

The double sparse linear model, which has both group-wise and element-wise sparsity in regression coefficients, has attracted lots of attention recently. This paper establishes the sufficient and necessary relationship between the exact support recovery and the optimal minimum signal conditions in the double sparse model. Specifically, sharply under the proposed signal conditions, a two-stage double sparse iterative hard thresholding procedure achieves exact support recovery with a suitably chosen threshold parameter. Also, this procedure maintains asymptotic normality aligning with an OLS estimator given true support, hence holding the oracle properties. Conversely, we prove that no method can achieve exact support recovery if these signal conditions are violated. This fills a critical gap in the minimax optimality theory on support recovery of the double sparse model. Finally, numerical experiments are provided to support our theoretical findings.

math.ST

Rethinking Hard Thresholding Pursuit: Full Adaptation and Sharp Estimation

Hard Thresholding Pursuit (HTP) has aroused increasing attention for its robust theoretical guarantees and impressive numerical performance in non-convex optimization. In this paper, we introduce a novel tuning-free procedure, named Full-Adaptive HTP (FAHTP), that simultaneously adapts to both the unknown sparsity and signal strength of the underlying model. We provide an in-depth analysis of the iterative thresholding dynamics of FAHTP, offering refined theoretical insights. In specific, under the beta-min condition $\min_{i \in S^*}|{\boldsymbol{\beta}}^*_i| \ge C\sigma (\log p/n)^{1/2}$, we show that the FAHTP achieves oracle estimation rate $\sigma (s^*/n)^{1/2}$, highlighting its theoretical superiority over convex competitors such as LASSO and SLOPE, and recovers the true support set exactly. More importantly, even without the beta-min condition, our method achieves a tighter error bound than the classical minimax rate with high probability. The comprehensive numerical experiments substantiate our theoretical findings, underscoring the effectiveness and robustness of the proposed FAHTP.

math.ST

Sharp minimax optimality of LASSO and SLOPE under double sparsity assumption

This paper introduces a rigorous approach to establish the sharp minimax optimalities of both LASSO and SLOPE within the framework of double sparse structures, notably without relying on RIP-type conditions. Crucially, our findings illuminate that the achievement of these optimalities is fundamentally anchored in a sparse group normalization condition, complemented by several novel sparse group restricted eigenvalue (RE)-type conditions introduced in this study. We further provide a comprehensive comparative analysis of these eigenvalue conditions. Furthermore, we demonstrate that these conditions hold with high probability across a wide range of random matrices. Our exploration extends to encompass the random design, where we prove the random design properties and optimal sample complexity under both weak moment distribution and sub-Gaussian distribution.

math.ST

Minimax Rates for High-dimensional Double Sparse Structure over $\ell_u(\ell_q)$-balls

In this paper, we focus on the high-dimensional double sparse structure, where the parameter of interest simultaneously encourages group-wise sparsity and element-wise sparsity in each group. By combining the Gilbert-Varshamov bound and its variants, we develop a novel lower bound technique for the metric entropy of the parameter space, specifically tailored for the double sparse structure over $\ell_u(\ell_q)$-balls with $u,q \in [0,1]$. We prove lower bounds on the estimation error using an information-theoretic approach, leveraging our proposed lower bound technique and Fano's inequality. To complement the lower bounds, we establish matching upper bounds through a direct analysis of constrained least-squares estimators and utilize results from empirical processes. A significant finding of our study is the discovery of a phase transition phenomenon in the minimax rates for $u,q \in (0, 1]$. Furthermore, we extend the theoretical results to the double sparse regression model and determine its minimax rate for estimation error. To tackle double sparse linear regression, we develop the DSIHT (Double Sparse Iterative Hard Thresholding) algorithm, demonstrating its optimality in the minimax sense. Finally, we demonstrate the superiority of our method through numerical experiments.

math.ST

A minimax optimal approach to high-dimensional double sparse linear regression

In this paper, we focus our attention on the high-dimensional double sparse linear regression, that is, a combination of element-wise and group-wise sparsity. To address this problem, we propose an IHT-style (iterative hard thresholding) procedure that dynamically updates the threshold at each step. We establish the matching upper and lower bounds for parameter estimation, showing the optimality of our proposal in the minimax sense. More importantly, we introduce a fully adaptive optimal procedure designed to address unknown sparsity and noise levels. Our adaptive procedure demonstrates optimal statistical accuracy with fast convergence. Additionally, we elucidate the significance of the element-wise sparsity level $s_0$ as the trade-off between IHT and group IHT, underscoring the superior performance of our method over both. Leveraging the beta-min condition, we establish that our IHT-style procedure can attain the oracle estimation rate and achieve almost full recovery of the true support set at both the element level and group level. Finally, we demonstrate the superiority of our method by comparing it with several state-of-the-art algorithms on both synthetic and real-world datasets.

math.ST

A Splicing Approach to Best Subset of Groups Selection

Best subset of groups selection (BSGS) is the process of selecting a small part of non-overlapping groups to achieve the best interpretability on the response variable. It has attracted increasing attention and has far-reaching applications in practice. However, due to the computational intractability of BSGS in high-dimensional settings, developing efficient algorithms for solving BSGS remains a research hotspot. In this paper,we propose a group-splicing algorithm that iteratively detects the relevant groups and excludes the irrelevant ones. Moreover, coupled with a novel group information criterion, we develop an adaptive algorithm to determine the optimal model size. Under mild conditions, it is certifiable that our algorithm can identify the optimal subset of groups in polynomial time with high probability. Finally, we demonstrate the efficiency and accuracy of our methods by comparing them with several state-of-the-art algorithms on both synthetic and real-world datasets.

cs.LG

abess: A Fast Best Subset Selection Library in Python and R

We introduce a new library named abess that implements a unified framework of best-subset selection for solving diverse machine learning problems, e.g., linear regression, classification, and principal component analysis. Particularly, the abess certifiably gets the optimal solution within polynomial times with high probability under the linear model. Our efficient implementation allows abess to attain the solution of best-subset selection problems as fast as or even 20x faster than existing competing variable (model) selection toolboxes. Furthermore, it supports common variants like best group subset selection and $\ell_2$ regularized best-subset selection. The core of the library is programmed in C++. For ease of use, a Python library is designed for conveniently integrating with scikit-learn, and it can be installed from the Python library Index. In addition, a user-friendly R library is available at the Comprehensive R Archive Network. The source code is available at: https://github.com/abess-team/abess.

stat.ML

V-Doc : Visual questions answers with Documents

We propose V-Doc, a question-answering tool using document images and PDF, mainly for researchers and general non-deep learning experts looking to generate, process, and understand the document visual question answering tasks. The V-Doc supports generating and using both extractive and abstractive question-answer pairs using documents images. The extractive QA selects a subset of tokens or phrases from the document contents to predict the answers, while the abstractive QA recognises the language in the content and generates the answer based on the trained model. Both aspects are crucial to understanding the documents, especially in an image format. We include a detailed scenario of question generation for the abstractive QA task. V-Doc supports a wide range of datasets and models, and is highly extensible through a declarative, framework-agnostic platform.

cs.AI