SearcharxivSearch

arXiv subjects

Ting Wei

Publications and source records attributed to Ting Wei.

8 recordsLinked to original sources

Distributed Prediction under Heterogeneity with Unidentifiable Parameter

Predicting a response based on covariates is a fundamental problem in statistics and machine learning. However, profound difficulties arise when the underlying low-dimensional structural parameters are unidentifiable, as typified in dimension reduction contexts. Specifically,estimating these non-identifiable parameters inherently introduces severe nonconvexity. In distributed settings, this difficulty is further compounded by the challenges of data heterogeneity and communication cost. To overcome these intertwined barriers, we propose a novel distributed semiparametric framework. We formulate an adaptive homogeneity pursuit utilizing a trace-similarity penalty to effectively address data heterogeneity. To resolve the ensuing severe nonconvexity and communication bottlenecks, we introduce an invex relaxation technique coupled with a multi-step local update algorithm, ensuring stable convergence to global optimality with significantly reduced communication overhead. Theoretically, we establish a non-asymptotic model-free prediction error bound and prove that our estimator achieves a two-phase minimax optimal convergence rate and an sharper model-free prediction error bound. Furthermore, we provide theoretical guarantees for algorithmic convergence and communication efficiency. Extensive simulations and a real-world multi-center medical application validate the superiority of our method.

stat.ME

Ill-Posedness in Limited Discrete Fourier Inversion and Regularization for Quasi Distributions in LaMET

We systematically investigated the limited inverse discrete Fourier transform of the quasi distributions from the perspective of inverse problem theory. This transformation satisfies two of Hadamard's well-posedness criteria, existence and uniqueness of solutions, but critically violates the stability requirement, exhibiting exponential sensitivity to input perturbations. To address this instability, we implemented Tikhonov regularization with L-curve optimized parameters, demonstrating its validity for controlled toy model studies and real lattice QCD results of quasi distribution amplitudes. The reconstructed solutions is consistent with the physics-driven $\lambda$-extrapolation method. Our analysis demonstrates that the inverse Fourier problem within the large-momentum effective theory (LaMET) framework belongs to a class of moderately tractable ill-posed problems, characterized by distinct spectral properties that differ from those of more severely unstable inverse problems encountered in other lattice QCD applications. Tikhonov regularization establishes a rigorous mathematical framework for addressing the underlying instability, enabling first-principles uncertainty quantification without relying on ansatz-based assumptions.

hep-lat

Personalized Bayesian Federated Learning with Wasserstein Barycenter Aggregation

Personalized Bayesian federated learning (PBFL) handles non-i.i.d. client data and quantifies uncertainty by combining personalization with Bayesian inference. However, existing PBFL methods face two limitations: restrictive parametric assumptions in client posterior inference and naive parameter averaging for server aggregation. To overcome these issues, we propose FedWBA, a novel PBFL method that enhances both local inference and global aggregation. At the client level, we use particle-based variational inference for nonparametric posterior representation. At the server level, we introduce particle-based Wasserstein barycenter aggregation, offering a more geometrically meaningful approach. Theoretically, we provide local and global convergence guarantees for FedWBA. Locally, we prove a KL divergence decrease lower bound per iteration for variational inference convergence. Globally, we show that the Wasserstein barycenter converges to the true parameter as the client data size increases. Empirically, experiments show that FedWBA outperforms baselines in prediction accuracy, uncertainty calibration, and convergence rate, with ablation studies confirming its robustness.

cs.LG

VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence

We present VisionFM, a foundation model pre-trained with 3.4 million ophthalmic images from 560,457 individuals, covering a broad range of ophthalmic diseases, modalities, imaging devices, and demography. After pre-training, VisionFM provides a foundation to foster multiple ophthalmic artificial intelligence (AI) applications, such as disease screening and diagnosis, disease prognosis, subclassification of disease phenotype, and systemic biomarker and disease prediction, with each application enhanced with expert-level intelligence and accuracy. The generalist intelligence of VisionFM outperformed ophthalmologists with basic and intermediate levels in jointly diagnosing 12 common ophthalmic diseases. Evaluated on a new large-scale ophthalmic disease diagnosis benchmark database, as well as a new large-scale segmentation and detection benchmark database, VisionFM outperformed strong baseline deep neural networks. The ophthalmic image representations learned by VisionFM exhibited noteworthy explainability, and demonstrated strong generalizability to new ophthalmic modalities, disease spectrum, and imaging devices. As a foundation model, VisionFM has a large capacity to learn from diverse ophthalmic imaging data and disparate datasets. To be commensurate with this capacity, in addition to the real data used for pre-training, we also generated and leveraged synthetic ophthalmic imaging data. Experimental results revealed that synthetic data that passed visual Turing tests, can also enhance the representation learning capability of VisionFM, leading to substantial performance gains on downstream ophthalmic AI tasks. Beyond the ophthalmic AI applications developed, validated, and demonstrated in this work, substantial further applications can be achieved in an efficient and cost-effective manner using VisionFM as the foundation.

eess.IV

Influence Maximization based on Simplicial Contagion Models in Hypergraphs

In recent years, the exploration of node centrality has received significant attention and extensive investigation, primarily fuelled by its applications in diverse domains such as product recommendations, opinion propagation, disease spread, and other scenarios requiring the maximization of node influence. Despite various perspectives emphasizing the indispensability of higher-order networks, research specifically delving into node centrality within the realm of hypergraphs has been relatively constrained. This paper focuses on the problem of influence maximization on the Simplicial Contagion Model (SCM), using the susceptible-infected-recovered (SIR) model as an example. To find practical solutions to this optimization problem, we have developed a theoretical framework based on message passing process and conducted stability analysis of equilibrium solutions for the self-consistent equations. Furthermore, we introduce a metric called collective influence and propose an adaptive algorithm, known as the Collective Influence Adaptive (CIA), to identify influential propagators in the spreading process. Notably, our algorithm distinguishes itself by prioritizing collective influence over individual influence, resulting in demonstrably superior performance, a characteristic substantiated by a comprehensive array of experiments.

cs.SI

Inverse Problem Approach for Non-Perturbative QCD: Theoretical Foundation

A novel theoretical framework, the inverse problem approach, is proposed to calculate non-perturbative quantities in quantum chromodynamics (QCD). Based on the dispersion relation of quantum field theory, this approach determines unknown low-energy non-perturbative quantities from known high-energy perturbative inputs via solving an inverse problem. The resulting inverse problem is rigorously proven to be ill-posed, with the solutions being unique but unstable. To address this instability, the well-established Tikhonov regularization is employed, yielding stable approximate solutions that converge to the true values as input errors vanish. The key features of this approach are illustrated through three toy models, demonstrating that solution precision can be systematically improved through reduced input errors and optimized regularization strategies.

hep-th

A Joint Model for Aspect-Category Sentiment Analysis with Shared Sentiment Prediction Layer

Aspect-category sentiment analysis (ACSA) aims to predict the aspect categories mentioned in texts and their corresponding sentiment polarities. Some joint models have been proposed to address this task. Given a text, these joint models detect all the aspect categories mentioned in the text and predict the sentiment polarities toward them at once. Although these joint models obtain promising performances, they train separate parameters for each aspect category and therefore suffer from data deficiency of some aspect categories. To solve this problem, we propose a novel joint model which contains a shared sentiment prediction layer. The shared sentiment prediction layer transfers sentiment knowledge between aspect categories and alleviates the problem caused by data deficiency. Experiments conducted on SemEval-2016 Datasets demonstrate the effectiveness of our model.

cs.CL