Searcharxiv⌕ Search

arXiv subjects

Haoran Yan

Publications and source records attributed to Haoran Yan.

12 recordsLinked to original sources

A Geometric Understanding of Denoising Autoencoder with Applications to Image Denoising

Denoising autoencoders have shown strong empirical performance in recovering clean data from their noisy observations, yet their underlying statistical behavior remains underexplored. In this paper, we study denoising autoencoders under the manifold hypothesis, assuming that clean data are supported on low-dimensional smooth manifolds embedded in a high-dimensional ambient space, while noisy observations are generated by isotropic Gaussian noise. We establish generalization guarantees in three geometric scenarios: a single manifold, a pairwise separated finite union of manifolds, and a finite union of intersecting manifolds. Using local chart representations, partitions of unity, and neural network approximation, we derive upper bounds for the expected squared reconstruction error for denoising autoencoder. In the single-manifold and separated-union scenarios, the error consists of a sample-dependent statistical term of order $n^{-2/(d+2)}\log^4 n$, a residual term of order $dσ^2/D$ caused by tangential noise, and an exponentially small tail term associated with failure of the manifold projection. Here $D$ is the data ambient dimension, $d$ is the intrinsic dimension of the clean-data manifold, and $σ^2$ is the expected squared noise magnitude. In the scenario of intersecting manifolds, we further identify an additional ambiguity term determined by the probability mass near the intersection neighborhood. Numerical experiments on synthetic manifolds and real image datasets support the predicted sample-size scaling law and illustrate the additional reconstruction ambiguity near manifold intersections.

stat.ML↗

Neural Scaling Laws of Transformer Operator Network

Transformers have emerged as powerful architectures for learning solution operators of physical systems. Empirically the prediction error has been observed to decrease when the data size and model size increase, suggesting neural scaling behavior. Yet a theoretical understanding of such scaling laws for transformer-based operator learning remains limited. In this work, we develop a theoretical framework for characterizing the approximation and generalization errors of transformer-based operator learning. Our analysis builds on a local-to-global approximation principle that is naturally aligned with the softmax attention mechanism and yields discretization-invariant output functions. On approximation theory, we derive a universal approximation error of transformer-based operator learning for Hölder-regular operators. On generalization theory, we establish a power scaling law between the prediction error and the training data size. The rate of convergence represented by the scaling exponent explicitly reflects the dimensions of the input and output domains, the regularity of the underlying functions and operators, and crucially, the intrinsic dimension of the input function class. By exploiting this intrinsic low-dimensional structure, our analysis yields a power-law generalization rate for operator learning, in contrast to the logarithmic-type power-law rates appearing in existing analyses of operator learning with feedforward neural networks. Numerical experiments validate the predicted power-law scaling and confirm that the convergence rate varies systematically with the intrinsic dimension of the input function class.

stat.ML↗

Injected and Leaked: Actively Inducing Side-Channel Leakage Using Electromagnetic Injection and Hardware Nonlinearity

Electromagnetic (EM) side-channel leakage and injection are typically treated as distinct physical phenomena, threatening data confidentiality and integrity respectively. This work investigates how EM injection can be used to amplify side-channel leakage that is otherwise infeasible. We introduce a novel framework for Injection-Induced EM Side Channels to enable integrated, closed-loop EM security analysis. Our theoretical modeling and experimental measurements reveal that nonlinear hardware components, such as ubiquitous amplifiers, analog-to-digital converters, and power converters, can modulate secret electrical signals onto an injected EM carrier and thus upconvert low-frequency secrets into measurable EM emissions. By tuning the injection frequency and amplitude, adversaries gain the ability to actively shape the effective spectrum and entropy of the resulting leakage. We design InjectEave attack and demonstrate eavesdropping on the audio played through wired and wireless headphones from up to 30 m away with accessible RF equipment, as well as in through-wall scenarios, and characterize injection-induced EM leakage of other low-frequency secrets such as power consumption of smart home devices and analog sensor inputs. Case studies further demonstrate how the proposed techniques enable closed-loop eavesdropping and manipulation of landline-phone conversations. Finally, we analyze the broader security challenges and mitigations.

cs.CR↗

Logit Distillation on Manifolds: Mapping by Learning

A simple way to improve the performance of almost any machine learning model is not to train a single but several models with diverse algorithms which will make slightly distinct kinds of predictions and errors on the same data, and thus improve the average predictions and robustness. However, making predictions using a whole ensemble of models is cumbersome and computationally too expensive to allow deployment to a large number of users, especially if the models are large neural nets. In response to this, we introduce a layer and point wise projection mapping, which maps student and teacher representations into an aligned high-dimensional embedding space during training process. The proposed approach combined with LoRA injection reduces the student model trainable parameters to less than 1% of the teacher model, while significantly improving word error rate (WER) compared to other distillation methods, as demonstrated in ablation studies. Unlike a mixture of experts, our method can be trained rapidly and in parallel.

cs.LG↗

Unsupervised cell segmentation by fast Gaussian Processes

Cell boundary information is crucial for analyzing cell behaviors from time-lapse microscopy videos. Existing supervised cell segmentation tools, such as ImageJ, require tuning various parameters and rely on restrictive assumptions about the shape of the objects. While recent supervised segmentation tools based on convolutional neural networks enhance accuracy, they depend on high-quality labeled images, making them unsuitable for segmenting new types of objects not in the database. We developed a novel unsupervised cell segmentation algorithm based on fast Gaussian processes for noisy microscopy images without the need for parameter tuning or restrictive assumptions about the shape of the object. We derived robust thresholding criteria adaptive for heterogeneous images containing distinct brightness at different parts to separate objects from the background, and employed watershed segmentation to distinguish touching cell objects. Both simulated studies and real-data analysis of large microscopy images demonstrate the scalability and accuracy of our approach compared with the alternatives.

stat.AP↗

An Empirical Study of Production Incidents in Generative AI Cloud Services

The ever-increasing demand for generative artificial intelligence (GenAI) has motivated cloud-based GenAI services such as Azure OpenAI Service and Amazon Bedrock. Like any large-scale cloud service, failures are inevitable in cloud-based GenAI services, resulting in user dissatisfaction and significant monetary losses. However, GenAI cloud services, featured by their massive parameter scales, hardware demands, and usage patterns, present unique challenges, including generated content quality issues and privacy concerns, compared to traditional cloud services. To understand the production reliability of GenAI cloud services, we analyzed production incidents from a leading GenAI cloud service provider spanning in the past four years. Our study (1) presents the general characteristics of GenAI cloud service incidents at different stages of the incident life cycle; (2) identifies the symptoms and impacts of these incidents on GenAI cloud service quality and availability; (3) uncovers why these incidents occurred and how they were resolved; (4) discusses open research challenges in terms of incident detection, triage, and mitigation, and sheds light on potential solutions.

cs.DC↗

Dynamical Approach to Realize Room-Temperature Superconductivity in LaH$_{10}$

Metallic hydrogen and hydride materials stand as promising avenues to achieve room-temperature superconductivity. Characterized by their high phonon frequencies and moderate coupling strengths, several high-pressure hydrides were theoretically predicted to exhibit transition temperatures ($T_c$) exceeding 250\,K, a claim further substantiated by experimental evidence. In an effort to push $T_c$ beyond room temperature, we introduce a dynamical method that involves stimulating hydrides with mid-infrared lasers. Employing Floquet first-principles simulations, we observe that in a nonequilibrium state induced by light, both the electronic density of states and the coupling to high-energy phonons see notable enhancements. These simultaneous improvements collectively result in an estimated 20\%-30\% rise in $T_c$ in practical pump conditions. Our theoretical investigation, therefore, offers a novel strategy to potentially raise the $T_c$ of hydrides above room temperature.

cond-mat.supr-con↗

HAUR: Human Annotation Understanding and Recognition Through Text-Heavy Images

Vision Question Answering (VQA) tasks use images to convey critical information to answer text-based questions, which is one of the most common forms of question answering in real-world scenarios. Numerous vision-text models exist today and have performed well on certain VQA tasks. However, these models exhibit significant limitations in understanding human annotations on text-heavy images. To address this, we propose the Human Annotation Understanding and Recognition (HAUR) task. As part of this effort, we introduce the Human Annotation Understanding and Recognition-5 (HAUR-5) dataset, which encompasses five common types of human annotations. Additionally, we developed and trained our model, OCR-Mix. Through comprehensive cross-model comparisons, our results demonstrate that OCR-Mix outperforms other models in this task. Our dataset and model will be released soon .

cs.CV↗

Strong Inter-valley Electron-Phonon Coupling in Magic-Angle Twisted Bilayer Graphene

The unusual properties of superconductivity in magic-angle twisted bilayer graphene (MATBG) have sparked enormous research interest. However, despite the dedication of intensive experimental efforts and the proposal of several possible pairing mechanisms, the origin of its superconductivity remains elusive. Here, utilizing angle-resolved photoemission spectroscopy with micrometer spatial resolution, we have revealed flat band replicas in superconducting MATBG, where MATBG is unaligned with its hexagonal boron nitride (hBN) substrate11. These replicas exhibit uniform energy spacing, approximately 150 +- 15 meV apart, indicative of strong electron-boson coupling. Strikingly, these replicas are absent in non-superconducting twisted bilayer graphene (TBG) systems, either when MATBG is aligned to hBN or when TBG deviates from the magic angle. Calculations suggest that the formation of these flat band replicas in superconducting MATBG are attributed to the strong coupling between flat band electrons and an optical phonon mode at the graphene K point, facilitated by inter-valley scattering. These findings, although do not necessarily put electron phonon coupling as the main driving force for the superconductivity in MATBG, unravel the unique electronic structure inherent in superconducting MATBG, thereby providing crucial information for understanding the unusual electronic landscape from which the superconductivity is derived.

cond-mat.mes-hall↗

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

With the development of artificial intelligence (AI), large language models (LLM) are widely used in many fields. However, the reasoning ability of LLM is still very limited when it comes to mathematical reasoning. Mathematics plays an important role in all aspects of human society and is a technical guarantee in the fields of healthcare, transport and aerospace, for this reason, the development of AI big language models in the field of mathematics has great potential significance. To improve the mathematical reasoning ability of large language models, we proposed an agent framework for learning to solve mathematical problems based on inductive reasoning. By emulating the human learning process of generalization of learned information and effective application of previous knowledge in new reasoning tasks, this framework has great performance in the mathematical reasoning process. It improves global accuracy over the baseline method (chain-of-thought) by 20.96% and solves 17.54% of the mathematical problems that the baseline cannot solve. Benefiting from the efficient RETRIEVAL method, our model improves the ability of large language models to efficiently use external knowledge, i.e., the mathematical computation of the model can be based on written procedures. In education, our model can be used as a personalised learning aid, thus reducing the inequality of educational resources.

cs.CL↗

Lovasz' Conjecture and Other Applications of Topological Methods in Discrete Mathematics

In 20th century mathematics, the field of topology, which concerns the properties of geometric objects under continuous transformation, has proved surprisingly useful in application to the study of discrete mathematics, such as combinatorics, graph theory, and theoretical computer science. In this paper, we seek to provide an introduction to the relevant topological concepts to non-specialists, as well as a selection of some existing applications to theorems in discrete mathematics.

math.HO↗

A Hybrid Quantum-Classical Method for Electron-Phonon Systems

Interactions between electrons and phonons play a crucial role in quantum materials. Yet, there is no universal method that would simultaneously accurately account for strong electron-phonon interactions and electronic correlations. By combining methods of the variational quantum eigensolver and the variational non-Gaussian solver, we develop a hybrid quantum-classical algorithm suitable for this type of correlated systems. This hybrid method tackles systems with arbitrarily strong electron-phonon coupling without increasing the number of required qubits and quantum gates, as compared to purely electronic models. We benchmark the new method by applying it to the paradigmatic Hubbard-Holstein model at half filling, and show that it correctly captures the competition between charge density wave and antiferromagnetic phases, quantitatively consistent with exact diagonalization.

cond-mat.str-el↗