arXiv subjects

Ye Tian

Publications and source records attributed to Ye Tian.

At least 127 records · Page 7Linked to original sources

arXiv2025

MudiNet: Task-guided Disentangled Representation Learning for 5G Indoor Multipath-assisted Positioning

In the fifth-generation communication system (5G), multipath-assisted positioning (MAP) has emerged as a promising approach. With the enhancement of signal resolution, multipath component (MPC) are no longer regarded as noise but rather as valuable information that can contribute to positioning. However, existing research often treats reflective surfaces as ideal reflectors, while being powerless in the face of indistinguishable multipath caused by diffuse reflectors. This study approaches diffuse reflectors from the perspective of uncertainty, investigating the statistical distribution characteristics of indoor diffuse and specular reflectors. Based on these insights, a task-guided disentangled representation learning method leveraging multi-time channel impulse response (CIR) observations is designed to directly map CIRs to positions, while mitigating the adverse effects of components that contribute minimally to localization accuracy (e.g., diffuse multipath).In this semi-supervised learning framework, a global feature extraction architecture based on self-attention is proposed to capture location-independent wireless environmental information, while an MLP is employed to extract the time-varying features related to user equipment (UE) positions. Variational inference based on a latent variable model (LVM) is applied to separate independent features within the CIR, with position labels guiding the LVM to express components more beneficial for localization. Additionally, we provide a feasibility proof for the separability of diffuse and specular environmental features in CIRs. Simulation results demonstrate that the proposed method achieves higher localization accuracy compared to conventional search-based localization methods, with enhanced robustness against indistinguishable multipath from diffuse reflectors.

eess.SP↗

arXiv2025

From Past to Present: A Survey of Malicious URL Detection Techniques, Datasets and Code Repositories

Malicious URLs persistently threaten the cybersecurity ecosystem, by either deceiving users into divulging private data or distributing harmful payloads to infiltrate host systems. Gaining timely insights into the current state of this ongoing battle holds significant importance. However, existing reviews exhibit 4 critical gaps: 1) Their reliance on algorithm-centric taxonomies obscures understanding of how detection approaches exploit specific modal information channels; 2) They fail to incorporate pivotal LLM/Transformer-based defenses; 3) No open-source implementations are collected to facilitate benchmarking; 4) Insufficient dataset coverage.This paper presents a comprehensive review of malicious URL detection technologies, systematically analyzing methods from traditional blacklisting to advanced deep learning approaches (e.g. Transformer, GNNs, and LLMs). Unlike prior surveys, we propose a novel modality-based taxonomy that categorizes existing works according to their primary data modalities (URL, HTML, Visual, etc.). This hierarchical classification enables both rigorous technical analysis and clear understanding of multimodal information utilization. Furthermore, to establish a profile of accessible datasets and address the lack of standardized benchmarking (where current studies often lack proper baseline comparisons), we curate and analyze: 1) publicly available datasets (2016-2024), and 2) open-source implementations from published works(2013-2025). Then, we outline essential design principles and architectural frameworks for product-level implementations. The review concludes by examining emerging challenges and proposing actionable directions for future research. We maintain a GitHub repository for ongoing curating datasets and open-source implementations: https://github.com/sevenolu7/Malicious-URL-Detection-Open-Source/tree/master.

cs.CR↗

arXiv2025

GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completion

Knowledge Graph Completion (KGC), which aims to infer missing or incomplete facts, is a crucial task for KGs. However, integrating the vital structural information of KGs into Large Language Models (LLMs) and outputting predictions deterministically remains challenging. To address this, we propose a new method called GLTW, which encodes the structural information of KGs and merges it with LLMs to enhance KGC performance. Specifically, we introduce an improved Graph Transformer (iGT) that effectively encodes subgraphs with both local and global structural information and inherits the characteristics of language model, bypassing training from scratch. Also, we develop a subgraph-based multi-classification training objective, using all entities within KG as classification objects, to boost learning efficiency.Importantly, we combine iGT with an LLM that takes KG language prompts as input.Our extensive experiments on various KG datasets show that GLTW achieves significant performance gains compared to SOTA baselines.

cs.CL↗

arXiv2025

Cross-Task Experiential Learning on LLM-based Multi-Agent Collaboration

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation, resulting in redundant computations and limited generalization across structurally similar tasks. To address this, we introduce multi-agent cross-task experiential learning (MAEL), a novel framework that endows LLM-driven agents with explicit cross-task learning and experience accumulation. We model the task-solving workflow on a graph-structured multi-agent collaboration network, where agents propagate information and coordinate via explicit connectivity. During the experiential learning phase, we quantify the quality for each step in the task-solving workflow and store the resulting rewards along with the corresponding inputs and outputs into each agent's individual experience pool. During inference, agents retrieve high-reward, task-relevant experiences as few-shot examples to enhance the effectiveness of each reasoning step, thereby enabling more accurate and efficient multi-agent collaboration. Experimental results on diverse datasets demonstrate that MAEL empowers agents to learn from prior task experiences effectively-achieving faster convergence and producing higher-quality solutions on current tasks.

cs.CL↗

arXiv2025

Co-Saving: Resource Aware Multi-Agent Collaboration for Software Development

Recent advancements in Large Language Models (LLMs) and autonomous agents have demonstrated remarkable capabilities across various domains. However, standalone agents frequently encounter limitations when handling complex tasks that demand extensive interactions and substantial computational resources. Although Multi-Agent Systems (MAS) alleviate some of these limitations through collaborative mechanisms like task decomposition, iterative communication, and role specialization, they typically remain resource-unaware, incurring significant inefficiencies due to high token consumption and excessive execution time. To address these limitations, we propose a resource-aware multi-agent system -- Co-Saving (meaning that multiple agents collaboratively engage in resource-saving activities), which leverages experiential knowledge to enhance operational efficiency and solution quality. Our key innovation is the introduction of "shortcuts" -- instructional transitions learned from historically successful trajectories -- which allows to bypass redundant reasoning agents and expedite the collective problem-solving process. Experiments for software development tasks demonstrate significant advantages over existing methods. Specifically, compared to the state-of-the-art MAS ChatDev, our method achieves an average reduction of 50.85% in token usage, and improves the overall code quality by 10.06%.

cs.CL↗

arXiv2025

A Feasibility Study of Task-Based fMRI at 0.55 T

0.55T MRI offers advantages compared to conventional field strengths, including reduced susceptibility artifacts and better compatibility with simultaneous EEG recordings. However, reliable task-based fMRI at 0.55T has not been significantly demonstrated. In this study, we establish a robust task-based fMRI protocol and analysis pipeline at 0.55T that achieves full brain coverage and results comparable to what is expected for activation extent and location. We attempted fMRI at 0.55T by combining EPI acquisition with custom analysis techniques. Finger-tapping and visual tasks were used, comparing 5- and 10-minute runs to enhance activation detection. The results show significant activations, demonstrating that high-quality task-based fMRI is achievable at 0.55T in single subjects. This study demonstrates that reliable task-based fMRI is feasible on 0.55T scanners, potentially broadening functional neuroimaging access in clinical and research settings where high-field MRI is unavailable or impractical, supporting broader diagnostic and research applications.

eess.IV↗

arXiv2025

Interplay between disorder and topology in Thouless pumping on a superconducting quantum processor

Topological phases are robust against weak perturbations, but break down when disorder becomes sufficiently strong. However, moderate disorder can also induce topologically nontrivial phases. Thouless pumping, as a (1+1)D counterpart of the integer quantum Hall effect, is one of the simplest manifestations of topology. Here, we report experimental observations of the competition and interplay between Thouless pumping and disorder on a 41-qubit superconducting quantum processor. We improve a Floquet engineering technique to realize cycles of adiabatic pumping by simultaneously varying the on-site potentials and the hopping couplings. We demonstrate Thouless pumping in the presence of disorder and show its breakdown as the strength of disorder increases. Moreover, we observe two types of topological pumping that are induced by on-site potential disorder and hopping disorder, respectively. In particular, an intrinsic topological pump that is induced by quasi-periodic hopping disorder has never been experimentally realized before. Our highly controllable system provides a valuable quantum simulating platform for studying various aspects of topological physics in the presence of disorder.

quant-ph↗

arXiv2025

Local Clustering for Lung Cancer Image Classification via Sparse Solution Technique

In this work, we propose to use a local clustering approach based on the sparse solution technique to study the medical image, especially the lung cancer image classification task. We view images as the vertices in a weighted graph and the similarity between a pair of images as the edges in the graph. The vertices within the same cluster can be assumed to share similar features and properties, thus making the applications of graph clustering techniques very useful for image classification. Recently, the approach based on the sparse solutions of linear systems for graph clustering has been found to identify clusters more efficiently than traditional clustering methods such as spectral clustering. We propose to use the two newly developed local clustering methods based on sparse solution of linear system for image classification. In addition, we employ a box spline-based tight-wavelet-framelet method to clean these images and help build a better adjacency matrix before clustering. The performance of our methods is shown to be very effective in classifying images. Our approach is significantly more efficient and either favorable or equally effective compared with other state-of-the-art approaches. Finally, we shall make a remark by pointing out two image deformation methods to build up more artificial image data to increase the number of labeled images.

cs.CV↗

arXiv2025

Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching

Large language models (LLMs) often struggle to provide up-to-date information due to their one-time training and the constantly evolving nature of the world. To keep LLMs current, existing approaches typically involve continued pre-training on new documents. However, they frequently face difficulties in extracting stored knowledge. Motivated by the remarkable success of the Feynman Technique in efficient human learning, we introduce Self-Tuning, a learning framework aimed at improving an LLM's ability to effectively acquire new knowledge from unseen raw documents through self-teaching. Specifically, we develop a Self-Teaching strategy that augments the documents with a set of knowledge-intensive tasks created in a self-supervised manner, focusing on three crucial aspects: memorization, comprehension, and self-reflection. Additionally, we introduce three Wiki-Newpages-2023-QA datasets to facilitate an in-depth analysis of an LLM's knowledge acquisition ability concerning memorization, extraction, and reasoning. Extensive experimental results on various models, e.g., Llama2-7B reveal that Self-Tuning consistently exhibits superior performance across all knowledge acquisition tasks and excels in preserving previous knowledge.

cs.CL↗

arXiv2025

Pangu Ultra MoE: How to Train Your Big MoE on Ascend NPUs

Sparse large language models (LLMs) with Mixture of Experts (MoE) and close to a trillion parameters are dominating the realm of most capable language models. However, the massive model scale poses significant challenges for the underlying software and hardware systems. In this paper, we aim to uncover a recipe to harness such scale on Ascend NPUs. The key goals are better usage of the computing resources under the dynamic sparse model structures and materializing the expected performance gain on the actual hardware. To select model configurations suitable for Ascend NPUs without repeatedly running the expensive experiments, we leverage simulation to compare the trade-off of various model hyperparameters. This study led to Pangu Ultra MoE, a sparse LLM with 718 billion parameters, and we conducted experiments on the model to verify the simulation results. On the system side, we dig into Expert Parallelism to optimize the communication between NPU devices to reduce the synchronization overhead. We also optimize the memory efficiency within the devices to further reduce the parameter and activation management overhead. In the end, we achieve an MFU of 30.0% when training Pangu Ultra MoE, with performance comparable to that of DeepSeek R1, on 6K Ascend NPUs, and demonstrate that the Ascend system is capable of harnessing all the training stages of the state-of-the-art language models. Extensive experiments indicate that our recipe can lead to efficient training of large-scale sparse language models with MoE. We also study the behaviors of such models for future reference.

cs.CL↗

arXiv2025

Generation of Relativistic Structured Spin-Polarized Lepton Beams

Relativistic structured spin-polarized (SSP) particle beams, characterized by polarization structures, are of critical importance in a wide range of applications, such as material properties investigation, imaging, and information storage. However, generation of relativistic SSP beams faces significant challenges. Here, we put forward a novel method for generating relativistic SSP lepton beams via employing a moderate-intensity terahertz (THz) wave. Building upon our foundational work on velocity-matched spin rotation in dielectric-lined waveguides [Phys. Rev. Lett. 134, 075001 (2025)], we present the first demonstration of spin-polarization mode matching - a novel mechanism that establishes a direct relation between waveguide modes and beam polarization states. This breakthrough enables precise spatial control over spin structures at relativistic energies, generating customizable spin-polarization configurations such as spider-like, azimuthal, and helical structures, etc. Such SSP beams have the potential to generate high-energy structured photon beams and open a new avenue for research on relativistic structured particle beams, especially in nuclear physics, high-energy physics, materials science and atomic physics.

physics.optics↗

arXiv2025

Prethermalization by Random Multipolar Driving on a 78-Qubit Superconducting Processor

Time-dependent drives hold the promise of realizing non-equilibrium many-body phenomena that are absent in undriven systems. Yet, drive-induced heating normally destabilizes the systems, which can be parametrically suppressed in the high-frequency regime by using periodic (Floquet) drives. It remains largely unknown to what extent highly controllable quantum simulators can suppress heating in non-periodically driven systems. Using the 78-qubit superconducting quantum processor, Chuang-tzu 2.0, we report the experimental observation of long-lived prethermal phases in many-body systems with tunable heating rates, driven by structured random protocols, characterized by $n$-multipolar temporal correlations. By measuring both the particle imbalance and subsystem entanglement entropy, we monitor the entire heating process over 1,000 driving cycles and observe the existence of the prethermal plateau. The prethermal lifetime is `doubly tunable': one way by driving frequency, the other by multipolar order; it grows algebraically with the frequency with the universal scaling exponent $2n{+}1$. Using quantum state tomography on different subsystems, we demonstrate a non-uniform spatial entanglement distribution and observe a crossover from area-law to volume-law entanglement scaling. With 78 qubits and 137 couplers in a 2D configuration, the entire far-from-equilibrium heating dynamics are beyond the reach of simulation using tensor-network numerical techniques. Our work highlights superconducting quantum processors as a powerful platform for exploring universal scaling laws and non-equilibrium phases of matter in driven systems in regimes where classical simulation faces formidable challenges.

quant-ph↗

arXiv2025

Training-free Diffusion Acceleration with Bottleneck Sampling

Diffusion models have demonstrated remarkable capabilities in visual content generation but remain challenging to deploy due to their high computational cost during inference. This computational burden primarily arises from the quadratic complexity of self-attention with respect to image or video resolution. While existing acceleration methods often compromise output quality or necessitate costly retraining, we observe that most diffusion models are pre-trained at lower resolutions, presenting an opportunity to exploit these low-resolution priors for more efficient inference without degrading performance. In this work, we introduce Bottleneck Sampling, a training-free framework that leverages low-resolution priors to reduce computational overhead while preserving output fidelity. Bottleneck Sampling follows a high-low-high denoising workflow: it performs high-resolution denoising in the initial and final stages while operating at lower resolutions in intermediate steps. To mitigate aliasing and blurring artifacts, we further refine the resolution transition points and adaptively shift the denoising timesteps at each stage. We evaluate Bottleneck Sampling on both image and video generation tasks, where extensive experiments demonstrate that it accelerates inference by up to 3$\times$ for image generation and 2.5$\times$ for video generation, all while maintaining output quality comparable to the standard full-resolution sampling process across multiple evaluation metrics.

cs.CV↗

arXiv2025

On the Distribution of 2-Selmer ranks of Quadratic Twists of Elliptic Curves over $\mathbb{Q}$

We characterize the distribution of 2-Selmer ranks of quadratic twists of elliptic curves over $\mathbb{Q}$ with full rational 2-torsion. We propose a new type of random alternating matrix model $M_{*,\mathbf t}^{\mathrm{Alt}}(\mathbb{F}_2)$ over $\mathbb{F}_2$ with 0, 1 or 2 ``holes'', with associated Markov chains, described by parameter $\mathbf t=(t_1,\cdots,t_s)\in\mathbb{Z}^s$ where $s$ is the number of ``holes''. We proved that for each equivalence classes of quadratic twists of elliptic curves: (1) The distribution of 2-Selmer ranks agrees with the distribution of coranks of matrices in $M_{*,\mathbf t}^{\mathrm{Alt}}(\mathbb{F}_2)$; (2) The moments of 2-Selmer groups agree with that of $M_{*,\mathbf t}^{\mathrm{Alt}}(\mathbb{F}_2)$, in particular, the average order of essential 2-Selmer groups is $3+\sum_i2^{t_i}$. Our work extends the works of Heath-Brown, Swinnerton-Dyer, Kane, and Klagsbrun-Mazur-Rubin where the matrix only has 0 ``holes'', the matrix model is the usual random alternating matrix model, and the average order of essential 2-Selmer groups is 3. A new phenomenon is that different equivalence classes in the same quadratic twist family could have different parameters, hence have different distribution of 2-Selmer ranks. The irreducible property of the Markov chain associated to $M_{*,\mathbf t}^{\mathrm{Alt}}(\mathbb{F}_2)$ gives the positive density results on the distribution of 2-Selmer ranks.

math.NT↗

arXiv2025

Nonlinear Multiple Response Regression and Learning of Latent Spaces

Identifying low-dimensional latent structures within high-dimensional data has long been a central topic in the machine learning community, driven by the need for data compression, storage, transmission, and deeper data understanding. Traditional methods, such as principal component analysis (PCA) and autoencoders (AE), operate in an unsupervised manner, ignoring label information even when it is available. In this work, we introduce a unified method capable of learning latent spaces in both unsupervised and supervised settings. We formulate the problem as a nonlinear multiple-response regression within an index model context. By applying the generalized Stein's lemma, the latent space can be estimated without knowing the nonlinear link functions. Our method can be viewed as a nonlinear generalization of PCA. Moreover, unlike AE and other neural network methods that operate as "black boxes", our approach not only offers better interpretability but also reduces computational complexity while providing strong theoretical guarantees. Comprehensive numerical experiments and real data analyses demonstrate the superior performance of our method.

stat.ML↗

arXiv2025

Don't Get Lost in the Trees: Streamlining LLM Reasoning by Overcoming Tree Search Exploration Pitfalls

Recent advancements in tree search algorithms guided by verifiers have significantly enhanced the reasoning capabilities of large language models (LLMs), but at the cost of increased computational resources. In this work, we identify two key challenges contributing to this inefficiency: $\textit{over-exploration}$ due to redundant states with semantically equivalent content, and $\textit{under-exploration}$ caused by high variance in verifier scoring leading to frequent trajectory switching. To address these issues, we propose FETCH, an e$\textbf{f}$fici$\textbf{e}$nt $\textbf{t}$ree sear$\textbf{ch}$ framework, which is a flexible, plug-and-play system compatible with various tree search algorithms. Our framework mitigates over-exploration by merging semantically similar states using agglomerative clustering of text embeddings obtained from a fine-tuned SimCSE model. To tackle under-exploration, we enhance verifiers by incorporating temporal difference learning with adjusted $λ$-returns during training to reduce variance, and employing a verifier ensemble to aggregate scores during inference. Experiments on GSM8K, GSM-Plus, and MATH datasets demonstrate that our methods significantly improve reasoning accuracy and computational efficiency across four different tree search algorithms, paving the way for more practical applications of LLM-based reasoning. The code is available at https://github.com/Soistesimmer/Fetch.

cs.CL↗

arXiv2025

Design of a CsI(Tl) Calorimeter for Muonium-to-Antimuonium Conversion Experiment

The Muonium-to-Antimuonium Conversion Experiment (MACE) is proposed to search for charged lepton flavor violation and increase the sensitivity by more than two orders of magnitude compared to the MACS experiment at PSI in 1999. A clear signature of this conversion is the positron produced from antimuonium decay. This paper presents a near-$4π$-coverage calorimeter designed for MACE, which can provide an energy resolution of 10.8% at 511 keV, and a signal efficiency of 78.3% for annihilation $γ$-ray events. Detailed Monte-Carlo simulations using MACE offline software based on Geant4 are performed for geometry optimization, coincidence system design, background estimation, and benchmark detector validation.

physics.ins-det↗

arXiv2025

Iterative Nash Policy Optimization: Aligning LLMs with General Preferences via No-Regret Learning

Reinforcement Learning with Human Feedback (RLHF) has achieved great success in aligning large language models (LLMs) with human preferences. Prevalent RLHF approaches are reward-based, following the Bradley-Terry (BT) model assumption, which may not fully capture the complexity of human preferences. In this paper, we explore RLHF under a general preference framework and approach it from a game-theoretic perspective. Specifically, we formulate the problem as a two-player game and propose a novel online algorithm, iterative Nash policy optimization (INPO). The key idea is to let the policy play against itself via no-regret learning, thereby approximating the Nash policy. Unlike previous methods, INPO bypasses the need for estimating the expected win rate for individual responses, which typically incurs high computational or annotation costs. Instead, we introduce a new loss objective that is directly minimized over a preference dataset. We provide theoretical analysis for our approach and demonstrate its effectiveness through experiments on various representative benchmarks. With an LLaMA-3-8B-based SFT model, INPO achieves a 42.6% length-controlled win rate on AlpacaEval 2.0 and a 37.8% win rate on Arena-Hard, showing substantial improvement over the state-of-the-art online RLHF algorithms.

cs.LG↗