arXiv subjects

Ying Zhu

Publications and source records attributed to Ying Zhu.

At least 37 records · Page 2Linked to original sources

arXiv2025

Versatile silicon integrated photonic processor: a reconfigurable solution for next-generation AI clusters

The Artificial Intelligence models pose serious challenges in intensive computing and high-bandwidth communication for conventional electronic circuit-based computing clusters. Silicon photonic technologies, owing to their high speed, low latency, large bandwidth, and complementary metal-oxide-semiconductor compatibility, have been widely implemented for data transfer and actively explored as photonic neural networks in AI clusters. However, current silicon photonic integrated chips lack adaptability for multifuncional use and hardware-software systematic coordination. Here, we develop a reconfigurable silicon photonic processor with $40$ programmable unit cells integrating over $160$ component, which, to the best of our knowledge, is the first to realize diverse functions with a chip for AI clusters, from computing acceleration and signal processing to network swtiching and secure encryption. Through a self-developed automated testing, compilation, and tuning framework to the processor without in-network monitoring photodetectors, we implement $4\times4$ dual-direction unitary and $3\times3$ uni-direction non-unitary matrix multiplications, neural networks for image recognition, micro-ring modulator wavelength locking, $4\times4$ photonic channel switching , and silicon photonic physical unclonable functions. This optoelectronic processing system, incorporating the photonic processor and its software stack, paves the way for both advanced photonic system-on-chip design and the construction of photo-electronic AI clusters.

physics.optics↗

arXiv2025

Quantitative Single-particle Profiling of Extracellular Vesicles via Fluorescent Nanoparticle Tracking Analysis

Extracellular vesicles (EVs) have drawn rapidly increasing attention as the next-generation diagnostic biomarkers and therapeutic agents. However, the heterogeneous nature of EVs necessitates advanced methods for profiling EVs at the single-particle level. While nanoparticle tracking analysis (NTA) is a widely used technique for quantifying particle size and concentration, conventional scattering-based systems are non-specific. In this study, we present an optimised protocol for quantitative profiling of EVs at the single-particle level by fluorescent NTA (F-NTA). The protocol integrates fluorescent immunolabeling of EVs with size-exclusion chromatography (SEC) to efficiently remove unbound labels, enabling the precise quantification of EV concentration, size distribution, and surface immunophenotype. We first validated this approach using biotinylated liposomes and EVs from cultured human cell lines, confirming effective removal of unbound labels and assessing labelling efficiency. We then demonstrated that F-NTA can distinguish EV subpopulations with distinct surface marker expression, exemplified by the differentiation of EpCAM-positive EVs derived from HT29 and HEK293 cells. Finally, we applied dual labelling to human plasma isolates to simultaneously profile EVs and non-vesicular extracellular particles, providing a quantitative quality assessment of EV purity at the single-particle level. The robustness of this method was further supported by comparative analysis with total internal reflection fluorescence microscopy. This validated workflow enables robust, quantitative profiling of EV subpopulations, providing a critical tool for diverse EV applications, including biomarker discovery, therapeutic monitoring, and quality control for engineered vesicles.

q-bio.BM↗

arXiv2025

Narrative-Driven Travel Planning: Geoculturally-Grounded Script Generation with Evolutionary Itinerary Optimization

To enhance tourists' experiences and immersion, this paper proposes a narrative-driven travel planning framework called NarrativeGuide, which generates a geoculturally-grounded narrative script for travelers, offering a novel, role-playing experience for their journey. In the initial stage, NarrativeGuide constructs a knowledge graph for attractions within a city, then configures the worldview, character setting, and exposition based on the knowledge graph. Using this foundation, the knowledge graph is combined to generate an independent scene unit for each attraction. During the itinerary planning stage, NarrativeGuide models narrative-driven travel planning as an optimization problem, utilizing a genetic algorithm (GA) to refine the itinerary. Before evaluating the candidate itinerary, transition scripts are generated for each pair of adjacent attractions, which, along with the scene units, form a complete script. The weighted sum of script coherence, travel time, and attraction scores is then used as the fitness value to update the candidate solution set. In our experiments, we incorporated the TravelPlanner benchmark to systematically evaluate the planning capability of NarrativeGuide under complex constraints. In addition, we assessed its performance in terms of narrative coherence and cultural fit. The results show that NarrativeGuide demonstrates strong capabilities in both itinerary planning and script generation.

cs.AI↗

arXiv2025

Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization

Recently, many approaches, such as Chain-of-Thought (CoT) prompting and Multi-Agent Debate (MAD), have been proposed to further enrich Large Language Models' (LLMs) complex problem-solving capacities in reasoning scenarios. However, these methods may fail to solve complex problems due to the lack of ability to find optimal solutions. Swarm Intelligence has been serving as a powerful tool for finding optima in the field of traditional optimization problems. To this end, we propose integrating swarm intelligence into the reasoning process by introducing a novel Agent-based Swarm Intelligence (ASI) paradigm. In this paradigm, we formulate LLM reasoning as an optimization problem and use a swarm intelligence scheme to guide a group of LLM-based agents in collaboratively searching for optimal solutions. To avoid swarm intelligence getting trapped in local optima, we further develop a Swarm Intelligence Enhancing Reasoning (SIER) framework, which develops a density-driven strategy to enhance the reasoning ability. To be specific, we propose to perform kernel density estimation and non-dominated sorting to optimize both solution quality and diversity simultaneously. In this case, SIER efficiently enhances solution space exploration through expanding the diversity of the reasoning path. Besides, a step-level quality evaluation is used to help agents improve solution quality by correcting low-quality intermediate steps. Then, we use quality thresholds to dynamically control the termination of exploration and the selection of candidate steps, enabling a more flexible and efficient reasoning process. Extensive experiments are ...

cs.MA↗

arXiv2025

RISE: Reasoning Enhancement via Iterative Self-Exploration in Multi-hop Question Answering

Large Language Models (LLMs) excel in many areas but continue to face challenges with complex reasoning tasks, such as Multi-Hop Question Answering (MHQA). MHQA requires integrating evidence from diverse sources while managing intricate logical dependencies, often leads to errors in reasoning. Retrieval-Augmented Generation (RAG), widely employed in MHQA tasks, faces challenges in effectively filtering noisy data and retrieving all necessary evidence, thereby limiting its effectiveness in addressing MHQA challenges. To address these challenges, we propose RISE:Reasoning Enhancement via Iterative Self-Exploration, a novel framework designed to enhance models' reasoning capability through iterative self-exploration. Specifically, RISE involves three key steps in addressing MHQA tasks: question decomposition, retrieve-then-read, and self-critique. By leveraging continuous self-exploration, RISE identifies accurate reasoning paths, iteratively self-improving the model's capability to integrate evidence, maintain logical consistency, and enhance performance in MHQA tasks. Extensive experiments on multiple MHQA benchmarks demonstrate that RISE significantly improves reasoning accuracy and task performance.

cs.CL↗

arXiv2025

Fully Integrated Vacuum-based Quantum Random Number Generator

Quantum random number generators play a crucial role in securing high-demand information contexts by producing true random numbers. Nevertheless, the large volume and high-cost limit their widespread use. Here, we propose a system on chip that fully leverages the advantages of different photonic integrated platforms, where the interference optical paths and photodiodes are integrated on a standard silicon process, while the laser source on-chip is realized on a III-V platform. Using micro-lens coupling package technology, which contributes to a topnotch coupling loss lower than 2dB, the components on different platforms are combined and packaged with the amplifier circuits in a 42mm* 24mm footprint in a butterfly form. This complete miniaturized and cost-effective entropy source enables outputting a vacuum noise signal with a 3dB bandwidth of over 500MHz. After sampling and post-processing, a random number generation rate of up to 6.57Gbps is achieved. The results show a feasible way of overcoming the laser integration problem with silicon-based integrated quantum photonics. Foreseeable, commercial applications on a large scale are significantly promoted.

physics.optics↗

arXiv2025

Cross-region Model Training with Communication-Computation Overlapping and Delay Compensation

Training large language models (LLMs) requires massive computational resources, often necessitating the aggregation of geographically distributed data centers (\ie, cross-region training). However, the high communication latency in wide-area networks severely degrades the efficiency of traditional distributed training. While methods like DiLoCo reduce communication frequency, they suffer from blocking synchronization. Streaming DiLoCo alleviates this issue via communication-computation overlapping but introduces update staleness and model inconsistency due to delayed global updates and partial synchronization. These factors impair convergence, especially when aggressive overlap is needed to mask high latency. We propose CoCoDC, a novel distributed training framework with communication-computation overlapping and delay compensation, to explicitly tackle these challenges. Within the CoCoDC framework, we specifically develop a novel Delay Compensation strategy based on Taylor expansion to effectively mitigate the staleness and an Adaptive Transmission strategy that dynamically schedules model fragment synchronization to optimize bandwidth usage and accelerate convergence. Extensive experiments highlight the superior performance of CoCoDC over both DiLoCo and Streaming DiLoCo regarding final accuracy and training speed. Specifically, CoCoDC reduces the training steps needed to reach a comparable perplexity by up to 21.0% compared to Streaming DiLoCo. Our work provides an effective solution for scalable and efficient cross-region LLM training.

cs.DC↗

arXiv2025

GRATR: Zero-Shot Evidence Graph Retrieval-Augmented Trustworthiness Reasoning

Trustworthiness reasoning aims to enable agents in multiplayer games with incomplete information to identify potential allies and adversaries, thereby enhancing decision-making. In this paper, we introduce the graph retrieval-augmented trustworthiness reasoning (GRATR) framework, which retrieves observable evidence from the game environment to inform decision-making by large language models (LLMs) without requiring additional training, making it a zero-shot approach. Within the GRATR framework, agents first observe the actions of other players and evaluate the resulting shifts in inter-player trust, constructing a corresponding trustworthiness graph. During decision-making, the agent performs multi-hop retrieval to evaluate trustworthiness toward a specific target, where evidence chains are retrieved from multiple trusted sources to form a comprehensive assessment. Experiments in the multiplayer game \emph{Werewolf} demonstrate that GRATR outperforms the alternatives, improving reasoning accuracy by 50.5\% and reducing hallucination by 30.6\% compared to the baseline method. Additionally, when tested on a dataset of Twitter tweets during the U.S. election period, GRATR surpasses the baseline method by 10.4\% in accuracy, highlighting its potential in real-world applications such as intent analysis.

cs.AI↗

arXiv2024

D$^3$epth: Self-Supervised Depth Estimation with Dynamic Mask in Dynamic Scenes

Depth estimation is a crucial technology in robotics. Recently, self-supervised depth estimation methods have demonstrated great potential as they can efficiently leverage large amounts of unlabelled real-world data. However, most existing methods are designed under the assumption of static scenes, which hinders their adaptability in dynamic environments. To address this issue, we present D$^3$epth, a novel method for self-supervised depth estimation in dynamic scenes. It tackles the challenge of dynamic objects from two key perspectives. First, within the self-supervised framework, we design a reprojection constraint to identify regions likely to contain dynamic objects, allowing the construction of a dynamic mask that mitigates their impact at the loss level. Second, for multi-frame depth estimation, we introduce a cost volume auto-masking strategy that leverages adjacent frames to identify regions associated with dynamic objects and generate corresponding masks. This provides guidance for subsequent processes. Furthermore, we propose a spectral entropy uncertainty module that incorporates spectral entropy to guide uncertainty estimation during depth fusion, effectively addressing issues arising from cost volume computation in dynamic environments. Extensive experiments on KITTI and Cityscapes datasets demonstrate that the proposed method consistently outperforms existing self-supervised monocular depth estimation baselines. Code is available at \url{https://github.com/Csyunling/D3epth}.

cs.CV↗

arXiv2024

Evaluating LLMs for Text-to-SQL Generation With Complex SQL Workload

This study presents a comparative analysis of the a complex SQL benchmark, TPC-DS, with two existing text-to-SQL benchmarks, BIRD and Spider. Our findings reveal that TPC-DS queries exhibit a significantly higher level of structural complexity compared to the other two benchmarks. This underscores the need for more intricate benchmarks to simulate realistic scenarios effectively. To facilitate this comparison, we devised several measures of structural complexity and applied them across all three benchmarks. The results of this study can guide future research in the development of more sophisticated text-to-SQL benchmarks. We utilized 11 distinct Language Models (LLMs) to generate SQL queries based on the query descriptions provided by the TPC-DS benchmark. The prompt engineering process incorporated both the query description as outlined in the TPC-DS specification and the database schema of TPC-DS. Our findings indicate that the current state-of-the-art generative AI models fall short in generating accurate decision-making queries. We conducted a comparison of the generated queries with the TPC-DS gold standard queries using a series of fuzzy structure matching techniques based on query features. The results demonstrated that the accuracy of the generated queries is insufficient for practical real-world application.

cs.DB↗

arXiv2024

On the limitations of data-based price discrimination

The classic third degree price discrimination (3PD) model requires the knowledge of the distribution of buyer valuations and the covariate to set the price conditioned on the covariate. In terms of generating revenue, the classic result shows that 3PD is at least as good as uniform pricing. What if the seller has to set a price based only on a sample of observations from the underlying distribution? Is it still obvious that the seller should engage in 3PD? This paper sheds light on these fundamental questions. In particular, the comparison of the revenue performance between 3PD and uniform pricing is ambiguous overall when prices are set based on samples. This finding is in the nature of statistical learning under uncertainty: a curse of dimensionality, but also other small sample complications.

cs.GT↗

arXiv2024

A Survey on Visual Mamba

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic complexity with image size and increasing computational demands, the researchers are now exploring how to adapt Mamba for computer vision tasks. This paper is the first comprehensive survey aiming to provide an in-depth analysis of Mamba models in the field of computer vision. It begins by exploring the foundational concepts contributing to Mamba's success, including the state space model framework, selection mechanisms, and hardware-aware design. Next, we review these vision mamba models by categorizing them into foundational ones and enhancing them with techniques such as convolution, recurrence, and attention to improve their sophistication. We further delve into the widespread applications of Mamba in vision tasks, which include their use as a backbone in various levels of vision processing. This encompasses general visual tasks, Medical visual tasks (e.g., 2D / 3D segmentation, classification, and image registration, etc.), and Remote Sensing visual tasks. We specially introduce general visual tasks from two levels: High/Mid-level vision (e.g., Object detection, Segmentation, Video classification, etc.) and Low-level vision (e.g., Image super-resolution, Image restoration, Visual generation, etc.). We hope this endeavor will spark additional interest within the community to address current challenges and further apply Mamba models in computer vision.

cs.CV↗

arXiv2023

Self-similar evolution of wave turbulence in Gross-Pitaevskii system

We study the universal non-stationary evolution of wave turbulence (WT) in Bose-Einstein condensates (BECs). Their temporal evolution can exhibit different kinds of self-similar behavior corresponding to a large-time asymptotic of the system or to a finite-time blowup. We identify self-similar regimes in BECs by numerically simulating the forced and unforced Gross-Pitaevskii equation (GPE) and the associated wave kinetic equation (WKE) for the direct and inverse cascades, respectively. In both the GPE and the WKE simulations for the direct cascade, we observe the first-kind self-similarity that is fully determined by energy conservation. For the inverse cascade evolution, we verify the existence of a self-similar evolution of the second kind describing self-accelerating dynamics of the spectrum leading to blowup at the zero mode (condensate) at a finite time. We believe that the universal self-similar spectra found in the present paper are as important and relevant for understanding the BEC turbulence in past and future experiments as the commonly studied stationary Kolmogorov-Zakharov (KZ) spectra.

cond-mat.other↗

arXiv2023

Phase transitions in nonparametric regressions

When the unknown regression function of a single variable is known to have derivatives up to the $(γ+1)$th order bounded in absolute values by a common constant everywhere or a.e. (i.e., $(γ+1)$th degree of smoothness), the minimax optimal rate of the mean integrated squared error (MISE) is stated as $\left(\frac{1}{n}\right)^{\frac{2γ+2}{2γ+3}}$ in the literature. This paper shows that: (i) if $n\leq\left(γ+1\right)^{2γ+3}$, the minimax optimal MISE rate is $\frac{\log n}{n\log(\log n)}$ and the optimal degree of smoothness to exploit is roughly $\max\left\{ \left\lfloor \frac{\log n}{2\log\left(\log n\right)}\right\rfloor ,\,1\right\} $; (ii) if $n>\left(γ+1\right)^{2γ+3}$, the minimax optimal MISE rate is $\left(\frac{1}{n}\right)^{\frac{2γ+2}{2γ+3}}$ and the optimal degree of smoothness to exploit is $γ+1$. The fundamental contribution of this paper is a set of metric entropy bounds we develop for smooth function classes. Some of our bounds are original, and some of them improve and/or generalize the ones in the literature (e.g., Kolmogorov and Tikhomirov, 1959). Our metric entropy bounds allow us to show phase transitions in the minimax optimal MISE rates associated with some commonly seen smoothness classes as well as non-standard smoothness classes, and can also be of independent interest outside the nonparametric regression problems.

math.ST↗

arXiv2023

Breast Lesion Diagnosis Using Static Images and Dynamic Video

Deep learning based Computer Aided Diagnosis (CAD) systems have been developed to treat breast ultrasound. Most of them focus on a single ultrasound imaging modality, either using representative static images or the dynamic video of a real-time scan. In fact, these two image modalities are complementary for lesion diagnosis. Dynamic videos provide detailed three-dimensional information about the lesion, while static images capture the typical sections of the lesion. In this work, we propose a multi-modality breast tumor diagnosis model to imitate the diagnosing process of radiologists, which learns the features of both static images and dynamic video and explores the potential relationship between the two modalities. Considering that static images are carefully selected by professional radiologists, we propose to aggregate dynamic video features under the guidance of domain knowledge from static images before fusing multi-modality features. Our work is validated on a breast ultrasound dataset composed of 897 sets of ultrasound images and videos. Experimental results show that our model boosts the performance of Benign/Malignant classification, achieving 90.0% in AUC and 81.7% in accuracy.

cs.CV↗

arXiv2023

Direct and inverse cascades in turbulent Bose-Einstein condensate

When a Bose-Einstein condensate (BEC) is driven out of equilibrium, density waves interact non-linearly and trigger turbulent cascades. In a turbulent BEC, energy is transferred towards small scales by a direct cascade, whereas the number of particles displays an inverse cascade toward large scales. In this work, we study analytically and numerically the direct and inverse cascades in wave-turbulent BECs. We analytically derive the Kolmogorov-Zakharov spectra, including the log-correction to the direct cascade scaling and the universal pre-factor constants for both cascades. We test and corroborate our predictions using high-resolution numerical simulations of the forced-dissipated Gross-Pitaevskii model in a periodic box and the corresponding wave-kinetic equation. Theoretical predictions and data are in excellent agreement, without adjustable parameters. Moreover, in order to connect with experiments, we test and validate our theoretical predictions using the Gross-Pitaevskii model with a confining cubic trap. Our results explain previous experimental observations and suggest new settings for future studies.

cond-mat.quant-gas↗

arXiv2023

Empathetic Response Generation via Emotion Cause Transition Graph

Empathetic dialogue is a human-like behavior that requires the perception of both affective factors (e.g., emotion status) and cognitive factors (e.g., cause of the emotion). Besides concerning emotion status in early work, the latest approaches study emotion causes in empathetic dialogue. These approaches focus on understanding and duplicating emotion causes in the context to show empathy for the speaker. However, instead of only repeating the contextual causes, the real empathic response often demonstrate a logical and emotion-centered transition from the causes in the context to those in the responses. In this work, we propose an emotion cause transition graph to explicitly model the natural transition of emotion causes between two adjacent turns in empathetic dialogue. With this graph, the concept words of the emotion causes in the next turn can be predicted and used by a specifically designed concept-aware decoder to generate the empathic response. Automatic and human experimental results on the benchmark dataset demonstrate that our method produces more empathetic, coherent, informative, and specific responses than existing models.

cs.CL↗

arXiv2022

Theoretical study of small signal modulation behavior of Fabry-Perot Germanium-on-Silicon lasers

This work investigated the small signal performance of Fabry-Perot Ge-on-Si lasers by modeling and simulations. The 3dB bandwidth dependence on the structure parameters such as poly-Si cladding thickness, Ge cavity width and thickness, and minority carrier lifetime were studied. A 3dB bandwidth of 33.94 GHz at a biasing current of 270.5 mA is predicted after Ge laser structure optimization with a defect limited carrier lifetime of 1 ns.

physics.optics↗