arXiv subjects

Siyu Wang

Publications and source records attributed to Siyu Wang.

At least 55 records · Page 3Linked to original sources

arXiv2025

Optimal $W_1$ and Berry-Esseen bound between the spectral radius of large Chiral non-Hermitian random matrices and Gumbel

Consider the chiral non-Hermitian random matrix ensemble with parameters $n$ and $v$ and the non Hermiticity parameter $τ=0$ and let $(ζ_i)_{1\le i\le n}$ be its $n$ eigenvalues with positive $x$-coordinate. Set $$X_n:=\sqrt{\log s_n}\left(\frac{2n \max_{1\le i\le n}|ζ_i|^2-2\sqrt{n(n+v)}}{\sqrt{2n+v}}-a(s_{n})\right)$$ with $s_n=n(n+v)/(2n+v)$ and $a(s_n)=\sqrt{\log s_n}-\frac{\log(\sqrt{2π}\log s_n)}{\sqrt{\log s_n}}.$ It was proved in \cite{JQ} that $X_n$ converges weakly to the Gumbel distribution $Λ$. In this paper, we give in further that $$\lim_{n\to\infty} \frac{\log s_n}{(\log\log s_n)^2}W_1\left(F_n, Λ\right)=\frac{1}{2}$$ and the Berry-Esseen bound $$\lim_{n\to\infty} \frac{\log s_n}{(\log\log s_n)^2}\sup_{x\in\mathbb{R}}|F_n(x)-e^{-e^{-x}}|=\frac{1}{2e}.$$ Here, $F_n$ is the distribution (function) of $X_n.$

math.PR↗

arXiv2024

Improved fluxonium readout through dynamic flux pulsing

The ability to perform rapid, high fidelity readout of a qubit state is an important requirement for quantum algorithms and, in particular, for enabling operations such as mid-circuit measurements and measurement-based feedback for error correction schemes on large quantum processors. The growing interest in fluxonium qubits, due to their long coherence times and high anharmonicity, merits further attention to reducing the readout duration and measurement errors. We find that this can be accomplished by exploiting the flux tunability of fluxonium qubits. In this work, we experimentally demonstrate flux-pulse-assisted readout, as proposed in Phys. Rev. Applied 22, 014079 (https://doi.org/10.1103/PhysRevApplied.22.014079), in a setup without a quantum-limited parametric amplifier. Increasing the dispersive shift magnitude by almost 20% through flux pulsing, we achieve an assignment fidelity of 94.3% with an integration time of 280 ns. The readout performance is limited by state initialization, but we find that the limit imposed only by the signal-to-noise ratio corresponds to an assignment fidelity of 99.9% with a 360 ns integration time. We also verify these results through simple semi-classical simulations. These results constitute the fastest reported readout of a fluxonium qubit, with the prospect of further improvement by incorporation of a parametric amplifier in the readout chain to enhance measurement efficiency.

quant-ph↗

arXiv2024

Action-Attentive Deep Reinforcement Learning for Autonomous Alignment of Beamlines

Synchrotron radiation sources play a crucial role in fields such as materials science, biology, and chemistry. The beamline, a key subsystem of the synchrotron, modulates and directs the radiation to the sample for analysis. However, the alignment of beamlines is a complex and time-consuming process, primarily carried out manually by experienced engineers. Even minor misalignments in optical components can significantly affect the beam's properties, leading to suboptimal experimental outcomes. Current automated methods, such as bayesian optimization (BO) and reinforcement learning (RL), although these methods enhance performance, limitations remain. The relationship between the current and target beam properties, crucial for determining the adjustment, is not fully considered. Additionally, the physical characteristics of optical elements are overlooked, such as the need to adjust specific devices to control the output beam's spot size or position. This paper addresses the alignment of beamlines by modeling it as a Markov Decision Process (MDP) and training an intelligent agent using RL. The agent calculates adjustment values based on the current and target beam states, executes actions, and iterates until optimal parameters are achieved. A policy network with action attention is designed to improve decision-making by considering both state differences and the impact of optical components. Experiments on two simulated beamlines demonstrate that our algorithm outperforms existing methods, with ablation studies highlighting the effectiveness of the action attention-based policy network.

eess.SY↗

arXiv2024

Absence of altermagnetic spin splitting character in rutile oxide RuO$_2$

Rutile RuO$_2$ has been posited as a potential $d$-wave altermagnetism candidate, with a predicted significant spin splitting up to 1.4 eV. Despite accumulating theoretical predictions and transport measurements, direct spectroscopic observation of spin splitting has remained elusive. Here, we employ spin- and angle-resolved photoemission spectroscopy to investigate the band structures and spin polarization of thin-film and single-crystal RuO$_2$. Contrary to expectations of altermagnetism, our analysis indicates that RuO$_2$'s electronic structure aligns with those predicted under non-magnetic conditions, exhibiting no evidence of the hypothesized spin splitting. Additionally, we observe significant in-plane spin polarization of the low-lying bulk bands, which is antisymmetric about the high-symmetry plane and contrary to the $d$-wave spin texture due to time-reversal symmetry breaking in altermagnetism. These findings definitively challenge the altermagnetic order previously proposed for rutile RuO$_2$, prompting a reevaluation of its magnetic properties.

cond-mat.mtrl-sci↗

arXiv2024

Precise Drive with VLM: First Prize Solution for PRCV 2024 Drive LM challenge

This technical report outlines the methodologies we applied for the PRCV Challenge, focusing on cognition and decision-making in driving scenarios. We employed InternVL-2.0, a pioneering open-source multi-modal model, and enhanced it by refining both the model input and training methodologies. For the input data, we strategically concatenated and formatted the multi-view images. It is worth mentioning that we utilized the coordinates of the original images without transformation. In terms of model training, we initially pre-trained the model on publicly available autonomous driving scenario datasets to bolster its alignment capabilities of the challenge tasks, followed by fine-tuning on the DriveLM-nuscenes Dataset. During the fine-tuning phase, we innovatively modified the loss function to enhance the model's precision in predicting coordinate values. These approaches ensure that our model possesses advanced cognitive and decision-making capabilities in driving scenarios. Consequently, our model achieved a score of 0.6064, securing the first prize on the competition's final results.

cs.CV↗

arXiv2024

Deviation and moderate deviation for extremal eigenvalues of large Chiral non-Hermitian random matrices

Consider the chiral non-Hermitian random matrix ensemble with parameters $n$ and $v,$ and let $(ζ_i)_{1\le i\le n}$ be its $n$ eigenvalues with positive $x$-coordinate. In this paper, we establish deviation probabilities and moderate deviation probabilities for the spectral radius $(n/(n+v))^{1/2}\max_{1\le i\le n}|ζ_i|^2,$ as well as $(n/(n+v))^{1/2}\min_{1\le i\le n}|ζ_i|^2.$

math.PR↗

arXiv2024

Asymptotically efficient estimators for tail probabilities of extremals of $β$-Jacobi ensembles

In this paper, we consider the tail probabilities of extremals of $β$-Jacobi ensemble which plays an important role in multivariate analysis. The key steps in constructing estimators rely on the rate functions of large deviations. Therefore, under specific conditions, we consider stretching and shifting transformations applied to the $β$-Jacobi ensemble to ensure that its extremals satisfy the large deviations. The estimator we construct characterize the large deviation behavior and moderate deviation behavior of extremals under different assumptions.

math.ST↗

arXiv2024

Importance Sampling for the Extremal Eigenvalue of $β$-Jacobi ensemble

This paper focuses on rare events associated with the tail probabilities of the extremal eigenvalues in the $β$-Jacobi ensemble, which plays a critical role in both multivariate statistical analysis and statistical physics. Under the ultra-high dimensional setting, we give an exact approximation for the tail probabilities and construct an efficient estimator for the tail probabilities. Additionally, we conduct a numerical study to evaluate the practical performance of our algorithms. The simulation results demonstrate that our method offers an efficient and accurate approach for evaluating tail probabilities in practice.

math.PR↗

arXiv2024

On Causally Disentangled State Representation Learning for Reinforcement Learning based Recommender Systems

In Reinforcement Learning-based Recommender Systems (RLRS), the complexity and dynamism of user interactions often result in high-dimensional and noisy state spaces, making it challenging to discern which aspects of the state are truly influential in driving the decision-making process. This issue is exacerbated by the evolving nature of user preferences and behaviors, requiring the recommender system to adaptively focus on the most relevant information for decision-making while preserving generaliability. To tackle this problem, we introduce an innovative causal approach for decomposing the state and extracting \textbf{C}ausal-\textbf{I}n\textbf{D}ispensable \textbf{S}tate Representations (CIDS) in RLRS. Our method concentrates on identifying the \textbf{D}irectly \textbf{A}ction-\textbf{I}nfluenced \textbf{S}tate Variables (DAIS) and \textbf{A}ction-\textbf{I}nfluence \textbf{A}ncestors (AIA), which are essential for making effective recommendations. By leveraging conditional mutual information, we develop a framework that not only discerns the causal relationships within the generative process but also isolates critical state variables from the typically dense and high-dimensional state representations. We provide theoretical evidence for the identifiability of these variables. Then, by making use of the identified causal relationship, we construct causal-indispensable state representations, enabling the training of policies over a more advantageous subset of the agent's state space. We demonstrate the efficacy of our approach through extensive experiments, showcasing our method outperforms state-of-the-art methods.

cs.AI↗

arXiv2024

Preserving Real-World Finger Dexterity Using a Lightweight Fingertip Haptic Device for Virtual Dexterous Manipulation

This study presents a lightweight, wearable fingertip haptic device that provides physics-based haptic feedback for dexterous manipulation in virtual environments without hindering real-world interactions. The device's design utilizes thin strings and actuators attached to the fingernails, minimizing the weight (1.76g each finger) while preserving finger flexibility. Multiple types of haptic feedback are simulated by integrating the software with a physics engine. Experiments evaluate the device's performance in pressure perception, slip feedback, and typical dexterous manipulation tasks. and daily operations, while subjective assessments gather user experiences. Results demonstrate that participants can perceive and respond to pressure and vibration feedback. These limited haptic cues are crucial as they significantly enhance efficiency in virtual dexterous manipulation tasks. The device's ability to preserve tactile sensations and minimize hindrance to real-world operations is a key advantage over glove-type haptic devices. This research offers a potential solution for designing haptic interfaces that balance lightweight, haptic feedback for dexterous manipulation and daily wearability.

cs.HC↗

arXiv2024

CODIS: Benchmarking Context-Dependent Visual Comprehension for Multimodal Large Language Models

Multimodal large language models (MLLMs) have demonstrated promising results in a variety of tasks that combine vision and language. As these models become more integral to research and applications, conducting comprehensive evaluations of their capabilities has grown increasingly important. However, most existing benchmarks fail to consider that, in certain situations, images need to be interpreted within a broader context. In this work, we introduce a new benchmark, named as CODIS, designed to assess the ability of models to use context provided in free-form text to enhance visual comprehension. Our findings indicate that MLLMs consistently fall short of human performance on this benchmark. Further analysis confirms that these models struggle to effectively extract and utilize contextual information to improve their understanding of images. This underscores the pressing need to enhance the ability of MLLMs to comprehend visuals in a context-dependent manner. View our project website at https://thunlp-mt.github.io/CODIS.

cs.CV↗

arXiv2024

Maximum-Entropy Regularized Decision Transformer with Reward Relabelling for Dynamic Recommendation

Reinforcement learning-based recommender systems have recently gained popularity. However, due to the typical limitations of simulation environments (e.g., data inefficiency), most of the work cannot be broadly applied in all domains. To counter these challenges, recent advancements have leveraged offline reinforcement learning methods, notable for their data-driven approach utilizing offline datasets. A prominent example of this is the Decision Transformer. Despite its popularity, the Decision Transformer approach has inherent drawbacks, particularly evident in recommendation methods based on it. This paper identifies two key shortcomings in existing Decision Transformer-based methods: a lack of stitching capability and limited effectiveness in online adoption. In response, we introduce a novel methodology named Max-Entropy enhanced Decision Transformer with Reward Relabeling for Offline RLRS (EDT4Rec). Our approach begins with a max entropy perspective, leading to the development of a max entropy enhanced exploration strategy. This strategy is designed to facilitate more effective exploration in online environments. Additionally, to augment the model's capability to stitch sub-optimal trajectories, we incorporate a unique reward relabeling technique. To validate the effectiveness and superiority of EDT4Rec, we have conducted comprehensive experiments across six real-world offline datasets and in an online simulator.

cs.IR↗

arXiv2024

Retentive Decision Transformer with Adaptive Masking for Reinforcement Learning based Recommendation Systems

Reinforcement Learning-based Recommender Systems (RLRS) have shown promise across a spectrum of applications, from e-commerce platforms to streaming services. Yet, they grapple with challenges, notably in crafting reward functions and harnessing large pre-existing datasets within the RL framework. Recent advancements in offline RLRS provide a solution for how to address these two challenges. However, existing methods mainly rely on the transformer architecture, which, as sequence lengths increase, can introduce challenges associated with computational resources and training costs. Additionally, the prevalent methods employ fixed-length input trajectories, restricting their capacity to capture evolving user preferences. In this study, we introduce a new offline RLRS method to deal with the above problems. We reinterpret the RLRS challenge by modeling sequential decision-making as an inference task, leveraging adaptive masking configurations. This adaptive approach selectively masks input tokens, transforming the recommendation task into an inference challenge based on varying token subsets, thereby enhancing the agent's ability to infer across diverse trajectory lengths. Furthermore, we incorporate a multi-scale segmented retention mechanism that facilitates efficient modeling of long sequences, significantly enhancing computational efficiency. Our experimental analysis, conducted on both online simulator and offline datasets, clearly demonstrates the advantages of our proposed method.

cs.IR↗

arXiv2024

Computation Offloading for Multi-server Multi-access Edge Vehicular Networks: A DDQN-based Method

In this paper, we investigate a multi-user offloading problem in the overlapping domain of a multi-server mobile edge computing system. We divide the original problem into two stages: the offloading decision making stage and the request scheduling stage. To prevent the terminal from going out of service area during offloading, we consider the mobility parameter of the terminal according to the human behaviour model when making the offloading decision, and then introduce a server evaluation mechanism based on both the mobility parameter and the server load to select the optimal offloading server. In order to fully utilise the server resources, we design a double deep Q-network (DDQN)-based reward evaluation algorithm that considers the priority of tasks when scheduling offload requests. Finally, numerical simulations are conducted to verify that our proposed method outperforms traditional mathematical computation methods as well as the DQN algorithm.

cs.NI↗

arXiv2024

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Single-Program-Multiple-Data (SPMD) parallelism has recently been adopted to train large deep neural networks (DNNs). Few studies have explored its applicability on heterogeneous clusters, to fully exploit available resources for large model learning. This paper presents \OurSystem, an automated system designed to expedite SPMD DNN training on heterogeneous clusters. \OurSystem jointly optimizes the tensor sharding strategy, sharding ratios across heterogeneous devices and the communication methods for tensor exchanges for optimized distributed training with SPMD parallelism. We novelly formulate model partitioning as a program synthesis problem, in which we generate a distributed program from scratch on a distributed instruction set that semantically resembles the program designed for a single device, and systematically explore the solution space with an A*-based search algorithm. We derive the optimal tensor sharding ratios by formulating it as a linear programming problem. Additionally, \OurSystem explores tensor communication optimization in a heterogeneous cluster and integrates it as part of the program synthesis process, for automatically choosing optimal collective communication primitives and applying sufficient factor broadcasting technique. Extensive experiments on representative workloads demonstrate that \OurSystem achieves up to 2.41x speed-up on heterogeneous clusters.

cs.DC↗

arXiv2023

Plug-and-Play Model-Agnostic Counterfactual Policy Synthesis for Deep Reinforcement Learning based Recommendation

Recent advances in recommender systems have proved the potential of Reinforcement Learning (RL) to handle the dynamic evolution processes between users and recommender systems. However, learning to train an optimal RL agent is generally impractical with commonly sparse user feedback data in the context of recommender systems. To circumvent the lack of interaction of current RL-based recommender systems, we propose to learn a general Model-Agnostic Counterfactual Synthesis (MACS) Policy for counterfactual user interaction data augmentation. The counterfactual synthesis policy aims to synthesise counterfactual states while preserving significant information in the original state relevant to the user's interests, building upon two different training approaches we designed: learning with expert demonstrations and joint training. As a result, the synthesis of each counterfactual data is based on the current recommendation agent's interaction with the environment to adapt to users' dynamic interests. We integrate the proposed policy Deep Deterministic Policy Gradient (DDPG), Soft Actor Critic (SAC) and Twin Delayed DDPG in an adaptive pipeline with a recommendation agent that can generate counterfactual data to improve the performance of recommendation. The empirical results on both online simulation and offline datasets demonstrate the effectiveness and generalisation of our counterfactual synthesis policy and verify that it improves the performance of RL recommendation agents.

cs.IR↗

arXiv2023

GPU Scheduler for De Novo Genome Assembly with Multiple MPI Processes

$\textit{De Novo}$ Genome assembly is one of the most important tasks in computational biology. ELBA is the state-of-the-art distributed-memory parallel algorithm for overlap detection and layout simplification steps of $\textit{De Novo}$ genome assembly but exists a performance bottleneck in pairwise alignment. In this work, we proposed 3 GPU schedulers for ELBA to accommodate multiple MPI processes and multiple GPUs. The GPU schedulers enable multiple MPI processes to perform computation on GPUs in a round-robin fashion. Both strong and weak scaling experiments show that 3 schedulers are able to significantly improve the performance of baseline while there is a trade-off between parallelism and GPU scheduler overhead. For the best performance implementation, the one-to-one scheduler achieves $\sim$7-8$\times$ speed-up using 25 MPI processes compared with the baseline vanilla ELBA GPU scheduler.

cs.DC↗

arXiv2023

Causal Decision Transformer for Recommender Systems via Offline Reinforcement Learning

Reinforcement learning-based recommender systems have recently gained popularity. However, the design of the reward function, on which the agent relies to optimize its recommendation policy, is often not straightforward. Exploring the causality underlying users' behavior can take the place of the reward function in guiding the agent to capture the dynamic interests of users. Moreover, due to the typical limitations of simulation environments (e.g., data inefficiency), most of the work cannot be broadly applied in large-scale situations. Although some works attempt to convert the offline dataset into a simulator, data inefficiency makes the learning process even slower. Because of the nature of reinforcement learning (i.e., learning by interaction), it cannot collect enough data to train during a single interaction. Furthermore, traditional reinforcement learning algorithms do not have a solid capability like supervised learning methods to learn from offline datasets directly. In this paper, we propose a new model named the causal decision transformer for recommender systems (CDT4Rec). CDT4Rec is an offline reinforcement learning system that can learn from a dataset rather than from online interaction. Moreover, CDT4Rec employs the transformer architecture, which is capable of processing large offline datasets and capturing both short-term and long-term dependencies within the data to estimate the causal relationship between action, state, and reward. To demonstrate the feasibility and superiority of our model, we have conducted experiments on six real-world offline datasets and one online simulator.

cs.IR↗