Searcharxiv⌕ Search

arXiv subjects

Rui Zhou

Publications and source records attributed to Rui Zhou.

At least 109 records · Page 6Linked to original sources
arXiv2024

MATRIX: Multi-Agent Trajectory Generation with Diverse Contexts

Data-driven methods have great advantages in modeling complicated human behavioral dynamics and dealing with many human-robot interaction applications. However, collecting massive and annotated real-world human datasets has been a laborious task, especially for highly interactive scenarios. On the other hand, algorithmic data generation methods are usually limited by their model capacities, making them unable to offer realistic and diverse data needed by various application users. In this work, we study trajectory-level data generation for multi-human or human-robot interaction scenarios and propose a learning-based automatic trajectory generation model, which we call Multi-Agent TRajectory generation with dIverse conteXts (MATRIX). MATRIX is capable of generating interactive human behaviors in realistic diverse contexts. We achieve this goal by modeling the explicit and interpretable objectives so that MATRIX can generate human motions based on diverse destinations and heterogeneous behaviors. We carried out extensive comparison and ablation studies to illustrate the effectiveness of our approach across various metrics. We also presented experiments that demonstrate the capability of MATRIX to serve as data augmentation for imitation-based motion planning.

cs.RO↗
arXiv2024

Internal Cross-layer Gradients for Extending Homogeneity to Heterogeneity in Federated Learning

Federated learning (FL) inevitably confronts the challenge of system heterogeneity in practical scenarios. To enhance the capabilities of most model-homogeneous FL methods in handling system heterogeneity, we propose a training scheme that can extend their capabilities to cope with this challenge. In this paper, we commence our study with a detailed exploration of homogeneous and heterogeneous FL settings and discover three key observations: (1) a positive correlation between client performance and layer similarities, (2) higher similarities in the shallow layers in contrast to the deep layers, and (3) the smoother gradients distributions indicate the higher layer similarities. Building upon these observations, we propose InCo Aggregation that leverages internal cross-layer gradients, a mixture of gradients from shallow and deep layers within a server model, to augment the similarity in the deep layers without requiring additional communication between clients. Furthermore, our methods can be tailored to accommodate model-homogeneous FL methods such as FedAvg, FedProx, FedNova, Scaffold, and MOON, to expand their capabilities to handle the system heterogeneity. Copious experimental results validate the effectiveness of InCo Aggregation, spotlighting internal cross-layer gradients as a promising avenue to enhance the performance in heterogeneous FL.

cs.LG↗
arXiv2024

Mel-FullSubNet: Mel-Spectrogram Enhancement for Improving Both Speech Quality and ASR

In this work, we propose Mel-FullSubNet, a single-channel Mel-spectrogram denoising and dereverberation network for improving both speech quality and automatic speech recognition (ASR) performance. Mel-FullSubNet takes as input the noisy and reverberant Mel-spectrogram and predicts the corresponding clean Mel-spectrogram. The enhanced Mel-spectrogram can be either transformed to speech waveform with a neural vocoder or directly used for ASR. Mel-FullSubNet encapsulates interleaved full-band and sub-band networks, for learning the full-band spectral pattern of signals and the sub-band/narrow-band properties of signals, respectively. Compared to linear-frequency domain or time-domain speech enhancement, the major advantage of Mel-spectrogram enhancement is that Mel-frequency presents speech in a more compact way and thus is easier to learn, which will benefit both speech quality and ASR. Experimental results demonstrate a significant improvement in both speech quality and ASR performance achieved by the proposed model.

eess.AS↗
arXiv2024

Cas-DiffCom: Cascaded diffusion model for infant longitudinal super-resolution 3D medical image completion

Early infancy is a rapid and dynamic neurodevelopmental period for behavior and neurocognition. Longitudinal magnetic resonance imaging (MRI) is an effective tool to investigate such a crucial stage by capturing the developmental trajectories of the brain structures. However, longitudinal MRI acquisition always meets a serious data-missing problem due to participant dropout and failed scans, making longitudinal infant brain atlas construction and developmental trajectory delineation quite challenging. Thanks to the development of an AI-based generative model, neuroimage completion has become a powerful technique to retain as much available data as possible. However, current image completion methods usually suffer from inconsistency within each individual subject in the time dimension, compromising the overall quality. To solve this problem, our paper proposed a two-stage cascaded diffusion model, Cas-DiffCom, for dense and longitudinal 3D infant brain MRI completion and super-resolution. We applied our proposed method to the Baby Connectome Project (BCP) dataset. The experiment results validate that Cas-DiffCom achieves both individual consistency and high fidelity in longitudinal infant brain image completion. We further applied the generated infant brain images to two downstream tasks, brain tissue segmentation and developmental trajectory delineation, to declare its task-oriented potential in the neuroscience field.

eess.IV↗
arXiv2024

Field-induced phase transitions and quantum criticality in a honeycomb antiferromagnet Na3Co2SbO6

We performed 23Na NMR measurements on a single-domain crystal of the Kitaev material Na3Co2SbO6, with magnetic field applied along the crystalline a axis. A positive Curie-Weiss constant is obtained from the NMR Knight shift, which suggests the existence of ferromagnetic exchange couplings. The antiferromagnetic ordering is found to be suppressed at a field of 1.9 T. Inside the ordered phase, our data reveal two additional phase transitions. At 1.9 T, the spin-lattice relaxation rate 1/23T1 establishes a quantum critical behavior at high temperatures. However, at low temperatures, a gapped behavior is observed at the critical field, which suggests a weakly first-order transition instead and a possible field-induced quantum spin liquid. Our results reveal complex microscopic interactions in the system, which may help to search for possible quantum spin liquids.

cond-mat.str-el↗
arXiv2023

A Novel Field-Free SOT Magnetic Tunnel Junction With Local VCMA-Induced Switching

By integrating the local voltage-controlled magnetic anisotropy (VCMA) effect, Dzyaloshinskii-Moriya interaction (DMI) effect, and spin-orbit torque (SOT) effect, we propose a novel device structure for field-free magnetic tunnel junction (MTJ). Micromagnetic simulation shows that the device utilizes the chiral symmetry breaking caused by the DMI effect to induce a non-collinear spin texture under the influence of SOT current. This, combined with the perpendicular magnetic anisotropy (PMA) gradient generated by the local VCMA effect, enables deterministic switching of the MTJ state without an external field. The impact of variations in DMI strength and PMA gradient on the magnetization dynamics is analyzed.

eess.SP↗
arXiv2023

Protected Transverse Electric Waves in Topological Dielectric Waveguides

Waveguides are fundamental components in communication systems. However, they suffer from reflection and scattering losses at sharp routes or defects. The breakthrough in developing topological photonic crystals (PhCs) provides promising solutions to robust signal transmission. In this work, we propose a new mechanism for protecting wave-guiding modes by decorating the boundaries of a conventional waveguide with valley-Hall PhCs. This special layout enables the robust propagation of conventional transverse electric waves against defects and bends. Moreover, the proposed waveguide is compatible with the substrate integrated waveguide (SIW). High efficient mode conversion from the SIW to the proposed waveguide is achievable. By leveraging the idea of topology to conventional waveguides, we provide a powerful and practical tool that can largely improve the performance of microwave and millimeter-wave integrated circuits while reserving the features of wave-guiding modes.

physics.app-ph↗
arXiv2023

Observation of Emergent Superconductivity in the Quantum Spin Hall Insulator Ta2Pd3Te5 via Pressure Manipulation

Quantum Spin Hall (QSH) insulators possess distinct helical in-gap states, enabling their edge states to act as one-dimensional conducting channels when backscattering is prohibited by time-reversal symmetry. However, it remains challenging to achieve high-performance combinations of nontrivial topological QSH states with superconductivity for applications and requires understanding of the complicated underlying mechanisms. Here, our experimental observations for a novel superconducting phase in the pressurized QSH insulator Ta2Pd3Te5 is reported, and the high-pressure phase maintains its original ambient pressure lattice symmetry up to 45 GPa. Our in-situ high-pressure synchrotron X-ray diffraction, electrical transport, infrared reflectance, and Raman spectroscopy measurements, in combination with rigorous theoretical calculations, provide compelling evidence for the association between the superconducting behavior and the abnormal densified phase. The isostructural transition was found to modify the topology of the Fermi surface directly, accompanied by a fivefold amplification of the density of states at 20 GPa compared to ambient pressure, which synergistically fosters the emergence of robust superconductivity. A profound comprehension of the fascinating properties exhibited by the compressed Ta2Pd3Te5 phase is achieved, highlighting the extraordinary potential of van der Waals (vdW) QSH insulators for exploring and investigating high-performance electronic advanced devices under extreme conditions.

cond-mat.mtrl-sci↗
arXiv2023

A topological gap waveguide based on unidirectional locking of pseudo-spins

Photonic topological insulators (PTIs) have been widely studied due to the robustness of energy transport via supported edge modes immune to structural disorder. In this work, a topological gap waveguide is constructed by introducing line defect into a topological photonic crystal structure and combining it with a gap waveguide structure, which design therefore combines the advantages of both topological and gap waveguides. Not only does it give high transmission efficiency, but also enables high robustness for energy transmission under structural defects and sharp bends. Our proposed topological waveguide design can be implemented with conventional semiconductor technology and integrated into optical circuits for communication systems.

physics.app-ph↗
arXiv2023

Efficient and Scalable Parametric High-Order Portfolios Design via the Skew-t Distribution

Since Markowitz's mean-variance framework, optimizing a portfolio that maximizes the profit and minimizes the risk has been ubiquitous in the financial industry. Initially, profit and risk were measured by the first two moments of the portfolio's return, a.k.a. the mean and variance, which are sufficient to characterize a Gaussian distribution. However, it is broadly believed that the first two moments are not enough to capture the characteristics of the returns' behavior, which have been recognized to be asymmetric and heavy-tailed. Although there is ample evidence that portfolio designs involving the third and fourth moments, i.e., skewness and kurtosis, will outperform the conventional mean-variance framework, they are non-trivial. Specifically, in the classical framework, the memory and computational cost of computing the skewness and kurtosis grow sharply with the number of assets. To alleviate the difficulty in high-dimensional problems, we consider an alternative expression for high-order moments based on parametric representations via a generalized hyperbolic skew-t distribution. Then, we reformulate the high-order portfolio optimization problem as a fixed-point problem and propose a robust fixed-point acceleration algorithm that solves the problem in an efficient and scalable manner. Empirical experiments also demonstrate that our proposed high-order portfolio optimization framework is of low complexity and significantly outperforms the state-of-the-art methods by 2 to 4 orders of magnitude.

eess.SP↗
arXiv2023

Quantum Algorithm for Maximum Biclique Problem

Identifying a biclique with the maximum number of edges bears considerable implications for numerous fields of application, such as detecting anomalies in E-commerce transactions, discerning protein-protein interactions in biology, and refining the efficacy of social network recommendation algorithms. However, the inherent NP-hardness of this problem significantly complicates the matter. The prohibitive time complexity of existing algorithms is the primary bottleneck constraining the application scenarios. Aiming to address this challenge, we present an unprecedented exploration of a quantum computing approach. Efficient quantum algorithms, as a crucial future direction for handling NP-hard problems, are presently under intensive investigation, of which the potential has already been proven in practical arenas such as cybersecurity. However, in the field of quantum algorithms for graph databases, little work has been done due to the challenges presented by the quantum representation of complex graph topologies. In this study, we delve into the intricacies of encoding a bipartite graph on a quantum computer. Given a bipartite graph with n vertices, we propose a ground-breaking algorithm qMBS with time complexity O^*(2^(n/2)), illustrating a quadratic speed-up in terms of complexity compared to the state-of-the-art. Furthermore, we detail two variants tailored for the maximum vertex biclique problem and the maximum balanced biclique problem. To corroborate the practical performance and efficacy of our proposed algorithms, we have conducted proof-of-principle experiments utilizing IBM quantum simulators, of which the results provide a substantial validation of our approach to the extent possible to date.

quant-ph↗
arXiv2023

A novel automatic wind power prediction framework based on multi-time scale and temporal attention mechanisms

Wind energy is a widely distributed, renewable, and environmentally friendly energy source that plays a crucial role in mitigating global warming and addressing energy shortages. Nevertheless, wind power generation is characterized by volatility, intermittence, and randomness, which hinder its ability to serve as a reliable power source for the grid. Accurate wind power forecasting is crucial for developing a new power system that heavily relies on renewable energy sources. However, traditional wind power forecasting systems primarily focus on ultra-short-term or short-term forecasts, limiting their ability to address the diverse adjustment requirements of the power system simultaneously. To overcome these challenges, We propose an automatic framework capable of forecasting wind power across multi-time scale. The framework based on the tree-structured Parzen estimator (TPE) and temporal fusion transformer (TFT) that can provide ultra-short-term, short-term and medium-term wind power forecasting power.Our approach employs the TFT for wind power forecasting and categorizes features based on their properties. Additionally, we introduce a generic algorithm to simultaneously fine-tune the hyperparameters of the decomposition method and model. We evaluate the performance of our framework by conducting ablation experiments using three commonly used decomposition algorithms and six state-of-the-art models for forecasting multi-time scale. The experimental results demonstrate that our proposed method considerably improves prediction accuracy on the public dataset Engie https://opendata-renewables.engie.com. Compared to the second-best state-of-the-art model, our approach exhibits a reduction of 31.75% and 28.74% in normalized mean absolute error (nMAE) for 24-hour forecasting, and 20.79% and 16.93% in nMAE for 48-hour forecasting, respectively.

cs.LG↗
arXiv2023

Network Topology Inference with Sparsity and Laplacian Constraints

We tackle the network topology inference problem by utilizing Laplacian constrained Gaussian graphical models, which recast the task as estimating a precision matrix in the form of a graph Laplacian. Recent research \cite{ying2020nonconvex} has uncovered the limitations of the widely used $\ell_1$-norm in learning sparse graphs under this model: empirically, the number of nonzero entries in the solution grows with the regularization parameter of the $\ell_1$-norm; theoretically, a large regularization parameter leads to a fully connected (densest) graph. To overcome these challenges, we propose a graph Laplacian estimation method incorporating the $\ell_0$-norm constraint. An efficient gradient projection algorithm is developed to solve the resulting optimization problem, characterized by sparsity and Laplacian constraints. Through numerical experiments with synthetic and financial time-series datasets, we demonstrate the effectiveness of the proposed method in network topology inference.

cs.LG↗
arXiv2023

The coupling effect between the environment and strategies drives the emergence of group cooperation

Introducing environmental feedback into evolutionary game theory has led to the development of eco-evolutionary games, which have gained popularity due to their ability to capture the intricate interplay between the environment and decision-making processes. However, current researches in this field focus on the study to macroscopic evolutionary dynamics in infinite populations. In this study, we propose a multi-agent computational model based on reinforcement learning to explore the coupled dynamics between strategies and the environment in finite populations from a bottom-up perspective. Our findings indicate that even in environments that favor defectors, high levels of group cooperation can emerge from self-interested individuals, highlighting the significant role of the coupling effect between the environment and strategies. Over time, the higher payoff of defection can be diluted due to environmental degradation, while cooperation can become the dominant strategy when positively reinforced by the environment. Remarkably, individuals can accurately detect the inflection point of the environment solely through rewards, when a reinforcing positive feedback loop are triggered, resulting in a rapid increase in agents' rewards and facilitating the establishment and maintenance of group cooperation. Our research provides a fresh perspective on understanding the emergence of group cooperation and sheds light on the underlying mechanisms involving individuals and the environment.

physics.bio-ph↗
arXiv2023

Multi-modal Machine Learning in Engineering Design: A Review and Future Directions

In the rapidly advancing field of multi-modal machine learning (MMML), the convergence of multiple data modalities has the potential to reshape various applications. This paper presents a comprehensive overview of the current state, advancements, and challenges of MMML within the sphere of engineering design. The review begins with a deep dive into five fundamental concepts of MMML:multi-modal information representation, fusion, alignment, translation, and co-learning. Following this, we explore the cutting-edge applications of MMML, placing a particular emphasis on tasks pertinent to engineering design, such as cross-modal synthesis, multi-modal prediction, and cross-modal information retrieval. Through this comprehensive overview, we highlight the inherent challenges in adopting MMML in engineering design, and proffer potential directions for future research. To spur on the continued evolution of MMML in engineering design, we advocate for concentrated efforts to construct extensive multi-modal design datasets, develop effective data-driven MMML techniques tailored to design applications, and enhance the scalability and interpretability of MMML models. MMML models, as the next generation of intelligent design tools, hold a promising future to impact how products are designed.

cs.LG↗
arXiv2023

Boundary Distribution Estimation for Precise Object Detection

In the field of state-of-the-art object detection, the task of object localization is typically accomplished through a dedicated subnet that emphasizes bounding box regression. This subnet traditionally predicts the object's position by regressing the box's center position and scaling factors. Despite the widespread adoption of this approach, we have observed that the localization results often suffer from defects, leading to unsatisfactory detector performance. In this paper, we address the shortcomings of previous methods through theoretical analysis and experimental verification and present an innovative solution for precise object detection. Instead of solely focusing on the object's center and size, our approach enhances the accuracy of bounding box localization by refining the box edges based on the estimated distribution at the object's boundary. Experimental results demonstrate the potential and generalizability of our proposed method.

cs.CV↗
arXiv2023

Phase transitions associated with magnetic-field induced topological orbital momenta in a non-collinear antiferromagnet

Resistivity measurements are widely exploited to uncover electronic excitations and phase transitions in metallic solids. While single crystals are preferably studied to explore crystalline anisotropies, these usually cancel out in polycrystalline materials. Here we show that in polycrystalline Mn3Zn0.5Ge0.5N with non-collinear antiferromagnetic order, changes in the diagonal and, rather unexpected, off-diagonal components of the resistivity tensor occur at low temperatures indicating subtle transitions between magnetic phases of different symmetry. This is supported by neutron scattering and explained within a phenomenological model which suggests that the phase transitions in magnetic field are associated with field induced topological orbital momenta. The fact that we observe transitions between spin phases in a polycrystal, where effects of crystalline anisotropy are cancelled suggests that they are only controlled by exchange interactions. The observation of an off-diagonal resistivity extends the possibilities for realising antiferromagnetic spintronics with polycrystalline materials.

cond-mat.mtrl-sci↗
arXiv2023

Speech Dereverberation with a Reverberation Time Shortening Target

This work proposes a new learning target based on reverberation time shortening (RTS) for speech dereverberation. The learning target for dereverberation is usually set as the direct-path speech or optionally with some early reflections. This type of target suddenly truncates the reverberation, and thus it may not be suitable for network training. The proposed RTS target suppresses reverberation and meanwhile maintains the exponential decaying property of reverberation, which will ease the network training, and thus reduce signal distortion caused by the prediction error. Moreover, this work experimentally study to adapt our previously proposed FullSubNet speech denoising network to speech dereverberation. Experiments show that RTS is a more suitable learning target than direct-path speech and early reflections, in terms of better suppressing reverberation and signal distortion. FullSubNet is able to achieve outstanding dereverberation performance.

eess.AS↗