Searcharxiv⌕ Search

arXiv subjects

Wei Yang

Publications and source records attributed to Wei Yang.

At least 307 records · Page 17Linked to original sources
arXiv2023

Identification of the melting line in the two-dimensional complex plasmas using an unsupervised machine learning method

Machine learning methods have been widely used in the investigations of the complex plasmas. In this paper, we demonstrate that the unsupervised convolutional neural network can be applied to obtain the melting line in the two-dimensional complex plasmas based on the Langevin dynamics simulation results. The training samples do not need to be labeled. The resulting melting line coincides with those obtained by the analysis of hexatic order parameter and supervised machine learning method.

physics.plasm-ph↗
arXiv2023

DyCL: Dynamic Neural Network Compilation Via Program Rewriting and Graph Optimization

DL compiler's primary function is to translate DNN programs written in high-level DL frameworks such as PyTorch and TensorFlow into portable executables. These executables can then be flexibly executed by the deployed host programs. However, existing DL compilers rely on a tracing mechanism, which involves feeding a runtime input to a neural network program and tracing the program execution paths to generate the computational graph necessary for compilation. Unfortunately, this mechanism falls short when dealing with modern dynamic neural networks (DyNNs) that possess varying computational graphs depending on the inputs. Consequently, conventional DL compilers struggle to accurately compile DyNNs into executable code. To address this limitation, we propose \tool, a general approach that enables any existing DL compiler to successfully compile DyNNs. \tool tackles the dynamic nature of DyNNs by introducing a compilation mechanism that redistributes the control and data flow of the original DNN programs during the compilation process. Specifically, \tool develops program analysis and program transformation techniques to convert a dynamic neural network into multiple sub-neural networks. Each sub-neural network is devoid of conditional statements and is compiled independently. Furthermore, \tool synthesizes a host module that models the control flow of the DyNNs and facilitates the invocation of the sub-neural networks. Our evaluation demonstrates the effectiveness of \tool, achieving a 100\% success rate in compiling all dynamic neural networks. Moreover, the compiled executables generated by \tool exhibit significantly improved performance, running between $1.12\times$ and $20.21\times$ faster than the original DyNNs executed on general-purpose DL frameworks.

cs.CL↗
arXiv2023

Density-dependent relativistic mean field approach and its application to single-$Λ$ hypernuclei in Oxygen isotopes

The in-medium feature of nuclear force which includes both nucleon-nucleon ($NN$) and hyperon-nucleon ($ΛN$) interactions impacts the description of single-$Λ$ hypernuclei. With the alternated mass number or isospin of hypernuclei, such effects could be unveiled by analyzing systematical evolution of the bulk and single-particle properties. From a density-dependent meson-nucleon/hyperon coupling perspective, a new $ΛN$ effective interaction in the covariant density functional (CDF) theory, namely DD-LZ1-$\Lambda1$, is obtained by fitting the experimental data of $Λ$ separation energies for several single-$Λ$ hypernuclei. It is then adopted to study the structure and transition properties of single-$Λ$ hypernuclei in Oxygen isotopes, comparing with several selected CDF Lagrangians. Discrepancy is observed explicitly in the isospin evolution of $\Lambda1p$ spin-orbit splitting with various effective interactions, ascribed to their divergence of the meson-hyperon coupling strengths with increasing density. In particular, the density-dependent CDFs introduce an extra contribution to enhance the isospin dependence of the splitting, which is originated from the rearrangement terms of $Λ$ self-energies. In addition, the characteristics of hypernuclear radii are studied along the isotopic chain. Owing to the impurity effect of $Λ$ hyperon, a size shrinkage is observed in the matter radii of hypernuclei as compared to their cores of normal nuclei, while its magnitude is elucidated further to correlate with the incompressibility of nuclear matter. Besides, there exists a sizable model-dependent trend that $Λ$ hyperon radii evolve with the neutron number, which is decided partly by the in-medium $NN$ interactions as well as the core polarization effects.

nucl-th↗
arXiv2023

Multi-RIS-aided Wireless Communications in Real-world: Prototyping and Field Trials

The performance of multiple reconfigurable intelligent surfaces (RISs) receives limited attention in previous studies. This article fills this research gap by investigating the capabilities of multiple RISs in real-world networks. We propose a simplified yet highly scalable sandwich architecture for implementing one-bit unit cells, with the flexibility to accommodate multi-bit unit cells. To effectively control multiple RISs, we present a cost-effective remote-controlling scheme and develop a cloud-based RIS management system. Through a series of four field trials, we demonstrate the effectiveness of multi-hop routing schemes in establishing reliable links. Our experiments reveal significant improvements in signal strength and data transmission in multi-RIS-aided Wi-Fi and commercial 5G networks. Furthermore, we investigate the power scaling law of RIS-aided beamforming and provide insights into the roles of the later nodes in multi-hop relay chains.

eess.SY↗
arXiv2023

Observation of first-order quantum phase transitions and ferromagnetism in twisted double bilayer graphene

Twisted graphene multilayers are highly tunable flatband systems for developing new phases of matter. Thus far, while orbital ferromagnetism has been observed in valley polarized phases, the long-range orders of other correlated phases as well as the quantum phase transitions between different orders mostly remain unknown. Here, we report an observation of Coulomb interaction driven first-order quantum phase transitions and ferromagnetism in twisted double bilayer graphene (TDBG). At zero magnetic field, the transitions are revealed in a series of step-like abrupt resistance jumps with prominent hysteresis loop when either the displacement field (D) or the carrier density (n) is tuned across symmetry-breaking boundary near half filling, indicating a formation of ordered domains. It is worth noting that the good turnability and switching of these states gives a rise to a memory performance with a large on/off ratio. Moreover, when both spin and valley play the roles at finite magnetic field, we observe abundant first-order quantum phase transitions among normal metallic states from charge neutral point, orbital ferromagnetic states from quarter filling, and spin-polarized states from half filling. We interpret these first-order phase transitions in the picture of phase separations and spin domain percolations driven by multi-field tunable Coulomb interactions, in agreement with Lifshitz transition from Hartree-Fock calculations. The observed multi-filed tunable domain structure and its hysteresis resembles the characteristics of multiferroics, revealing intriguing magnetoelectric properties. Our result enriches the correlated phase diagram in TDBG for discovering novel exotic phases and quantum phase transitions, and it would benefit other twisted moiré systems as well.

cond-mat.mes-hall↗
arXiv2023

SlothSpeech: Denial-of-service Attack Against Speech Recognition Models

Deep Learning (DL) models have been popular nowadays to execute different speech-related tasks, including automatic speech recognition (ASR). As ASR is being used in different real-time scenarios, it is important that the ASR model remains efficient against minor perturbations to the input. Hence, evaluating efficiency robustness of the ASR model is the need of the hour. We show that popular ASR models like Speech2Text model and Whisper model have dynamic computation based on different inputs, causing dynamic efficiency. In this work, we propose SlothSpeech, a denial-of-service attack against ASR models, which exploits the dynamic behaviour of the model. SlothSpeech uses the probability distribution of the output text tokens to generate perturbations to the audio such that efficiency of the ASR model is decreased. We find that SlothSpeech generated inputs can increase the latency up to 40X times the latency induced by benign input.

cs.SD↗
arXiv2023

Multi-level Cross-modal Feature Alignment via Contrastive Learning towards Zero-shot Classification of Remote Sensing Image Scenes

Zero-shot classification of image scenes which can recognize the image scenes that are not seen in the training stage holds great promise of lowering the dependence on large numbers of labeled samples. To address the zero-shot image scene classification, the cross-modal feature alignment methods have been proposed in recent years. These methods mainly focus on matching the visual features of each image scene with their corresponding semantic descriptors in the latent space. Less attention has been paid to the contrastive relationships between different image scenes and different semantic descriptors. In light of the challenge of large intra-class difference and inter-class similarity among image scenes and the potential noisy samples, these methods are susceptible to the influence of the instances which are far from these of the same classes and close to these of other classes. In this work, we propose a multi-level cross-modal feature alignment method via contrastive learning for zero-shot classification of remote sensing image scenes. While promoting the single-instance level positive alignment between each image scene with their corresponding semantic descriptors, the proposed method takes the cross-instance contrastive relationships into consideration,and learns to keep the visual and semantic features of different classes in the latent space apart from each other. Extensive experiments have been done to evaluate the performance of the proposed method. The results show that our proposed method outperforms state of the art methods for zero-shot remote sensing image scene classification. All the code and data are available at github https://github.com/masuqiang/MCFA-Pytorch

cs.CV↗
arXiv2023

Deep learning-based approach to reveal tumor mutational burden status from whole slide images across multiple cancer types

Tumor mutational burden (TMB) is a potential genomic biomarker of immunotherapy. However, TMB detected through whole exome sequencing lacks clinical penetration in low-resource settings. In this study, we proposed a multi-scale deep learning framework to address the detection of TMB status from routinely used whole slide images for a multiple cancer TMB prediction model (MC- TMB). The MC-TMB achieved a mean area under the curve (AUC) of 0.818 (0.804-0.831) in the cross-validation cohort, which showed superior performance to each single-scale model. The improvements of MC-TMB over the single-tumor models were also confirmed by the ablation tests on x10 magnification, and the highly concerned regions typically correspond to dense lymphocytic infiltration and heteromorphic tumor cells. MC-TMB algorithm also exhibited good generalization on the external validation cohort with an AUC of 0.732 (0.683-0.761), and better performance when compared to other methods. In conclusion, we proposed a deep learning-based approach to reveal tumor mutational burden status from routinely used pathological slides across multiple cancer types.

cs.CV↗
arXiv2023

Future-conditioned Unsupervised Pretraining for Decision Transformer

Recent research in offline reinforcement learning (RL) has demonstrated that return-conditioned supervised learning is a powerful paradigm for decision-making problems. While promising, return conditioning is limited to training data labeled with rewards and therefore faces challenges in learning from unsupervised data. In this work, we aim to utilize generalized future conditioning to enable efficient unsupervised pretraining from reward-free and sub-optimal offline data. We propose Pretrained Decision Transformer (PDT), a conceptually simple approach for unsupervised RL pretraining. PDT leverages future trajectory information as a privileged context to predict actions during training. The ability to make decisions based on both present and future factors enhances PDT's capability for generalization. Besides, this feature can be easily incorporated into a return-conditioned framework for online finetuning, by assigning return values to possible futures and sampling future embeddings based on their respective values. Empirically, PDT outperforms or performs on par with its supervised pretraining counterpart, especially when dealing with sub-optimal data. Further analysis reveals that PDT can extract diverse behaviors from offline data and controllably sample high-return behaviors by online finetuning. Code is available at here.

cs.LG↗
arXiv2023

Dynamics-Adaptive Continual Reinforcement Learning via Progressive Contextualization

A key challenge of continual reinforcement learning (CRL) in dynamic environments is to promptly adapt the RL agent's behavior as the environment changes over its lifetime, while minimizing the catastrophic forgetting of the learned information. To address this challenge, in this article, we propose DaCoRL, i.e., dynamics-adaptive continual RL. DaCoRL learns a context-conditioned policy using progressive contextualization, which incrementally clusters a stream of stationary tasks in the dynamic environment into a series of contexts and opts for an expandable multihead neural network to approximate the policy. Specifically, we define a set of tasks with similar dynamics as an environmental context and formalize context inference as a procedure of online Bayesian infinite Gaussian mixture clustering on environment features, resorting to online Bayesian inference to infer the posterior distribution over contexts. Under the assumption of a Chinese restaurant process prior, this technique can accurately classify the current task as a previously seen context or instantiate a new context as needed without relying on any external indicator to signal environmental changes in advance. Furthermore, we employ an expandable multihead neural network whose output layer is synchronously expanded with the newly instantiated context, and a knowledge distillation regularization term for retaining the performance on learned tasks. As a general framework that can be coupled with various deep RL algorithms, DaCoRL features consistent superiority over existing methods in terms of the stability, overall performance and generalization ability, as verified by extensive experiments on several robot navigation and MuJoCo locomotion tasks.

cs.LG↗
arXiv2023

Dynamic Transformers Provide a False Sense of Efficiency

Despite much success in natural language processing (NLP), pre-trained language models typically lead to a high computational cost during inference. Multi-exit is a mainstream approach to address this issue by making a trade-off between efficiency and accuracy, where the saving of computation comes from an early exit. However, whether such saving from early-exiting is robust remains unknown. Motivated by this, we first show that directly adapting existing adversarial attack approaches targeting model accuracy cannot significantly reduce inference efficiency. To this end, we propose a simple yet effective attacking framework, SAME, a novel slowdown attack framework on multi-exit models, which is specially tailored to reduce the efficiency of the multi-exit models. By leveraging the multi-exit models' design characteristics, we utilize all internal predictions to guide the adversarial sample generation instead of merely considering the final prediction. Experiments on the GLUE benchmark show that SAME can effectively diminish the efficiency gain of various multi-exit models by 80% on average, convincingly validating its effectiveness and generalization ability.

cs.CL↗
arXiv2023

Quantum oscillations in field-induced correlated insulators of a moiré superlattice

We report an observation of quantum oscillations (QOs) in the correlated insulators with valley anisotropy of twisted double bilayer graphene (TDBG). The anomalous QOs are best captured in the magneto resistivity oscillations of the insulators at v = -2, with a period of 1/B and an oscillation amplitude as high as 150 kΩ. The QOs can survive up to ~10 K, and above 12 K, the insulating behaviors are dominant. The QOs of the insulator are strongly D dependent: the carrier density extracted from the 1/B periodicity decreases almost linearly with D from -0.7 to -1.1 V/nm, suggesting a reduced Fermi surface; the effective mass from Lifshitz-Kosevich analysis depends nonlinearly on D, reaching a minimal value of 0.1 me at D = ~ -1.0 V/nm. Similar observations of QOs are also found at v = 2, as well as in other devices without graphite gate. We interpret the D sensitive QOs of the correlated insulators in the picture of band inversion. By reconstructing an inverted band model with the measured effective mass and Fermi surface, the density of state at the gap, calculated from thermal broadened Landau levels, agrees qualitatively with the observed QOs in the insulators. While more theoretical understandings are needed in the future to fully account for the anomalous QOs in this moiré system, our study suggests that TDBG is an excellent platform to discover exotic phases where correlation and topology are at play.

cond-mat.mes-hall↗
arXiv2023

HACK: Learning a Parametric Head and Neck Model for High-fidelity Animation

Significant advancements have been made in developing parametric models for digital humans, with various approaches concentrating on parts such as the human body, hand, or face. Nevertheless, connectors such as the neck have been overlooked in these models, with rich anatomical priors often unutilized. In this paper, we introduce HACK (Head-And-neCK), a novel parametric model for constructing the head and cervical region of digital humans. Our model seeks to disentangle the full spectrum of neck and larynx motions, facial expressions, and appearance variations, providing personalized and anatomically consistent controls, particularly for the neck regions. To build our HACK model, we acquire a comprehensive multi-modal dataset of the head and neck under various facial expressions. We employ a 3D ultrasound imaging scheme to extract the inner biomechanical structures, namely the precise 3D rotation information of the seven vertebrae of the cervical spine. We then adopt a multi-view photometric approach to capture the geometry and physically-based textures of diverse subjects, who exhibit a diverse range of static expressions as well as sequential head-and-neck movements. Using the multi-modal dataset, we train the parametric HACK model by separating the 3D head and neck depiction into various shape, pose, expression, and larynx blendshapes from the neutral expression and the rest skeletal pose. We adopt an anatomically-consistent skeletal design for the cervical region, and the expression is linked to facial action units for artist-friendly controls. HACK addresses the head and neck as a unified entity, offering more accurate and expressive controls, with a new level of realism, particularly for the neck regions. This approach has significant benefits for numerous applications and enables inter-correlation analysis between head and neck for fine-grained motion synthesis and transfer.

cs.GR↗
arXiv2023

Bézout Subresultants for Univariate Polynomials in General Basis

Subresultant is a powerful tool for developing various algorithms in computer algebra. Subresultants for polynomials in standard basis (i.e., power basis) have been well studied so far. With the popularity of basis-preserving algorithms, resultants and subresultants in non-standard basis are drawing more and more attention. In this paper, we develop a formula for Bézout subresultants of univariate polynomials in general basis, which covers a broad range of non-standard bases. More explicitly, the input polynomials are provided in a given general basis and the resulting subresultants are Bézout-type expressions in the same basis. It is shown that the subresultants share the essential properties as the subresultants in standard basis.

cs.SC↗
arXiv2023

Electron-infrared phonon coupling in ABC trilayer graphene

Stacking order plays a crucial role in determining the crystal symmetry and has significant impacts on electronic, optical, magnetic, and topological properties. Electron-phonon coupling, which is central to a wide range of intriguing quantum phenomena, is expected to be intricately connected with stacking order. Understanding the stacking order-dependent electron-phonon coupling is essential for understanding peculiar physical phenomena associated with electron-phonon coupling, such as superconductivity and charge density waves. In this study, we investigate the effect of stacking order on electron-infrared phonon coupling in graphene trilayers. By using gate-tunable Raman spectroscopy and excitation frequency-dependent near-field infrared nanoscopy, we show that rhombohedral ABC-stacked trilayer graphene has a significantly stronger electron-infrared phonon coupling strength than the Bernal ABA-stacked trilayer graphene. Our findings provide novel insights into the superconductivity and other fundamental physical properties of rhombohedral ABC-stacked trilayer graphene, and can enable nondestructive and high-throughput imaging of trilayer graphene stacking order using Raman scattering.

physics.optics↗
arXiv2023

Towards Effective and Interpretable Human-Agent Collaboration in MOBA Games: A Communication Perspective

MOBA games, e.g., Dota2 and Honor of Kings, have been actively used as the testbed for the recent AI research on games, and various AI systems have been developed at the human level so far. However, these AI systems mainly focus on how to compete with humans, less on exploring how to collaborate with humans. To this end, this paper makes the first attempt to investigate human-agent collaboration in MOBA games. In this paper, we propose to enable humans and agents to collaborate through explicit communication by designing an efficient and interpretable Meta-Command Communication-based framework, dubbed MCC, for accomplishing effective human-agent collaboration in MOBA games. The MCC framework consists of two pivotal modules: 1) an interpretable communication protocol, i.e., the Meta-Command, to bridge the communication gap between humans and agents; 2) a meta-command value estimator, i.e., the Meta-Command Selector, to select a valuable meta-command for each agent to achieve effective human-agent collaboration. Experimental results in Honor of Kings demonstrate that MCC agents can collaborate reasonably well with human teammates and even generalize to collaborate with different levels and numbers of human teammates. Videos are available at https://sites.google.com/view/mcc-demo.

cs.AI↗
arXiv2023

Discovering and Explaining the Non-Causality of Deep Learning in SAR ATR

In recent years, deep learning has been widely used in SAR ATR and achieved excellent performance on the MSTAR dataset. However, due to constrained imaging conditions, MSTAR has data biases such as background correlation, i.e., background clutter properties have a spurious correlation with target classes. Deep learning can overfit clutter to reduce training errors. Therefore, the degree of overfitting for clutter reflects the non-causality of deep learning in SAR ATR. Existing methods only qualitatively analyze this phenomenon. In this paper, we quantify the contributions of different regions to target recognition based on the Shapley value. The Shapley value of clutter measures the degree of overfitting. Moreover, we explain how data bias and model bias contribute to non-causality. Concisely, data bias leads to comparable signal-to-clutter ratios and clutter textures in training and test sets. And various model structures have different degrees of overfitting for these biases. The experimental results of various models under standard operating conditions on the MSTAR dataset support our conclusions. Our code is available at https://github.com/waterdisappear/Data-Bias-in-MSTAR.

cs.CV↗
arXiv2023

Differentially Private Numerical Vector Analyses in the Local and Shuffle Model

Numerical vector aggregation plays a crucial role in privacy-sensitive applications, such as distributed gradient estimation in federated learning and statistical analysis of key-value data. In the context of local differential privacy, this study provides a tight minimax error bound of $O(\frac{ds}{nε^2})$, where $d$ represents the dimension of the numerical vector and $s$ denotes the number of non-zero entries. By converting the conditional/unconditional numerical mean estimation problem into a frequency estimation problem, we develop an optimal and efficient mechanism called Collision. In contrast, existing methods exhibit sub-optimal error rates of $O(\frac{d^2}{nε^2})$ or $O(\frac{ds^2}{nε^2})$. Specifically, for unconditional mean estimation, we leverage the negative correlation between two frequencies in each dimension and propose the CoCo mechanism, which further reduces estimation errors for mean values compared to Collision. Moreover, to surpass the error barrier in local privacy, we examine privacy amplification in the shuffle model for the proposed mechanisms and derive precisely tight amplification bounds. Our experiments validate and compare our mechanisms with existing approaches, demonstrating significant error reductions for frequency estimation and mean estimation on numerical vectors.

cs.CR↗