SearcharxivSearch

arXiv subjects

Xuebin Wang

Publications and source records attributed to Xuebin Wang.

15 recordsLinked to original sources

Chiral Packings in Cylinders are Ultrasensitive to Confinement Deformation

Sphere packings in circular cylinders have attracted substantial research interest, among which the discovery of chiral helical structures is the most iconic. However, recent experimental results on zebrafish do not match the known packing structures in circular cylinders. To account for the inherent imperfections of biological tubes, we take elliptic cylinders as the canonical deformation of circular cylinders and investigate the densest packings of hard spheres in them using simulation, theory, and experiments. Starting from the chiral structures in circular cylinders, we demonstrate that even a weak cross-sectional deformation can trigger entirely new phases, including ones that either eliminate global chirality or significantly complicate the chiral structures. This reveals the significant effect of cylindrical anisotropy. The new helical phases under anisotropic confinement remain chiral and develop hierarchical periodic structures, which are difficult to obtain by simulations but are predicted by our newly developed theory for helical phases in elliptic cylinders. The theory also predicts double oscillated-chain phases without chirality, which perfectly match the simulations. Our work offers fresh insights into understanding packings in anisotropic cylinders, which will help researchers to design new materials and to understand many living systems.

cond-mat.soft

From Essence to Defense: Adaptive Semantic-aware Watermarking for Embedding-as-a-Service Copyright Protection

Benefiting from the superior capabilities of large language models in natural language understanding and generation, Embeddings-as-a-Service (EaaS) has emerged as a successful commercial paradigm on the web platform. However, prior studies have revealed that EaaS is vulnerable to imitation attacks. Existing methods protect the intellectual property of EaaS through watermarking techniques, but they all ignore the most important properties of embedding: semantics, resulting in limited harmlessness and stealthiness. To this end, we propose SemMark, a novel semantic-based watermarking paradigm for EaaS copyright protection. SemMark employs locality-sensitive hashing to partition the semantic space and inject semantic-aware watermarks into specific regions, ensuring that the watermark signals remain imperceptible and diverse. In addition, we introduce the adaptive watermark weight mechanism based on the local outlier factor to preserve the original embedding distribution. Furthermore, we propose Detect-Sampling and Dimensionality-Reduction attacks and construct four scenarios to evaluate the watermarking method. Extensive experiments are conducted on four popular NLP datasets, and SemMark achieves superior verifiability, diversity, stealthiness, and harmlessness.

cs.CR

Mining Word Boundaries from Speech-Text Parallel Data for Cross-domain Chinese Word Segmentation

Inspired by early research on exploring naturally annotated data for Chinese Word Segmentation (CWS), and also by recent research on integration of speech and text processing, this work for the first time proposes to explicitly mine word boundaries from speech-text parallel data. We employ the Montreal Forced Aligner (MFA) toolkit to perform character-level alignment on speech-text data, giving pauses as candidate word boundaries. Based on detailed analysis of collected pauses, we propose an effective probability-based strategy for filtering unreliable word boundaries. To more effectively utilize word boundaries as extra training data, we also propose a robust complete-then-train (CTT) strategy. We conduct cross-domain CWS experiments on two target domains, i.e., ZX and AISHELL2. We have annotated about 1,000 sentences as the evaluation data of AISHELL2. Experiments demonstrate the effectiveness of our proposed approach.

cs.CL

An Artificial Neural Network for Image Classification Inspired by Aversive Olfactory Learning Circuits in Caenorhabditis Elegans

This study introduces an artificial neural network (ANN) for image classification task, inspired by the aversive olfactory learning circuits of the nematode Caenorhabditis elegans (C. elegans). Despite the remarkable performance of ANNs in a variety of tasks, they face challenges such as excessive parameterization, high training costs and limited generalization capabilities. C. elegans, with its simple nervous system comprising only 302 neurons, serves as a paradigm in neurobiological research and is capable of complex behaviors including learning. This research identifies key neural circuits associated with aversive olfactory learning in C. elegans through behavioral experiments and high-throughput gene sequencing, translating them into an image classification ANN architecture. Additionally, two other image classification ANNs with distinct architectures were constructed for comparative performance analysis to highlight the advantages of bio-inspired design. The results indicate that the ANN inspired by the aversive olfactory learning circuits of C. elegans achieves higher accuracy, better consistency and faster convergence rates in image classification task, especially when tackling more complex classification challenges. This study not only showcases the potential of bio-inspired design in enhancing ANN capabilities but also provides a novel perspective and methodology for future ANN design.

cs.NE

Leveraging Data Mining, Active Learning, and Domain Adaptation in a Multi-Stage, Machine Learning-Driven Approach for the Efficient Discovery of Advanced Acidic Oxygen Evolution Electrocatalysts

Developing advanced catalysts for acidic oxygen evolution reaction (OER) is crucial for sustainable hydrogen production. This study introduces a novel, multi-stage machine learning (ML) approach to streamline the discovery and optimization of complex multi-metallic catalysts. Our method integrates data mining, active learning, and domain adaptation throughout the materials discovery process. Unlike traditional trial-and-error methods, this approach systematically narrows the exploration space using domain knowledge with minimized reliance on subjective intuition. Then the active learning module efficiently refines element composition and synthesis conditions through iterative experimental feedback. The process culminated in the discovery of a promising Ru-Mn-Ca-Pr oxide catalyst. Our workflow also enhances theoretical simulations with domain adaptation strategy, providing deeper mechanistic insights aligned with experimental findings. By leveraging diverse data sources and multiple ML strategies, we establish an efficient pathway for electrocatalyst discovery and optimization. This comprehensive, data-driven approach represents a paradigm shift and potentially new benchmark in electrocatalysts research.

cond-mat.mtrl-sci

FlightPatchNet: Multi-Scale Patch Network with Differential Coding for Flight Trajectory Prediction

Accurate multi-step flight trajectory prediction plays an important role in Air Traffic Control, which can ensure the safety of air transportation. Two main issues limit the flight trajectory prediction performance of existing works. The first issue is the negative impact on prediction accuracy caused by the significant differences in data range. The second issue is that real-world flight trajectories involve underlying temporal dependencies, and most existing methods fail to reveal the hidden complex temporal variations and extract features from one single time scale. To address the above issues, we propose FlightPatchNet, a multi-scale patch network with differential coding for flight trajectory prediction. Specifically, FlightPatchNet first utilizes differential coding to encode the original values of longitude and latitude into first-order differences and generates embeddings for all variables at each time step. Then, global temporal attention is introduced to explore the dependencies between different time steps. To fully explore the diverse temporal patterns in flight trajectories, a multi-scale patch network is delicately designed to serve as the backbone. The multi-scale patch network exploits stacked patch mixer blocks to capture inter- and intra-patch dependencies under different time scales, and further integrates multi-scale temporal features across different scales and variables. Finally, FlightPatchNet ensembles multiple predictors to make direct multi-step prediction. Extensive experiments on ADS-B datasets demonstrate that our model outperforms the competitive baselines.

cs.CV

Adaptive Data Augmentation for Aspect Sentiment Quad Prediction

Aspect sentiment quad prediction (ASQP) aims to predict the quad sentiment elements for a given sentence, which is a critical task in the field of aspect-based sentiment analysis. However, the data imbalance issue has not received sufficient attention in ASQP task. In this paper, we divide the issue into two-folds, quad-pattern imbalance and aspect-category imbalance, and propose an Adaptive Data Augmentation (ADA) framework to tackle the imbalance issue. Specifically, a data augmentation process with a condition function adaptively enhances the tail quad patterns and aspect categories, alleviating the data imbalance in ASQP. Following previous studies, we also further explore the generative framework for extracting complete quads by introducing the category prior knowledge and syntax-guided decoding target. Experimental results demonstrate that data augmentation for imbalance in ASQP task can improve the performance, and the proposed ADA method is superior to naive data oversampling.

cs.CL

How Well Do Large Language Models Understand Syntax? An Evaluation by Asking Natural Language Questions

While recent advancements in large language models (LLMs) bring us closer to achieving artificial general intelligence, the question persists: Do LLMs truly understand language, or do they merely mimic comprehension through pattern recognition? This study seeks to explore this question through the lens of syntax, a crucial component of sentence comprehension. Adopting a natural language question-answering (Q&A) scheme, we craft questions targeting nine syntactic knowledge points that are most closely related to sentence comprehension. Experiments conducted on 24 LLMs suggest that most have a limited grasp of syntactic knowledge, exhibiting notable discrepancies across different syntactic knowledge points. In particular, questions involving prepositional phrase attachment pose the greatest challenge, whereas those concerning adjectival modifier and indirect object are relatively easier for LLMs to handle. Furthermore, a case study on the training dynamics of the LLMs reveals that the majority of syntactic knowledge is learned during the initial stages of training, hinting that simply increasing the number of training tokens may not be the `silver bullet' for improving the comprehension ability of LLMs.

cs.CL

Prompt2Gaussia: Uncertain Prompt-learning for Script Event Prediction

Script Event Prediction (SEP) aims to predict the subsequent event for a given event chain from a candidate list. Prior research has achieved great success by integrating external knowledge to enhance the semantics, but it is laborious to acquisite the appropriate knowledge resources and retrieve the script-related knowledge. In this paper, we regard public pre-trained language models as knowledge bases and automatically mine the script-related knowledge via prompt-learning. Still, the scenario-diversity and label-ambiguity in scripts make it uncertain to construct the most functional prompt and label token in prompt learning, i.e., prompt-uncertainty and verbalizer-uncertainty. Considering the innate ability of Gaussian distribution to express uncertainty, we deploy the prompt tokens and label tokens as random variables following Gaussian distributions, where a prompt estimator and a verbalizer estimator are proposed to estimate their probabilistic representations instead of deterministic representations. We take the lead to explore prompt-learning in SEP and provide a fresh perspective to enrich the script semantics. Our method is evaluated on the most widely used benchmark and a newly proposed large-scale one. Experiments show that our method, which benefits from knowledge evoked from pre-trained language models, outperforms prior baselines by 1.46\% and 1.05\% on two benchmarks, respectively.

cs.CL

Optimal and Low-Memory Near-Optimal Preconditioning of Fully Implicit Runge-Kutta Schemes for Parabolic PDEs

Runge-Kutta (RK) schemes, especially Gauss-Legendre and some other fully implicit RK (FIRK) schemes, are desirable for the time integration of parabolic partial differential equations due to their A-stability and high-order accuracy. However, it is significantly more challenging to construct optimal preconditioners for them compared to diagonally implicit RK (or DIRK) schemes. To address this challenge, we first introduce mathematically optimal preconditioners called block complex Schur decomposition (BCSD), block real Schur decomposition (BRSD), and block Jordan form (BJF), motivated by block-circulant preconditioners and Jordan form solution techniques for IRK. We then derive an efficient, near-optimal singly-diagonal approximate BRSD (SABRSD) by approximating the quasi-triangular matrix in real Schur decomposition using an optimized upper-triangular matrix with a single diagonal value. A desirable feature of SABRSD is that it has comparable memory requirements and factorization (or setup) cost as singly DIRK (SDIRK). We approximate the diagonal blocks in these preconditioning techniques using an incomplete factorization with (near) linear complexity, such as multilevel ILU, ILU(0), or a multigrid method with an ILU-based smoother. We apply the block preconditioners in right-preconditioned GMRES to solve the advection-diffusion equation in 3D using finite element and finite difference methods. We show that BCSD, BRSD, and BJF significantly outperform other preconditioners in terms of GMRES iterations, and SABRSD is competitive with them and the prior state of the art in terms of computational cost while requiring the least amount of memory.

math.NA

Edge-Enhanced Graph Convolution Networks for Event Detection with Syntactic Relation

Event detection (ED), a key subtask of information extraction, aims to recognize instances of specific event types in text. Previous studies on the task have verified the effectiveness of integrating syntactic dependency into graph convolutional networks. However, these methods usually ignore dependency label information, which conveys rich and useful linguistic knowledge for ED. In this paper, we propose a novel architecture named Edge-Enhanced Graph Convolution Networks (EE-GCN), which simultaneously exploits syntactic structure and typed dependency label information to perform ED. Specifically, an edge-aware node update module is designed to generate expressive word representations by aggregating syntactically-connected words through specific dependency types. Furthermore, to fully explore clues hidden in dependency edges, a node-aware edge update module is introduced, which refines the relation representations with contextual information. These two modules are complementary to each other and work in a mutual promotion way. We conduct experiments on the widely used ACE2005 dataset and the results show significant improvement over competitive baseline methods.

cs.CL

Universal scaling and phase transitions of coupled phase oscillator populations

The Kuramoto model, which serves as a paradigm for investigating synchronization phenomenon of oscillatory system, is known to exhibit second-order, i.e., continuous, phase transitions in the macroscopic order parameter. Here, we generalize a number of classical results by presenting a general framework for capturing, analytically, the critical scaling of the order parameter at the onset of synchronization. Using a self-consistent approach and constructing a characteristic function, we identify various phase transitions toward synchrony and establish scaling relations describing the asymptotic dependence of the order parameter on coupling strength near the critical point. We find that the geometric properties of the characteristic function, which depends on the natural frequency distribution, determines the scaling properties of order parameter above the criticality.

nlin.AO

Bifurcation analysis and structural stability of simplicial oscillator populations

We present an analytical description for the collective dynamics of oscillator ensembles with higher-order coupling encoded by simplicial structure, which serves as an illustrative and insightful paradigm for brain function and information storage. The novel dynamics of the system, including abrupt desynchronization and multistability, are rigorously characterized and the critical points that correspond to a continuum of first-order phase transitions are found to satisfy universal scaling properties. More importantly, the underlying bifurcation mechanism giving rise to multiple clusters with arbitrary ensemble size is characterized using a rigorous spectral analysis of the stable cluster states. As a consequence of $SO_2$ group symmetry, we show that the continuum of abrupt desynchronization transitions result from the instability of a collective mode under the nontrivial antisymmetric manifold in the high dimensional phase space.

nlin.AO

WLS-ENO Remap: Superconvergent and Non-Oscillatory Weighted Least Squares Data Transfer on Surfaces

Data remap between non-matching meshes is a critical step in multiphysics coupling using a partitioned approach. The data fields being transferred often have jumps in function values or derivatives. It is important but very challenging to avoid spurious oscillations (a.k.a. the Gibbs Phenomenon) near discontinuities and at the same time to achieve high-order accuracy away from discontinuities. In this work, we introduce a new approach, called WLS-ENOR, or Weighted-Least-Squares-based Essentially Non-Oscillatory Remap, to address this challenge. Based on the WLS-ENO reconstruction technique proposed by Liu and Jiao (J. Comput. Phys. vol 314, pp 749--773, 2016), WLS-ENOR differs from WLS-ENO and other WENO schemes in that it resolves not only the O(1) oscillations due to C 0 discontinuities, but also the accumulated effect of O(h) oscillations due to C 1 discontinuities. To this end, WLS-ENOR introduces a robust detector of discontinuities and a new weighting scheme for WLS-ENO near discontinuities. We also optimize the weights at smooth regions to achieve superconvergence. As a result, WLS-ENOR is more than fifth-order accurate and highly conservative in smooth regions, while being non-oscillatory and minimally diffusive near discontinuities. We also compare WLS-ENOR with some commonly used methods based on L 2 projection, moving least squares, and radial basis functions.

math.NA

De-Pinning Transition of Bubble Phases in a High Landau Level

While in the lowest Landau level the electron-electron interaction leads to the formation of the Wigner crystal, in higher Landau levels a solid phase with multiple electrons in a lattice site of crystal was predicted, which was called the bubble phase. Reentrant integer quantum Hall states are believed to be the insulating bubble phase pinned by disorder. We carry out nonlinear transport measurements on the reentrant states and study the de-pinning of the bubble phase, which is complementary to previous microwave measurements and provides unique information. In this study, conductivity is directly measured with Corbino geometry. Based on the threshold electric field of de-pinning, a phase diagram of the reentrant state is mapped. We discuss an interaction-driven topological phase transition between the integer quantum Hall state and the reentrant integer quantum Hall state.

cond-mat.mes-hall