Searcharxiv⌕ Search

arXiv subjects

Bin Wang

Publications and source records attributed to Bin Wang.

At least 577 records · Page 32Linked to original sources

Geometry Contrastive Learning on Heterogeneous Graphs

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous graphs into a single geometric space, either Euclidean or hyperbolic. This kind of single geometric view is usually not enough to observe the complete picture of heterogeneous graphs due to their rich semantics and complex structures. Under these observations, this paper proposes a novel self-supervised learning method, termed as Geometry Contrastive Learning (GCL), to better represent the heterogeneous graphs when supervisory data is unavailable. GCL views a heterogeneous graph from Euclidean and hyperbolic perspective simultaneously, aiming to make a strong merger of the ability of modeling rich semantics and complex structures, which is expected to bring in more benefits for downstream tasks. GCL maximizes the mutual information between two geometric views by contrasting representations at both local-local and local-global semantic levels. Extensive experiments on four benchmarks data sets show that the proposed approach outperforms the strong baselines, including both unsupervised methods and supervised methods, on three tasks, including node classification, node clustering and similarity search.

cs.LG↗

SynWMD: Syntax-aware Word Mover's Distance for Sentence Similarity Evaluation

Word Mover's Distance (WMD) computes the distance between words and models text similarity with the moving cost between words in two text sequences. Yet, it does not offer good performance in sentence similarity evaluation since it does not incorporate word importance and fails to take inherent contextual and structural information in a sentence into account. An improved WMD method using the syntactic parse tree, called Syntax-aware Word Mover's Distance (SynWMD), is proposed to address these two shortcomings in this work. First, a weighted graph is built upon the word co-occurrence statistics extracted from the syntactic parse trees of sentences. The importance of each word is inferred from graph connectivities. Second, the local syntactic parsing structure of words is considered in computing the distance between words. To demonstrate the effectiveness of the proposed SynWMD, we conduct experiments on 6 textual semantic similarity (STS) datasets and 4 sentence classification datasets. Experimental results show that SynWMD achieves state-of-the-art performance on STS tasks. It also outperforms other WMD-based methods on sentence classification tasks.

cs.CL↗

A Numerical Reasoning Question Answering System with Fine-grained Retriever and the Ensemble of Multiple Generators for FinQA

The numerical reasoning in the financial domain -- performing quantitative analysis and summarizing the information from financial reports -- can greatly increase business efficiency and reduce costs of billions of dollars. Here, we propose a numerical reasoning question answering system to answer numerical reasoning questions among financial text and table data sources, consisting of a retriever module, a generator module, and an ensemble module. Specifically, in the retriever module, in addition to retrieving the whole row data, we innovatively design a cell retriever that retrieves the gold cells to avoid bringing unrelated and similar cells in the same row to the inputs of the generator module. In the generator module, we utilize multiple generators to produce programs, which are operation steps to answer the question. Finally, in the ensemble module, we integrate multiple programs to choose the best program as the output of our system. In the final private test set in FinQA Competition, our system obtains 69.79 execution accuracy.

cs.CL↗

Characterizing ultra-narrow momentum of atoms by standing-wave light-pulse sequences

We propose a method to characterize the ultra-narrow momentum distribution of atomic gases by employing a standing-wave light-pulse sequences beam-splitter. The mechanism of beam splitting is analyzed in detail, and the influence of a finite-width momentum distribution on the population of each diffraction order is given. The temperature of ultracold atomic gases can be calibrated by measuring the ratio of population in different diffraction orders after double standing-wave light-pulses. We obtain analytical expressions for two typical cases, and demonstrate phase space evolution in the whole process by using the Wigner function. This method is valid for both classical atomic gas and Bose-Einstein condensates, and it is suited for temperature measurement on the space ultra-cold atomic physics platform, in which the ultra-narrow momentum distribution of atomic gas is on the order of 100pK or even lower.

cond-mat.quant-gas↗

Single-frame characterization of ultrafast pulses with spatiotemporal orbital angular momentum

Light carrying spatiotemporal orbital angular momentum (ST-OAM) makes possible new types of optical vortices arising from transverse OAM. ST-OAM pulses exhibit novel properties during propagation, transmission, refraction, diffraction, and nonlinear conversion, attracting growing experimental and theoretical interest and studies. However, one major challenge is the lack of a simple and straightforward method for characterizing ultrafast ST-OAM pulses. Using spatially resolved spectral interferometry, we demonstrate a simple, stationary, single-frame method to quantitatively characterize ultrashort light pulses carrying ST-OAM. Using our method, the presence of an ST-OAM pulse, including its main characteristics such as topological charge numbers and OAM helicity, can be identified easily from the unique and unambiguous features directly seen on the raw data--without any need for a full analysis of the data. After processing and reconstructions, other exquisite features, including pulse dispersion and beam divergence, can also be fully characterized. Our fast characterization method allows high-throughput and quick feedback during the generation and optical alignment processes of ST-OAM pulses. It is straightforward to extend our method to single-shot measurement by using a high-speed camera that matches the pulse repetition rate. This new method can help advance the field of spatially and temporally structured light and its applications in advanced metrologies.

physics.optics↗

Dynamical spontaneous scalarization in Einstein-Maxwell-scalar models in anti-de Sitter spacetime

The phenomenon of spontaneous scalarization of charged black holes has attracted a lot of attention. In this work, we study the dynamical process of the spontaneous scalarization of charged black hole in asymptotically anti-de Sitter spacetimes in Einstein-Maxwell-scalar models. Including various non-minimal couplings between the scalar field and Maxwell field, we observe that an initial scalar-free configuration suffers tachyonic instability and both the scalar field and the black hole irreducible mass grow exponentially at early times and saturate exponentially at late times. For fractional couplings, we find that though there is negative energy distribution near the black hole horizon, the black hole horizon area never decreases. But when the parameters are large, the evolution endpoints of linearly unstable bald black holes will be spacetimes with naked singularity and the cosmic censorship is violated. The effects of the black hole charge, cosmological constant and coupling strength on the dynamical scalarization process are studied in detail. We find that large enough cosmological constant can prevent the spontaneous scalarization.

gr-qc↗

Topological Mirror Symmetry of Parabolic Hitchin Systems

In this paper, we first prove the parabolic Beauvile-Narasimhan-Ramanan correspondence over an arbitrary field which generalizes the corresponding results over algebraically closed fields in [SWW22]. We use the correspondence and the p-adic integration methods developed by Groechenig- Wyss-Ziegler [GWZ20b] to prove the topological mirror symmetry for parabolic Hitchin systems on curves with arbitrary parabolic structures.

math.AG↗

Confederated Learning: Federated Learning with Decentralized Edge Servers

Federated learning (FL) is an emerging machine learning paradigm that allows to accomplish model training without aggregating data at a central server. Most studies on FL consider a centralized framework, in which a single server is endowed with a central authority to coordinate a number of devices to perform model training in an iterative manner. Due to stringent communication and bandwidth constraints, such a centralized framework has limited scalability as the number of devices grows. To address this issue, in this paper, we propose a ConFederated Learning (CFL) framework. The proposed CFL consists of multiple servers, in which each server is connected with an individual set of devices as in the conventional FL framework, and decentralized collaboration is leveraged among servers to make full use of the data dispersed throughout the network. We develop an alternating direction method of multipliers (ADMM) algorithm for CFL. The proposed algorithm employs a random scheduling policy which randomly selects a subset of devices to access their respective servers at each iteration, thus alleviating the need of uploading a huge amount of information from devices to servers. Theoretical analysis is presented to justify the proposed method. Numerical results show that the proposed method can converge to a decent solution significantly faster than gradient-based FL algorithms, thus boasting a substantial advantage in terms of communication efficiency.

cs.LG↗

Transformer based Generative Adversarial Network for Liver Segmentation

Automated liver segmentation from radiology scans (CT, MRI) can improve surgery and therapy planning and follow-up assessment in addition to conventional use for diagnosis and prognosis. Although convolutional neural networks (CNNs) have become the standard image segmentation tasks, more recently this has started to change towards Transformers based architectures because Transformers are taking advantage of capturing long range dependence modeling capability in signals, so called attention mechanism. In this study, we propose a new segmentation approach using a hybrid approach combining the Transformer(s) with the Generative Adversarial Network (GAN) approach. The premise behind this choice is that the self-attention mechanism of the Transformers allows the network to aggregate the high dimensional feature and provide global information modeling. This mechanism provides better segmentation performance compared with traditional methods. Furthermore, we encode this generator into the GAN based architecture so that the discriminator network in the GAN can classify the credibility of the generated segmentation masks compared with the real masks coming from human (expert) annotations. This allows us to extract the high dimensional topology information in the mask for biomedical image segmentation and provide more reliable segmentation results. Our model achieved a high dice coefficient of 0.9433, recall of 0.9515, and precision of 0.9376 and outperformed other Transformer based approaches.

eess.IV↗

Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters

The ever-growing model size and scale of compute have attracted increasing interests in training deep learning models over multiple nodes. However, when it comes to training on cloud clusters, especially across remote clusters, huge challenges are faced. In this work, we introduce a general framework, Nebula-I, for collaboratively training deep learning models over remote heterogeneous clusters, the connections between which are low-bandwidth wide area networks (WANs). We took natural language processing (NLP) as an example to show how Nebula-I works in different training phases that include: a) pre-training a multilingual language model using two remote clusters; and b) fine-tuning a machine translation model using knowledge distilled from pre-trained models, which run through the most popular paradigm of recent deep learning. To balance the accuracy and communication efficiency, in Nebula-I, parameter-efficient training strategies, hybrid parallel computing methods and adaptive communication acceleration techniques are jointly applied. Meanwhile, security strategies are employed to guarantee the safety, reliability and privacy in intra-cluster computation and inter-cluster communication. Nebula-I is implemented with the PaddlePaddle deep learning framework, which can support collaborative training over heterogeneous hardware, e.g. GPU and NPU. Experiments demonstrate that the proposed framework could substantially maximize the training efficiency while preserving satisfactory NLP performance. By using Nebula-I, users can run large-scale training tasks over cloud clusters with minimum developments, and the utility of existed large pre-trained models could be further promoted. We also introduced new state-of-the-art results on cross-lingual natural language inference tasks, which are generated based upon a novel learning framework and Nebula-I.

cs.LG↗

Semi-discretization and full-discretization with optimal accuracy for charged-particle dynamics in a strong nonuniform magnetic field

The aim of this paper is to formulate and analyze numerical discretizations of charged-particle dynamics (CPD) in a strong nonuniform magnetic field. A strategy is firstly performed for the two dimensional CPD to construct the semi-discretization and full-discretization which have optimal accuracy. This accuracy is improved in the position and in the velocity when the strength of the magnetic field becomes stronger. This is a better feature than the usual so called "uniformly accurate methods". To obtain this refined accuracy, some reformulations of the problem and two-scale exponential integrators are incorporated, and the optimal accuracy is derived from this new procedure. Then based on the strategy given for the two dimensional case, a new class of uniformly accurate methods with simple scheme is formulated for the three dimensional CPD in maximal ordering case. All the theoretical results of the accuracy are numerically illustrated by some numerical tests.

math.NA↗

Magneto-Transport Properties of Kagome Magnet TmMn$_6$Sn$_6$

Kagome magnet usually hosts nontrivial electronic or magnetic states drawing great interests in condensed matter physics. In this paper, we report a systematic study on transport properties of kagome magnet TmMn$_6$Sn$_6$. The prominent topological Hall effect (THE) has been observed in a wide temperature region spanning over several magnetic phases and exhibits strong temperature and field dependence. This novel phenomenon due to non-zero spin chirality indicates possible appearance of nontrival magnetic states accompanying with strong fluctuations. The planar applied field drives planar Hall effect(PHE) and anistropic magnetoresisitivity(PAMR) exhibiting sharp disconnections in angular dependent planar resistivity violating the empirical law. By using an effective field, we identify a magnetic transition separating the PAMR into two groups belonging to various magnetic states. We extended the empirical formula to scale the field and temperature dependent planar magnetoresistivity and provide the understandings for planar transport behaviors with the crossover between various magnetic states. Our results shed lights on the novel transport effects in presence of multiple nontrivial magnetic states for the kagome lattice with complicated magnetic structures.

cond-mat.str-el↗

Dynamical spontaneous scalarization in Einstein-Maxwell-scalar theory

We study the linear instability and the nonlinear dynamical evolution of the Reissner-Nordström (RN) black hole in the Einstein-Maxwell-scalar theory in asymptotic flat spacetime. We focus on the coupling function $f(ϕ)=e^{-bϕ^2}$ which allows both the scalar-free RN solution and scalarized black hole solution. We first present the evolution of system parameters during dynamic scalarization. For parameter regions where spontaneous scalarization occurs, we find that the evolution of the scalar field at the horizon is dominated by the fundamental unstable mode from linear analysis at early times. At late times, the nonlinear evolution can be viewed as the perturbation of scalarized black holes.

gr-qc↗

Strong Effects of Interlayer Interaction on Valence-Band Splitting in Transition Metal Dichalcogenides

Understanding the origin of valence band maxima (VBM) splitting in transition metal dichalcogenides (TMDs) is important because it governs the unique spin and valley physics in monolayer and multilayer TMDs. In this work, we present our systematic study of VBM splitting ($Δ$) in atomically thin MoS$_2$ and WS$_2$ by employing photocurrent spectroscopy as we change the temperature and the layer numbers. We found that VBM splitting in monolayer MoS$_2$ and WS$_2$ depends strongly on temperature, which contradicts the theory that spin-orbit coupling solely determines the VBM splitting in monolayer TMDs. We also found that the rate of change of VBM splitting with respect to temperature ($m=\frac{\partialΔ}{\partial T}$) is the highest for monolayer (-0.14 meV/K for MoS$_2$) and the rate decreases as the layer number increases ($m ~ 0$ meV/K for 5 layers MoS$_2$). We performed density functional theory (DFT) and the GW with Bethe-Salpeter Equation (GW-BSE) calculations to determine the electronic band structure and optical absorption for a bilayer MoS$_2$ with different interlayer separations. Our simulations agree with the experimental observations and demonstrate that the temperature dependence of VBM splitting in atomically thin monolayer and multilayer TMDs originates from the changes in the interlayer coupling strength between the neighboring layers. By studying two different types of TMDs and many different layer thicknesses, we also demonstrate that VBM splitting also depends on the layer numbers and type of transition metals. Our study will help understand the role spin-orbit coupling and interlayer interaction play in determining the VBM splitting in quantum materials and develop next-generation devices based on spin-orbit interactions.

cond-mat.mes-hall↗

Long term analysis of splitting methods for charged-particle dynamics

In this paper, we rigorously analyze the energy, momentum and magnetic moment behaviours of two splitting methods for solving charged-particle dynamics. The near-conservations of these invariants are given for the system under constant magnetic field or quadratic electric potential. By the approach named as backward error analysis, we derive the modified equations and modified invariants of the splitting methods and based on which, the near-conservations over long times are proved. Some numerical experiments are presented to demonstrate these long time behaviours.

math.NA↗

Electrified Autonomous Freight Benefit analysis on Fleet, Infrastructure and Grid Leveraging Grid-Electrified Mobility (GEM) Model

This paper analyzes the potential benefit of heavy-duty vehicle (HDV) electrification and automation on fleet cost, infrastructure cost, grid, and environmental impact. In this work, we extended the vehicle electrification benefit analysis tool: Grid-Electrified Mobility (GEM) model, which had primarily been used to study light-duty passenger vehicles (LDVs), to analyze the heavy-duty vehicle electrification. The extended model is derived for freight transportation and key results and findings on the impact of freight electrification and automation are presented and discussed.

eess.SY↗

Critical phenomena in dynamical scalarization of charged black hole

We report a new black hole scalarization mechanism and disclose novel dynamical critical phenomena in the process of the nonlinear accretion of the scalar field into black holes. The accretion process can transform a seed black hole into a final scalarized or bald black hole, depending on the initial parameter of the scalar field $p$. There is a critical parameter $p_{\ast}$ and near it all intermediate solutions are attracted to a critical solution and stay there for a time scaling as $T\propto-γ\ln|p-p_{\ast}|$. At late times, the solutions evolve into scalarized black holes if $p>p_{\ast}$, or bald black holes if $p<p_{\ast}$. The final masses of the resulting scalarized/bald black holes satisfy power-laws $M_{p}-M_{\pm}\propto|p-p_{\ast}|^{γ_{\pm}}$ where $M_{\pm}$ are the masses of the scalarized/bald black holes when $p\to p_\ast$ from above/below, and $γ_{\pm}$ the corresponding exponents.

gr-qc↗

C3KG: A Chinese Commonsense Conversation Knowledge Graph

Existing commonsense knowledge bases often organize tuples in an isolated manner, which is deficient for commonsense conversational models to plan the next steps. To fill the gap, we curate a large-scale multi-turn human-written conversation corpus, and create the first Chinese commonsense conversation knowledge graph which incorporates both social commonsense knowledge and dialog flow information. To show the potential of our graph, we develop a graph-conversation matching approach, and benchmark two graph-grounded conversational tasks.

cs.CL↗