Searcharxiv⌕ Search

arXiv subjects

Bing Liu

Publications and source records attributed to Bing Liu.

At least 127 records · Page 7Linked to original sources
arXiv2023

A Novel Bilateral Energy Trading Mechanism for Electricity Markets with Numerous Prosumers

With the rapid development of distributed energy resources, increasing number of residential and commercial users have been switched from pure electricity consumers to prosumers that can both consume and produce energy. To properly manage these emerging prosumers, a peer-to-peer electricity market has been explored and extensively studied. In such an electricity market, each prosumer trades energy directly with other prosumers, posing a serious challenge to the scalability of the market. Therefore, a bilateral energy trading mechanism with good scalability is proposed for electricity markets with numerous prosumers in this paper. First, the multi-bilateral economic dispatch problem that maximizes the social welfare is formulated, taking into account product differentiation and network constraints. Then, an energy trading mechanism is devised to improve the scalability from two aspects: (i) an accelerated distributed clearing algorithm with less exchanged information and faster convergence rate. (ii) a novel selection strategy to reduce the amount of computation and communication per prosumer. Finally, the convergence proof of the proposed accelerated algorithm is given, and the proposed selection strategy is illustrated through a Monte Carlo simulation experiment.

cs.DC↗
arXiv2023

Zero-shot information extraction from radiological reports using ChatGPT

Electronic health records contain an enormous amount of valuable information, but many are recorded in free text. Information extraction is the strategy to transform the sequence of characters into structured data, which can be employed for secondary analysis. However, the traditional information extraction components, such as named entity recognition and relation extraction, require annotated data to optimize the model parameters, which has become one of the major bottlenecks in building information extraction systems. With the large language models achieving good performances on various downstream NLP tasks without parameter tuning, it becomes possible to use large language models for zero-shot information extraction. In this study, we aim to explore whether the most popular large language model, ChatGPT, can extract useful information from the radiological reports. We first design the prompt template for the interested information in the CT reports. Then, we generate the prompts by combining the prompt template with the CT reports as the inputs of ChatGPT to obtain the responses. A post-processing module is developed to transform the responses into structured extraction results. We conducted the experiments with 847 CT reports collected from Peking University Cancer Hospital. The experimental results indicate that ChatGPT can achieve competitive performances for some extraction tasks compared with the baseline information extraction system, but some limitations need to be further improved.

cs.CL↗
arXiv2023

Proton-Boron Fusion Yield Increased by Orders of Magnitude with Foam Targets

A novel intense beam-driven scheme for high yield of the tri-alpha reaction 11B(p,α)2α was investigated. We used a foam target made of cellulose triacetate (TAC, C_9H_{16}O_8) doped with boron. It was then heated volumetrically by soft X-ray radiation from a laser heated hohlraum and turned into a homogenous, and long living plasma. We employed a picosecond laser pulse to generate a high-intensity energetic proton beam via the well-known Target Normal Sheath Acceleration (TNSA) mechanism. We observed up to 10^{10}/sr α particles per laser shot. This constitutes presently the highest yield value normalized to the laser energy on target. The measured fusion yield per proton exceeds the classical expectation of beam-target reactions by up to four orders of magnitude under high proton intensities. This enhancement is attributed to the strong electric fields and nonequilibrium thermonuclear fusion reactions as a result of the new method. Our approach shows opportunities to pursue ignition of aneutronic fusion.

physics.plasm-ph↗
arXiv2023

New estimation of the nuclear de-excitation line emission from the supernova remnant Cassiopeia A

MeV nuclear de-excitation lines serve as a unique tool to study low-energy cosmic rays (CRs), containing both spectral and elemental information of the interacting material. In this paper, we estimated the possible nuclear de-excitation lines from the young supernova remnant Cassiopeia A. Given different CR spectral shapes and interacting materials, we found the predicted fluxes of strong narrow line emissions from the remnant are highly model-dependent, ranging from about $1\times10^{-10}\,{\rm \,cm^{-2}\,s^{-1}}$ to $1\times10^{-6}\, {\rm \,cm^{-2}\,s^{-1}}$ for the 4.44 MeV narrow line and from about $4\times10^{-11}\,{\rm \,cm^{-2}\,s^{-1}}$ to $2\times10^{-7}{\rm \,cm^{-2}\,s^{-1}}$ for the 6.13 MeV narrow line, respectively. Based on the new estimation, we also discussed the detection probability of these line emissions against the MeV diffuse Galactic background under different assumptions of instrument response functions.

astro-ph.HE↗
arXiv2023

CT-Net: Arbitrary-Shaped Text Detection via Contour Transformer

Contour based scene text detection methods have rapidly developed recently, but still suffer from inaccurate frontend contour initialization, multi-stage error accumulation, or deficient local information aggregation. To tackle these limitations, we propose a novel arbitrary-shaped scene text detection framework named CT-Net by progressive contour regression with contour transformers. Specifically, we first employ a contour initialization module that generates coarse text contours without any post-processing. Then, we adopt contour refinement modules to adaptively refine text contours in an iterative manner, which are beneficial for context information capturing and progressive global contour deformation. Besides, we propose an adaptive training strategy to enable the contour transformers to learn more potential deformation paths, and introduce a re-score mechanism that can effectively suppress false positives. Extensive experiments are conducted on four challenging datasets, which demonstrate the accuracy and efficiency of our CT-Net over state-of-the-art methods. Particularly, CT-Net achieves F-measure of 86.1 at 11.2 frames per second (FPS) and F-measure of 87.8 at 10.1 FPS for CTW1500 and Total-Text datasets, respectively.

cs.CV↗
arXiv2023

Class-Incremental Learning based on Label Generation

Despite the great success of pre-trained language models, it is still a challenge to use these models for continual learning, especially for the class-incremental learning (CIL) setting due to catastrophic forgetting (CF). This paper reports our finding that if we formulate CIL as a continual label generation problem, CF is drastically reduced and the generalizable representations of pre-trained models can be better retained. We thus propose a new CIL method (VAG) that also leverages the sparsity of vocabulary to focus the generation and creates pseudo-replay samples by using label semantics. Experimental results show that VAG outperforms baselines by a large margin.

cs.CL↗
arXiv2023

Observation of whistler wave instability driven by temperature anisotropy of energetic electrons on EXL-50 spherical torus

Electromagnetic modes in the frequency range of 30-120MHz were observed in electron cyclotron wave (ECW) steady state plasmas on the ENN XuanLong-50 (EXL-50) spherical torus. These modes were found to have multiple bands of frequencies proportional to the Alfvén velocity. This indicates that the observed mode frequencies satisfy the dispersion relation of whistler waves. In addition, suppression of the whistler waves by the synergistic effect of Lower Hybrid Wave (LHW) and ECW was also observed. This suggests that the whistler waves were driven by temperature anisotropy of energetic electrons. These are the first such observations (not runaway discharge) made in magnetically confined toroidal plasmas and may have important implications for studying wave-particle interactions, RF wave current driver, and runaway electron control in future fusion devices.

physics.plasm-ph↗
arXiv2023

Parameter-Level Soft-Masking for Continual Learning

Existing research on task incremental learning in continual learning has primarily focused on preventing catastrophic forgetting (CF). Although several techniques have achieved learning with no CF, they attain it by letting each task monopolize a sub-network in a shared network, which seriously limits knowledge transfer (KT) and causes over-consumption of the network capacity, i.e., as more tasks are learned, the performance deteriorates. The goal of this paper is threefold: (1) overcoming CF, (2) encouraging KT, and (3) tackling the capacity problem. A novel technique (called SPG) is proposed that soft-masks (partially blocks) parameter updating in training based on the importance of each parameter to old tasks. Each task still uses the full network, i.e., no monopoly of any part of the network by any task, which enables maximum KT and reduction in capacity usage. To our knowledge, this is the first work that soft-masks a model at the parameter-level for continual learning. Extensive experiments demonstrate the effectiveness of SPG in achieving all three objectives. More notably, it attains significant transfer of knowledge not only among similar tasks (with shared knowledge) but also among dissimilar tasks (with little shared knowledge) while mitigating CF.

cs.LG↗
arXiv2023

Learnability and Algorithm for Continual Learning

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be applied to predict/classify test instances of any classes learned thus far without providing any task related information for each test instance. Although many techniques have been proposed for CIL, they are mostly empirical. It has been shown recently that a strong CIL system needs a strong within-task prediction (WP) and a strong out-of-distribution (OOD) detection for each task. However, it is still not known whether CIL is actually learnable. This paper shows that CIL is learnable. Based on the theory, a new CIL algorithm is also proposed. Experimental results demonstrate its effectiveness.

cs.LG↗
arXiv2023

Dealing with Cross-Task Class Discrimination in Online Continual Learning

Existing continual learning (CL) research regards catastrophic forgetting (CF) as almost the only challenge. This paper argues for another challenge in class-incremental learning (CIL), which we call cross-task class discrimination (CTCD),~i.e., how to establish decision boundaries between the classes of the new task and old tasks with no (or limited) access to the old task data. CTCD is implicitly and partially dealt with by replay-based methods. A replay method saves a small amount of data (replay data) from previous tasks. When a batch of current task data arrives, the system jointly trains the new data and some sampled replay data. The replay data enables the system to partially learn the decision boundaries between the new classes and the old classes as the amount of the saved data is small. However, this paper argues that the replay approach also has a dynamic training bias issue which reduces the effectiveness of the replay data in solving the CTCD problem. A novel optimization objective with a gradient-based adaptive method is proposed to dynamically deal with the problem in the online CL process. Experimental results show that the new method achieves much better results in online CL.

cs.LG↗
arXiv2023

Sentiment Analysis in the Era of Large Language Models: A Reality Check

Sentiment analysis (SA) has been a long-standing research area in natural language processing. It can offer rich insights into human sentiments and opinions and has thus seen considerable interest from both academia and industry. With the advent of large language models (LLMs) such as ChatGPT, there is a great potential for their employment on SA problems. However, the extent to which existing LLMs can be leveraged for different sentiment analysis tasks remains unclear. This paper aims to provide a comprehensive investigation into the capabilities of LLMs in performing various sentiment analysis tasks, from conventional sentiment classification to aspect-based sentiment analysis and multifaceted analysis of subjective texts. We evaluate performance across 13 tasks on 26 datasets and compare the results against small language models (SLMs) trained on domain-specific datasets. Our study reveals that while LLMs demonstrate satisfactory performance in simpler tasks, they lag behind in more complex tasks requiring deeper understanding or structured sentiment information. However, LLMs significantly outperform SLMs in few-shot learning settings, suggesting their potential when annotation resources are limited. We also highlight the limitations of current evaluation practices in assessing LLMs' SA abilities and propose a novel benchmark, \textsc{SentiEval}, for a more comprehensive and realistic evaluation. Data and code during our investigations are available at \url{https://github.com/DAMO-NLP-SG/LLM-Sentiment}.

cs.CL↗
arXiv2023

Do We Need an Encoder-Decoder to Model Dynamical Systems on Networks?

As deep learning gains popularity in modelling dynamical systems, we expose an underappreciated misunderstanding relevant to modelling dynamics on networks. Strongly influenced by graph neural networks, latent vertex embeddings are naturally adopted in many neural dynamical network models. However, we show that embeddings tend to induce a model that fits observations well but simultaneously has incorrect dynamical behaviours. Recognising that previous studies narrowly focus on short-term predictions during the transient phase of a flow, we propose three tests for correct long-term behaviour, and illustrate how an embedding-based dynamical model fails these tests, and analyse the causes, particularly through the lens of topological conjugacy. In doing so, we show that the difficulties can be avoided by not using embedding. We propose a simple embedding-free alternative based on parametrising two additive vector-field components. Through extensive experiments, we verify that the proposed model can reliably recover a broad class of dynamics on different network topologies from time series data.

cs.LG↗
arXiv2023

Analyzing and Reducing the Performance Gap in Cross-Lingual Transfer with Fine-tuning Slow and Fast

Existing research has shown that a multilingual pre-trained language model fine-tuned with one (source) language also performs well on downstream tasks for non-source languages, even though no fine-tuning is done on these languages. However, there is a clear gap between the performance of the source language and that of the non-source languages. This paper analyzes the fine-tuning process, discovers when the performance gap changes and identifies which network weights affect the overall performance most. Additionally, the paper seeks to answer to what extent the gap can be reduced by reducing forgetting. Based on the analysis results, a method named Fine-tuning slow and fast with four training policies is proposed to address these issues. Experimental results show the proposed method outperforms baselines by a clear margin.

cs.CL↗
arXiv2023

A hard spectrum diffuse gamma-ray component associated with HII gas in the Galactic plane

We analyzed 12-year Fermi Large Area Telescope gamma-ray data in the inner Galaxy centered at (l=30$^{\circ}$, b=0$^{\circ}$) and (l=330$^{\circ}$, b=0$^{\circ}$). We found significant hardening of the spectrum of the diffuse gamma-ray emission in these regions as previously reported. We further deduced that the diffuse gamma rays can be divided into two components from the likelihood analysis. One component is associated with the total gas column density and reveals a soft spectrum, while the other is associated with the HII gas and presents a hard spectrum. Assuming the diffuse gamma-ray emissions are mainly produced through the interaction between cosmic rays (CRs) and the ambient gas, these two components are produced by the CR populations with spectral indices of 2.8 ("soft") and 2.3 ("hard"), respectively. We argue that the hard CR population may come from the vicinity of the CR accelerators. The soft CR population has a similar spectral shape and density as measured in the solar neighborhood, which implies a uniform CR "sea" with a similar density and spectral shape in the Galaxy.

astro-ph.HE↗
arXiv2023

Continual Learning of Natural Language Processing Tasks: A Survey

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help learn new tasks better. This survey presents a comprehensive review and analysis of the recent progress of CL in NLP, which has significant differences from CL in computer vision and machine learning. It covers (1) all CL settings with a taxonomy of existing techniques; (2) catastrophic forgetting (CF) prevention, (3) knowledge transfer (KT), which is particularly important for NLP tasks; and (4) some theory and the hidden challenge of inter-task class separation (ICS). (1), (3) and (4) have not been included in the existing survey. Finally, a list of future directions is discussed.

cs.CL↗
arXiv2023

Enhancement of Fusion Reactivity under Non-Maxwellian Distributions: Effects of Drift-Ring-Beam, Slowing-Down, and Kappa Super-Thermal Distributions

Non-Maxwellian distributions of particles are commonly observed in fusion studies, especially for magnetic confinement fusion plasmas. The particle distribution has a direct effect on fusion reactivity, which is the focus of this study. We investigate the effects of three types of non-Maxwellian distributions, namely drift-ring-beam, slowing-down, and kappa super-thermal distributions, on the fusion reactivities of D-T (Deuterium-Trillium) and p-B11 (proton-Boron) using a newly developed program, where the enhancement of fusion reactivity relative to the Maxwellian distribution is computed while keeping the total kinetic energy constant. The calculation results show that for the temperature ranges of interest to us, namely 5-50 keV for D-T and 100-500 keV for p-B11, these non-Maxwellian distributions can enhance the fusion reactivities. In the case of the drift-ring-beam distribution, the enhancement factors for both reactions are affected by the perpendicular ring beam velocity, leading to decreased enhancement in low temperature range and increased enhancement in high temperature range. However, this effect is favorable for p-B11 fusion reaction and unfavorable for D-T fusion reaction. In the slowing-down distribution, the birth speed plays a crucial role in both reactions, and increasing birth speed leads to a shift in the enhancement ranges towards lower temperatures, which is beneficial for both reactions. Finally, the kappa super-thermal distribution results in a relatively large enhancement in the low temperature range with a small high energy power-law index κ. Overall, this study provides insight into the effects of non-Maxwellian distributions on fusion reactivity and highlights potential opportunities for enhancing fusion efficiency.

physics.plasm-ph↗
arXiv2023

A Unified Evaluation Framework for Novelty Detection and Accommodation in NLP with an Instantiation in Authorship Attribution

State-of-the-art natural language processing models have been shown to achieve remarkable performance in 'closed-world' settings where all the labels in the evaluation set are known at training time. However, in real-world settings, 'novel' instances that do not belong to any known class are often observed. This renders the ability to deal with novelties crucial. To initiate a systematic research in this important area of 'dealing with novelties', we introduce 'NoveltyTask', a multi-stage task to evaluate a system's performance on pipelined novelty 'detection' and 'accommodation' tasks. We provide mathematical formulation of NoveltyTask and instantiate it with the authorship attribution task that pertains to identifying the correct author of a given text. We use Amazon reviews corpus and compile a large dataset (consisting of 250k instances across 200 authors/labels) for NoveltyTask. We conduct comprehensive experiments and explore several baseline methods for the task. Our results show that the methods achieve considerably low performance making the task challenging and leaving sufficient room for improvement. Finally, we believe our work will encourage research in this underexplored area of dealing with novelties, an important step en route to developing robust systems.

cs.CL↗
arXiv2023

Cosmic ray density variations in nearby giant molecular clouds

In this paper, we analyzed 12 years of Fermi LAT gamma-ray data towards three nearby giant molecular clouds (GMCs), i.e., R~CrA, Chamaeleon, and Lupus. We calibrated the gas column density of these regions by using the Planck dust opacity map as well as the Gaia extinction map. With both the gamma-ray observations and gas column density maps, we derived the cosmic ray densities in the three GMCs. We found the derived CR spectra have almost the same shape but significantly different normalizations, which may reflect that the distributions of CRs in the vicinity of solar systems are inhomogeneous.

astro-ph.HE↗