Searcharxiv⌕ Search

arXiv subjects

Bin Wang

Publications and source records attributed to Bin Wang.

At least 487 records · Page 27Linked to original sources

Reconstructed Convolution Module Based Look-Up Tables for Efficient Image Super-Resolution

Look-up table(LUT)-based methods have shown the great efficacy in single image super-resolution (SR) task. However, previous methods ignore the essential reason of restricted receptive field (RF) size in LUT, which is caused by the interaction of space and channel features in vanilla convolution. They can only increase the RF at the cost of linearly increasing LUT size. To enlarge RF with contained LUT sizes, we propose a novel Reconstructed Convolution(RC) module, which decouples channel-wise and spatial calculation. It can be formulated as $n^2$ 1D LUTs to maintain $n\times n$ receptive field, which is obviously smaller than $n\times n$D LUT formulated before. The LUT generated by our RC module reaches less than 1/10000 storage compared with SR-LUT baseline. The proposed Reconstructed Convolution module based LUT method, termed as RCLUT, can enlarge the RF size by 9 times than the state-of-the-art LUT-based SR method and achieve superior performance on five popular benchmark dataset. Moreover, the efficient and robust RC module can be used as a plugin to improve other LUT-based SR methods. The code is available at https://github.com/liuguandu/RC-LUT.

eess.IV↗

GreenKGC: A Lightweight Knowledge Graph Completion Method

Knowledge graph completion (KGC) aims to discover missing relationships between entities in knowledge graphs (KGs). Most prior KGC work focuses on learning embeddings for entities and relations through a simple scoring function. Yet, a higher-dimensional embedding space is usually required for a better reasoning capability, which leads to a larger model size and hinders applicability to real-world problems (e.g., large-scale KGs or mobile/edge computing). A lightweight modularized KGC solution, called GreenKGC, is proposed in this work to address this issue. GreenKGC consists of three modules: representation learning, feature pruning, and decision learning, to extract discriminant KG features and make accurate predictions on missing relationships using classifiers and negative sampling. Experimental results demonstrate that, in low dimensions, GreenKGC can outperform SOTA methods in most datasets. In addition, low-dimensional GreenKGC can achieve competitive or even better performance against high-dimensional models with a much smaller model size.

cs.AI↗

Nonlinear dynamics of hot, cold and bald Einstein-Maxwell-scalar black holes in AdS spacetime

We investigate the dynamical transition processes of an Einstein-Maxwell-scalar gravitational system between two local ground states and an excited state in the anti-de Sitter spacetime. From the linear perturbation theory, only the excited state possesses a single unstable mode, indicating the dynamical instability. Such an instability is associated with the tachyonic instability due to the presence of an effective potential well near the event horizon. From the nonlinear dynamics simulation, through the scalar field accretion mechanism, the critical phenomena in the transition process of the gravitational system between the two local ground states are revealed. The threshold of the accretion strength indicates the existence of a dynamical barrier in this transition process, which depends on the coupling strength between the scalar and Maxwell fields. On the other hand, for the unstable excited state, there exists a special kind of critical dynamics with a zero threshold for the perturbation strength. The perturbations of different signs push the gravitational system to fall into different local ground states. Interestingly, in an extended parameter space, there exist specific parameters such that the perturbations of non-zero amplitude fail to trigger the single unstable mode of the excited state.

gr-qc↗

Impact of UAVs Equipped with ADS-B on the Civil Aviation Monitoring System

In recent years, there is an increasing demand for unmanned aerial vehicles (UAVs) to complete multiple applications. However, as unmanned equipments, UAVs lead to some security risks to general civil aviations. In order to strengthen the flight management of UAVs and guarantee the safety, UAVs can be equipped with automatic dependent surveillance-broadcast (ADS-B) devices. In addition, as an automatic system, ADS-B can periodically broadcast flight information to the nearby aircrafts or the ground stations, and the technology is already used in civil aviation systems. However, due to the limited frequency of ADS-B technique, UAVs equipped with ADS-B devices result in the loss of packets to both UAVs and civil aviation. Further, the operation of civil aviation are seriously interfered. Hence, this paper firstly examines the packets loss of civil planes at different distance, then analyzes the impact of UAVs equipped with ADS-B on the packets updating of civil planes. The result indicates that the 1090MHz band blocking is affected by the density of UAVs. Besides, the frequency capacity is affected by the requirement of updating interval of civil planes. The position updating probability within 3s is 92.3% if there are 200 planes within 50km and 20 UAVs within 5km. The position updating probability within 3s is 86.9% if there are 200 planes within 50km and 40 UAVs within 5km.

eess.SP↗

An Overview on Language Models: Recent Developments and Outlook

Language modeling studies the probability distributions over strings of texts. It is one of the most fundamental tasks in natural language processing (NLP). It has been widely used in text generation, speech recognition, machine translation, etc. Conventional language models (CLMs) aim to predict the probability of linguistic sequences in a causal manner, while pre-trained language models (PLMs) cover broader concepts and can be used in both causal sequential modeling and fine-tuning for downstream applications. PLMs have their own training paradigms (usually self-supervised) and serve as foundation models in modern NLP systems. This overview paper provides an introduction to both CLMs and PLMs from five aspects, i.e., linguistic units, architectures, training methods, evaluation methods, and applications. Furthermore, we discuss the relationship between CLMs and PLMs and shed light on the future directions of language modeling in the pre-trained era.

cs.CL↗

CMATH: Can Your Language Model Pass Chinese Elementary School Math Test?

We present the Chinese Elementary School Math Word Problems (CMATH) dataset, comprising 1.7k elementary school-level math word problems with detailed annotations, source from actual Chinese workbooks and exams. This dataset aims to provide a benchmark tool for assessing the following question: to what grade level of elementary school math do the abilities of popular large language models (LLMs) correspond? We evaluate a variety of popular LLMs, including both commercial and open-source options, and discover that only GPT-4 achieves success (accuracy $\geq$ 60\%) across all six elementary school grades, while other models falter at different grade levels. Furthermore, we assess the robustness of several top-performing LLMs by augmenting the original problems in the CMATH dataset with distracting information. Our findings reveal that GPT-4 is able to maintains robustness, while other model fail. We anticipate that our study will expose limitations in LLMs' arithmetic and reasoning capabilities, and promote their ongoing development and advancement.

cs.CL↗

Rings and images of Horndeski hairy black hole illuminated by various thin accretions

We analyze the light rays around a static hairy black hole in Horndeski gravity with the use of ray-tracing procedure. We find that a stronger Horndeski hairy parameter corresponds to larger photon sphere as well as critical impact parameter, and wider ranges of photon ring and lensed ring emissions. These influences can be robustly interpreted from the shape of the effective potential of the photon's radial motion. Based on the distribution of the light rays, we then investigate the optical appearances of the Horndeski hairy black hole surrounded by various thin accretions. Firstly, we consider that the Horndeski hairy black hole is illuminated by the optically and geometrically thin accretion disk. We carefully clarify the contributions from the direct, lensed ring and photon ring intensities to the total observed intensity via the transfer function, which is rarely discussed in this scenario. We find that the Horndeski hair has significant influences on both shadow size and distributions of direct, lensed ring and photon ring brightness in three standard emission profiles. As a result, the rings and images of Horndeski hairy black hole and the origination of their brightness differentiate from those of Schwarzschild black hole (SBH). Then, when the Horndeski hairy black hole is illuminated by thin spherical accretions, the hairy black hole's shadow surrounded by a bright ring is larger than that of SBH, but the brightness of ring is fainter. Similar to that of SBH, the size of hairy black hole shadow does not change as the radial moving of the spherical accretion, and the brightness for the infalling accretion is fainter than that for the static accretion due to the Doppler effect. Therefore, we argue that the black hole image consisting of the shadow and accretion construction could, in theory, reflect the observational differences between the Horndeski hairy black hole and SBH.

gr-qc↗

Detecting vector charge with extreme mass ratio inspirals onto Kerr black holes

Extreme mass ratio inspirals (EMRIs) are excellent sources for space-based observatories to explore the properties of black holes and test no-hair theorems. We consider EMRIs with a charged compact object inspiralling onto a Kerr black hole in quasi-circular orbits. Using the Teukolsky and generalized Sasaki-Nakamura formalisms for the gravitational and vector perturbations about a Kerr black hole, we numerically calculate the energy fluxes for both gravitational and vector perturbations induced by a charged particle moving in equatorial circular orbits. With one-year observations of EMRIs, we apply the Fisher information matrix method to estimate the charge uncertainty detected by space-based gravitational wave detectors such as the Laser Interferometer Space Antenna, TianQin, and Taiji, and we find that it is possible to detect vector charge as small as $q\sim 0.0049$. The results show that EMRIs composed of a Kerr black hole with a higher spin $a$ and lighter mass $M$, and a secondary charged object with more vector charge give smaller relative error on the charge, thus constrain the charge better. The positive spin of the Kerr black hole can decrease the charge uncertainty by about one or two orders of magnitude.

gr-qc↗

Design and manipulation of high-performance photovoltaic systems based on two-dimensional novel KAgSe/KAgX(X=S,Te) van der Waals heterojunctions

The realization of high-performance two-dimensional (2D) solar photovoltaic systems are both fundamentally intriguing and practically appealing to meet the fast-growing energy requirements. Since the limited application of single 2D crystals in photovoltaic, here we propose a family of 2D KAgSe/KAgX(X=S,Te) van der Waals heterostructures (vdWHs), which are constructed by combining two different KAgX layers through interlayer vdW interaction. After a systematic study and further regulatory research of these vdWHs based on the first-principles, numerous fascinating characteristics and physical mechanisms are obtained. Firstly, favorable potential applications of these vdWHs in photovoltaics are confirmed in virtue of their desirable optoelectronic properties, such as the robust stabilitis, moderate direct band gaps, type-II band alignments together with superior carrier mobilities, visible optical absorptions, power conversion efficiencys (PCEs) and photocurrents in their based photovoltaic devices. More importantly, when under varying vertical electric field Ez, a phase transition of band alignment from type-II to type-I of these vdWHs can be induced by the opposite band shifts between layers, which may enrich their applications in light-emitting diodes and lasers. Meanwhile, the PCE can be expanded up to 23%, and an obvious red-shift peak of the photocurrent in the visible light range are also obtained at different Ez. These fascinating tunable properties of KAgSe/KAgX vdWHs under varying Ez not only promote the improvement of their photoelectric performances, but the underlying mechanisms can also be applied to next experimental design and practical application of other 2D photovoltaic systems. Especially for the red-shift peak of the photocurrent, which is rarely found but highly desirable in practical visible photoelectric conversion.

physics.comp-ph↗

Low-Confidence Samples Mining for Semi-supervised Object Detection

Reliable pseudo-labels from unlabeled data play a key role in semi-supervised object detection (SSOD). However, the state-of-the-art SSOD methods all rely on pseudo-labels with high confidence, which ignore valuable pseudo-labels with lower confidence. Additionally, the insufficient excavation for unlabeled data results in an excessively low recall rate thus hurting the network training. In this paper, we propose a novel Low-confidence Samples Mining (LSM) method to utilize low-confidence pseudo-labels efficiently. Specifically, we develop an additional pseudo information mining (PIM) branch on account of low-resolution feature maps to extract reliable large-area instances, the IoUs of which are higher than small-area ones. Owing to the complementary predictions between PIM and the main branch, we further design self-distillation (SD) to compensate for both in a mutually-learning manner. Meanwhile, the extensibility of the above approaches enables our LSM to apply to Faster-RCNN and Deformable-DETR respectively. On the MS-COCO benchmark, our method achieves 3.54% mAP improvement over state-of-the-art methods under 5% labeling ratios.

cs.CV↗

Gravitational waves from eccentric extreme mass-ratio inspirals as probes of scalar fields

We study eccentric orbits of the Schwarzschild spacetime for extreme mass ratio system (EMRI) in modified gravity theories with additional scalar fields. Due to the additional energy and angular momentum carried away by the scalar field, the orbit of the EMRI in modified gravity decays faster than that in general relativity. The time that it takes the eccentricity $e$ to reach the minimum is smaller and the values of the semi-latus rectum $p$ and $e$ at the turning point when $e$ reaches the minimum are bigger for larger scalar charge $d$. In addition to the calculation of energy fluxes with numerical method, we also use the Post-Newtonian expansion of the rate of energy carried away by the scalar field in eccentric orbits to understand the behaviors of the energy emission. By adding the scalar flux to the open code FastEMRIWaveforms of the Black Hole Perturbation Toolkit, we numerically generate fast gravitational waveforms for eccentric EMRIs with scalar fields and use the faithfulness between waveforms with and without the scalar charge to discuss the detection of scalar charge $d$. The detection error of the scalar charge is also estimated with method of Fisher information matrix.

gr-qc↗

Short-Term Voltage Security Constrained UC to Prevent Trip Faults in High Wind Power Penetrated Power Systems

For high wind power-penetrated power systems, the multiple renewable energy station short-circuit ratio (MRSCR) is often insufficient due to weak grid structures. Additionally, transient voltage sag/overvoltage issues may cause trip faults of wind turbines (WTs). Due to the time delay in WTs' controllers, it is difficult for WTs alone to meet the reactive power demands in different stages of the transient process. Some synchronous machines (SMs) must be retained through unit commitment (UC) scheduling to improve MRSCR and prevent trip faults of WTs. The MRSCR and short-term voltage security constrained-UC model is a mixed integer nonlinear programming (MINLP) problem with differential algebraic equations (DAEs) and symbolic matrix inversion, which is intractable to solve. Based on the dynamic characteristics of different devices, the original model is simplified as a general MINLP model without DAEs. Then, generalized Benders decomposition is applied to improve the solution efficiency. The relaxed MRSCR constraints are formulated in the master problem to improve the convergence, and the precise MRSCR constraints are formulated in the subproblems to consider the impact of voltage profiles. Case studies based on several benchmark systems and a provincial power grid verify the validity and efficiency of the proposed method

eess.SY↗

Universal Information Extraction with Meta-Pretrained Self-Retrieval

Universal Information Extraction~(Universal IE) aims to solve different extraction tasks in a uniform text-to-structure generation manner. Such a generation procedure tends to struggle when there exist complex information structures to be extracted. Retrieving knowledge from external knowledge bases may help models to overcome this problem but it is impossible to construct a knowledge base suitable for various IE tasks. Inspired by the fact that large amount of knowledge are stored in the pretrained language models~(PLM) and can be retrieved explicitly, in this paper, we propose MetaRetriever to retrieve task-specific knowledge from PLMs to enhance universal IE. As different IE tasks need different knowledge, we further propose a Meta-Pretraining Algorithm which allows MetaRetriever to quicktly achieve maximum task-specific retrieval performance when fine-tuning on downstream IE tasks. Experimental results show that MetaRetriever achieves the new state-of-the-art on 4 IE tasks, 12 datasets under fully-supervised, low-resource and few-shot scenarios.

cs.CL↗

UniMC: A Unified Framework for Long-Term Memory Conversation via Relevance Representation Learning

Open-domain long-term memory conversation can establish long-term intimacy with humans, and the key is the ability to understand and memorize long-term dialogue history information. Existing works integrate multiple models for modelling through a pipeline, which ignores the coupling between different stages. In this paper, we propose a Unified framework for Long-term Memory Conversations (UniMC), which increases the connection between different stages by learning relevance representation. Specifically, we decompose the main task into three subtasks based on probability graphs: 1) conversation summarization, 2) memory retrieval, 3) memory-augmented generation. Each subtask involves learning a representation for calculating the relevance between the query and memory, which is modelled by inserting a special token at the beginning of the decoder input. The relevance representation learning strengthens the connection across subtasks through parameter sharing and joint training. Extensive experimental results show that the proposed method consistently improves over strong baselines and yields better dialogue consistency and engagingness.

cs.CL↗

Type I critical dynamical scalarization and descalarization in Einstein-Maxwell-scalar theory

We investigated the critical dynamical scalarization and descalarization of black holes within the framework of the Einstein-Maxwell-scalar theory featuring higher-order coupling functions. Both the critical scalarization and descalarization displayed first-order phase transitions. When examining the nonlinear dynamics near the threshold, we always observed critical solutions that are linearly unstable static scalarized black holes. The critical dynamical scalarization and descalarization share certain similarities with the type I critical gravitational collapse. However, their initial configurations, critical solutions, and final outcomes differ significantly. To provide further insights into the dynamical results, we conducted a comparative analysis involving static solutions and perturbative analysis.

gr-qc↗

On second-order combinatorial algebraic time-delay interferometry

Inspired by the combinatorial algebraic approach proposed by Dhurandhar {\it et al.}, we propose two novel classes of second-generation time-delay interferometry (TDI) solutions and their further generalization. The primary strategy of the algorithm is to enumerate specific types of residual laser frequency noise associated with second-order commutators in products of time-displacement operators. The derivations are based on analyzing the delay time residual when expanded in time derivatives of the armlengths order by order. It is observed that the solutions obtained by such a scheme are primarily captured by the geometric TDI approach and therefore possess an intuitive interpretation. Nonetheless, the fully-symmetric Sagnac and Sagnac-inspired combinations inherit the properties from the original algebraic approach, and subsequently lie outside of the scope of geometric TDI. We explicitly show that novel solutions, distinct from existing ones in terms of both algebraic structure and sensitivity curve, are encountered. Moreover, at its lowest order, the solution is furnished by commutators of relatively compact form. Besides the original Michelson-type solution, we elaborate on other types of solutions such as the Monitor, Beacon, Relay, Sagnac, fully-symmetric Sagnac, and Sagnac-inspired ones. The average response functions, residual noise power spectral density, and sensitivity curves are evaluated for the obtained solutions. Also, the relations between the present scheme and other existing algorithms are discussed.

astro-ph.IM↗

A novel class of explicit energy-preserving splitting methods for charged-particle dynamics

In this letter, based on the exponential scalar auxiliary variable technology, we propose and study a new class of explicit energy-preserving splitting methods for solving the charged-particle dynamics. The energy-preserving property of these methods is rigorously analysed. We also provide the error estimates for the new methods. Numerical computations are presented, which confirm the effectiveness and superiority of these novel methods in comparison with the standard scalar auxiliary variable approach.

math.NA↗

Relational Sentence Embedding for Flexible Semantic Matching

We present Relational Sentence Embedding (RSE), a new paradigm to further discover the potential of sentence embeddings. Prior work mainly models the similarity between sentences based on their embedding distance. Because of the complex semantic meanings conveyed, sentence pairs can have various relation types, including but not limited to entailment, paraphrasing, and question-answer. It poses challenges to existing embedding methods to capture such relational information. We handle the problem by learning associated relational embeddings. Specifically, a relation-wise translation operation is applied to the source sentence to infer the corresponding target sentence with a pre-trained Siamese-based encoder. The fine-grained relational similarity scores can be computed from learned embeddings. We benchmark our method on 19 datasets covering a wide range of tasks, including semantic textual similarity, transfer, and domain-specific tasks. Experimental results show that our method is effective and flexible in modeling sentence relations and outperforms a series of state-of-the-art sentence embedding methods. https://github.com/BinWang28/RSE

cs.CL↗