arXiv subjects

Jing Li

Publications and source records attributed to Jing Li.

At least 397 records · Page 22Linked to original sources

arXiv2024

Unveiling the Impact of Multi-Modal Interactions on User Engagement: A Comprehensive Evaluation in AI-driven Conversations

Large Language Models (LLMs) have significantly advanced user-bot interactions, enabling more complex and coherent dialogues. However, the prevalent text-only modality might not fully exploit the potential for effective user engagement. This paper explores the impact of multi-modal interactions, which incorporate images and audio alongside text, on user engagement in chatbot conversations. We conduct a comprehensive analysis using a diverse set of chatbots and real-user interaction data, employing metrics such as retention rate and conversation length to evaluate user engagement. Our findings reveal a significant enhancement in user engagement with multi-modal interactions compared to text-only dialogues. Notably, the incorporation of a third modality significantly amplifies engagement beyond the benefits observed with just two modalities. These results suggest that multi-modal interactions optimize cognitive processing and facilitate richer information comprehension. This study underscores the importance of multi-modality in chatbot design, offering valuable insights for creating more engaging and immersive AI communication experiences and informing the broader AI community about the benefits of multi-modal interactions in enhancing user engagement.

cs.CL↗

arXiv2024

High-density single-atom electrocatalytic centers on two-dimensional topological platinum tellurides with Te-vacancy superstructure

Chemical activation of the intrinsically inert basal planes of transition metal dichalcogenides (TMDs) is crucial for developing high-efficiency electrocatalysts for energy technology applications. Here we report the discovery of an efficient TMD-based topological catalyst for hydrogen evolution reaction (HER), containing high-density single-atom reactive centers on a few-layer (7x7)-PtTe2-x superstructure with a Te-vacancy density of x. Compared with pristine Pt(111), PtTe2, and (2x2)-PtTe2-x, (7x7)-PtTe2-x exhibits superior HER performance owing to its substantially increased density of undercoordinated Pt sites, and displays exceptional catalytic stability when operating at high current densities. Our first-principles calculations confirm that multiple types of undercoordinated Pt sites on (7x7)-PtTe2-x exhibit favorable hydrogen adsorption Gibbs free energies, and that the reactive sites can further increase their population upon increasing hydrogen coverage. Both the (2x2)- and (7x7)-PtTe2-x are also shown to possess nontrivial band topology with robust edge states that may further facilitate HER.

cond-mat.mtrl-sci↗

arXiv2024

Knowledge Fusion By Evolving Weights of Language Models

Fine-tuning pre-trained language models, particularly large language models, demands extensive computing resources and can result in varying performance outcomes across different domains and datasets. This paper examines the approach of integrating multiple models from diverse training scenarios into a unified model. This unified model excels across various data domains and exhibits the ability to generalize well on out-of-domain data. We propose a knowledge fusion method named Evolver, inspired by evolutionary algorithms, which does not need further training or additional training data. Specifically, our method involves aggregating the weights of different language models into a population and subsequently generating offspring models through mutation and crossover operations. These offspring models are then evaluated against their parents, allowing for the preservation of those models that show enhanced performance on development datasets. Importantly, our model evolving strategy can be seamlessly integrated with existing model merging frameworks, offering a versatile tool for model enhancement. Experimental results on mainstream language models (i.e., encoder-only, decoder-only, encoder-decoder) reveal that Evolver outperforms previous state-of-the-art models by large margins. The code is publicly available at {https://github.com/duguodong7/model-evolution}.

cs.CL↗

arXiv2024

Mitigating Unhelpfulness in Emotional Support Conversations with Multifaceted AI Feedback

An emotional support conversation system aims to alleviate users' emotional distress and assist them in addressing their challenges. To generate supportive responses, it is critical to consider multiple factors such as empathy, support strategies, and response coherence, as established in prior methods. Nonetheless, previous models occasionally generate unhelpful responses, which intend to provide support but display counterproductive effects. According to psychology and communication theories, poor performance in just one contributing factor might cause a response to be unhelpful. From the model training perspective, since these models have not been exposed to unhelpful responses during their training phase, they are unable to distinguish if the tokens they generate might result in unhelpful responses during inference. To address this issue, we introduce a novel model-agnostic framework named mitigating unhelpfulness with multifaceted AI feedback for emotional support (Muffin). Specifically, Muffin employs a multifaceted AI feedback module to assess the helpfulness of responses generated by a specific model with consideration of multiple factors. Using contrastive learning, it then reduces the likelihood of the model generating unhelpful responses compared to the helpful ones. Experimental results demonstrate that Muffin effectively mitigates the generation of unhelpful responses while slightly increasing response fluency and relevance.

cs.CL↗

arXiv2024

Multimodal Reasoning with Multimodal Knowledge Graph

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge graphs, but their singular modality of knowledge limits comprehensive cross-modal understanding. In this paper, we propose the Multimodal Reasoning with Multimodal Knowledge Graph (MR-MKG) method, which leverages multimodal knowledge graphs (MMKGs) to learn rich and semantic knowledge across modalities, significantly enhancing the multimodal reasoning capabilities of LLMs. In particular, a relation graph attention network is utilized for encoding MMKGs and a cross-modal alignment module is designed for optimizing image-text alignment. A MMKG-grounded dataset is constructed to equip LLMs with initial expertise in multimodal reasoning through pretraining. Remarkably, MR-MKG achieves superior performance while training on only a small fraction of parameters, approximately 2.25% of the LLM's parameter size. Experimental results on multimodal question answering and multimodal analogy reasoning tasks demonstrate that our MR-MKG method outperforms previous state-of-the-art models.

cs.CL↗

arXiv2024

CACL: Community-Aware Heterogeneous Graph Contrastive Learning for Social Media Bot Detection

Social media bot detection is increasingly crucial with the rise of social media platforms. Existing methods predominantly construct social networks as graph and utilize graph neural networks (GNNs) for bot detection. However, most of these methods focus on how to improve the performance of GNNs while neglecting the community structure within social networks. Moreover, GNNs based methods still face problems such as poor model generalization due to the relatively small scale of the dataset and over-smoothness caused by information propagation mechanism. To address these problems, we propose a Community-Aware Heterogeneous Graph Contrastive Learning framework (CACL), which constructs social network as heterogeneous graph with multiple node types and edge types, and then utilizes community-aware module to dynamically mine both hard positive samples and hard negative samples for supervised graph contrastive learning with adaptive graph enhancement algorithms. Extensive experiments demonstrate that our framework addresses the previously mentioned challenges and outperforms competitive baselines on three social media bot benchmarks.

cs.SI↗

arXiv2024

Reasoning3D -- Grounding and Reasoning in 3D: Fine-Grained Zero-Shot Open-Vocabulary 3D Reasoning Part Segmentation via Large Vision-Language Models

In this paper, we introduce a new task: Zero-Shot 3D Reasoning Segmentation for parts searching and localization for objects, which is a new paradigm to 3D segmentation that transcends limitations for previous category-specific 3D semantic segmentation, 3D instance segmentation, and open-vocabulary 3D segmentation. We design a simple baseline method, Reasoning3D, with the capability to understand and execute complex commands for (fine-grained) segmenting specific parts for 3D meshes with contextual awareness and reasoned answers for interactive segmentation. Specifically, Reasoning3D leverages an off-the-shelf pre-trained 2D segmentation network, powered by Large Language Models (LLMs), to interpret user input queries in a zero-shot manner. Previous research have shown that extensive pre-training endows foundation models with prior world knowledge, enabling them to comprehend complex commands, a capability we can harness to "segment anything" in 3D with limited 3D datasets (source efficient). Experimentation reveals that our approach is generalizable and can effectively localize and highlight parts of 3D objects (in 3D mesh) based on implicit textual queries, including these articulated 3d objects and real-world scanned data. Our method can also generate natural language explanations corresponding to these 3D models and the decomposition. Moreover, our training-free approach allows rapid deployment and serves as a viable universal baseline for future research of part-level 3d (semantic) object understanding in various fields including robotics, object manipulation, part assembly, autonomous driving applications, augment reality and virtual reality (AR/VR), and medical applications. The code, the model weight, the deployment guide, and the evaluation protocol are: http://tianrun-chen.github.io/Reason3D/

cs.CV↗

arXiv2024

Emergent Oscillating bound states in a semi-infinite linear waveguide with a point-like $Λ$-type quantum emitter driven by a classical field

An oscillating bound state is a phenomenon where excitations mediated by the continuum modes oscillate persistently. Although it is generated by the superposition of two bound states in the continuum (BICs), such phenomenon is said to be unique to giant atoms. We present the phenomenon of an oscillating bound state with an alternative waveguide QED system, which is a one-dimensional semi-infinite waveguide coupled to a \textit{point-like} quantum emitter. This \textit{point-like} quantum emitter is $Λ$-type quantum system with one transition driven by a classical field.

quant-ph↗

arXiv2024

Shape of a droplet on a surface in the presence of an external field and its critical disruption condition

Due to the potential application of regulating droplet shape by external fields in microfluidic technology and micro devices, it becomes increasingly important to understand the shape formation of a droplet in the presence of an electric field. How to understand and determine such a deformable boundary shape at equilibrium has been a long-term physical and mathematical challenge. Here, based on the theoretical model we propose, and combining the finite element method and the gradient descent algorithm, we successfully obtain the droplet shape by considering the contributions made by electrostatic energy, surface tension energy, and gravitational potential energy. We also carry out scaling analyses and obtain an empirical critical disruption condition with a universal scaling exponent 1/2 for the contact angle in terms of normalized volume. The master curve fits both the experimental and the numerical results very well.

cond-mat.soft↗

arXiv2024

LocMoE: A Low-Overhead MoE for Large Language Model Training

The Mixtures-of-Experts (MoE) model is a widespread distributed and integrated learning method for large language models (LLM), which is favored due to its ability to sparsify and expand models efficiently. However, the performance of MoE is limited by load imbalance and high latency of All-to-All communication, along with relatively redundant computation owing to large expert capacity. Load imbalance may result from existing routing policies that consistently tend to select certain experts. The frequent inter-node communication in the All-to-All procedure also significantly prolongs the training time. To alleviate the above performance problems, we propose a novel routing strategy that combines load balance and locality by converting partial inter-node communication to that of intra-node. Notably, we elucidate that there is a minimum threshold for expert capacity, calculated through the maximal angular deviation between the gating weights of the experts and the assigned tokens. We port these modifications on the PanGu-Sigma model based on the MindSpore framework with multi-level routing and conduct experiments on Ascend clusters. The experiment results demonstrate that the proposed LocMoE reduces training time per epoch by 12.68% to 22.24% compared to classical routers, such as hash router and switch router, without impacting the model accuracy.

cs.LG↗

arXiv2024

Collaborative planning of integrated hydrogen energy chain multi-energy systems: A review

Most planning of the traditional hydrogen energy supply chain (HSC) focuses on the storage and transportation links between production and consumption ends. It ignores the energy flows and interactions between each link, making it unsuitable for energy system planning analysis. Therefore, we propose the concept of a hydrogen energy chain (HEC) based on the HSC, which emphasizes the interactions between different types of energy flows in the production, compression, storage, transportation, and application links of hydrogen. The HEC plays a crucial role in mitigating fluctuations of renewable energy and facilitating the optimal allocation of heterogeneous energy sources across time and space. Effective collaborative planning models that consider HEC are essential for the optimal configuration of multi-energy systems (MESs), which guarantees high-efficiency operation and the economic and environmental friendliness of the system. This paper presents a systematic review of recent articles on collaborative planning of integrated hydrogen energy chain multi-energy systems (HEC-MESs). First, we introduce the basic framework of HEC-MES, focusing on the current research status of the production, compression, storage, transportation, and application links in HEC. Furthermore, we review technology types of hydrogen energy for planning and summarize the typical forms of HEC in MESs. Then, the following sections outline the models and methods for collaborative planning of HEC-MES. They include detailed analyses of covered sector types, spatial and temporal scopes of planning, uncertainties, model formulations, and solution methods. Finally, the paper concludes by summarizing the research gaps identified in current articles and outlining directions for future research.

eess.SY↗

arXiv2024

Discovery of $\sim$2200 new supernova remnants in 19 nearby star-forming galaxies with MUSE spectroscopy

We present the largest extragalactic survey of supernova remnant (SNR) candidates in nearby star-forming galaxies using exquisite spectroscopic maps from MUSE. Supernova remnants exhibit distinctive emission-line ratios and kinematic signatures, which are apparent in optical spectroscopy. Using optical integral field spectra from the PHANGS-MUSE project, we identify SNRs in 19 nearby galaxies at ~ 100~pc scales. We use five different optical diagnostics: (1) line ratio maps of [SII]/H$α$; (2) line ratio maps of [OI]/H$α$; (3) velocity dispersion map of the gas; (4) and (5) two line ratio diagnostic diagrams from BPT diagrams to identify and distinguish SNRs from other nebulae. Given that our SNRs are seen in projection against HII regions and diffuse ionized gas, in our line ratio maps we use a novel technique to search for objects with [SII]/H$α$ or [OI]/H$α$ in excess of what is expected at fixed H$α$ surface brightness within photoionized gas. In total, we identify 2,233 objects using at least one of our diagnostics, and define a subsample of 1,166 high-confidence SNRs that have been detected with at least two diagnostics. The line ratios of these SNRs agree well with the MAPPINGS shock models, and we validate our technique using the well-studied nearby galaxy M83, where all SNRs we found are also identified in literature catalogs and we recover 51% of the known SNRs. The remaining 1,067 objects in our sample are detected with only one diagnostic and we classify them as SNR candidates. We find that ~ 35% of all our objects overlap with the boundaries of HII regions from literature catalogs, highlighting the importance of using indicators beyond line intensity morphology to select SNRs. [OI]/H$α$ line ratio is responsible for selecting the most objects (1,368; 61%), (abridged).

astro-ph.GA↗

arXiv2024

Prompt-based Code Completion via Multi-Retrieval Augmented Generation

Automated code completion, aiming at generating subsequent tokens from unfinished code, has been significantly benefited from recent progress in pre-trained Large Language Models (LLMs). However, these models often suffer from coherence issues and hallucinations when dealing with complex code logic or extrapolating beyond their training data. Existing Retrieval Augmented Generation (RAG) techniques partially address these issues by retrieving relevant code with a separate encoding model where the retrieved snippet serves as contextual reference for code completion. However, their retrieval scope is subject to a singular perspective defined by the encoding model, which largely overlooks the complexity and diversity inherent in code semantics. To address this limitation, we propose ProCC, a code completion framework leveraging prompt engineering and the contextual multi-armed bandits algorithm to flexibly incorporate and adapt to multiple perspectives of code. ProCC first employs a prompt-based multi-retriever system which crafts prompt templates to elicit LLM knowledge to understand code semantics with multiple retrieval perspectives. Then, it adopts the adaptive retrieval selection algorithm to incorporate code similarity into the decision-making process to determine the most suitable retrieval perspective for the LLM to complete the code. Experimental results demonstrate that ProCC outperforms state-of-the-art code completion technique by 8.6% on our collected open-source benchmark suite and 10.1% on the private-domain benchmark suite collected from a billion-user e-commerce company in terms of Exact Match. ProCC also allows augmenting fine-tuned techniques in a plug-and-play manner, yielding 5.6% improvement over our studied fine-tuned model.

cs.SE↗

arXiv2024

PHANGS-JWST: Data Processing Pipeline and First Full Public Data Release

The exquisite angular resolution and sensitivity of JWST is opening a new window for our understanding of the Universe. In nearby galaxies, JWST observations are revolutionizing our understanding of the first phases of star formation and the dusty interstellar medium. Nineteen local galaxies spanning a range of properties and morphologies across the star-forming main sequence have been observed as part of the PHANGS-JWST Cycle 1 Treasury program at spatial scales of $\sim$5-50pc. Here, we describe pjpipe, an image processing pipeline developed for the PHANGS-JWST program that wraps around and extends the official JWST pipeline. We release this pipeline to the community as it contains a number of tools generally useful for JWST NIRCam and MIRI observations. Particularly for extended sources, pjpipe products provide significant improvements over mosaics from the MAST archive in terms of removing instrumental noise in NIRCam data, background flux matching, and calibration of relative and absolute astrometry. We show that slightly smoothing F2100W MIRI data to 0.9" (degrading the resolution by about 30 percent) reduces the noise by a factor of $\approx$3. We also present the first public release (DR1.1.0) of the pjpipe processed eight-band 2-21 $μ$m imaging for all nineteen galaxies in the PHANGS-JWST Cycle 1 Treasury program. An additional 55 galaxies will soon follow from a new PHANGS-JWST Cycle 2 Treasury program.

astro-ph.GA↗

arXiv2024

Annealed adaptive importance sampling method in PINNs for solving high dimensional partial differential equations

Physics-informed neural networks (PINNs) have emerged as powerful tools for solving a wide range of partial differential equations (PDEs). However, despite their user-friendly interface and broad applicability, PINNs encounter challenges in accurately resolving PDEs, especially when dealing with singular cases that may lead to unsatisfactory local minima. To address these challenges and improve solution accuracy, we propose an innovative approach called Annealed Adaptive Importance Sampling (AAIS) for computing the discretized PDE residuals of the cost functions, inspired by the Expectation Maximization algorithm used in finite mixtures to mimic target density. Our objective is to approximate discretized PDE residuals by strategically sampling additional points in regions with elevated residuals, thus enhancing the effectiveness and accuracy of PINNs. Implemented together with a straightforward resampling strategy within PINNs, our AAIS algorithm demonstrates significant improvements in efficiency across a range of tested PDEs, even with limited training datasets. Moreover, our proposed AAIS-PINN method shows promising capabilities in solving high-dimensional singular PDEs. The adaptive sampling framework introduced here can be integrated into various PINN frameworks.

math.NA↗

arXiv2024

The SDSS-V Local Volume Mapper (LVM): Scientific Motivation and Project Overview

We present the Sloan Digital Sky Survey V (SDSS-V) Local Volume Mapper (LVM). The LVM is an integral-field spectroscopic survey of the Milky Way, Magellanic Clouds, and of a sample of local volume galaxies, connecting resolved pc-scale individual sources of feedback to kpc-scale ionized interstellar medium (ISM) properties. The 4-year survey covers the southern Milky Way disk at spatial resolutions of 0.05 to 1 pc, the Magellanic Clouds at 10 pc resolution, and nearby large galaxies at larger scales totaling $>4300$ square degrees of sky, and more than 55M spectra. It utilizes a new facility of alt-alt mounted siderostats feeding 16 cm refractive telescopes, lenslet-coupled fiber-optics, and spectrographs covering 3600-9800A at R ~ 4000. The ultra-wide field IFU has a diameter of 0.5 degrees with 1801 hexagonally packed fibers of 35.3 arcsec apertures. The siderostats allow for a completely stationary fiber system, avoiding instability of the line spread function seen in traditional fiber feeds. Scientifically, LVM resolves the regions where energy, momentum, and chemical elements are injected into the ISM at the scale of gas clouds, while simultaneously charting where energy is being dissipated (via cooling, shocks, turbulence, bulk flows, etc.) to global scales. This combined local and global view enables us to constrain physical processes regulating how stellar feedback operates and couples to galactic kinematics and disk-scale structures, such as the bar and spiral arms, as well as gas in- and out-flows.

astro-ph.GA↗

arXiv2024

Giant Spin-Orbit Torque in Cr-based Janus Transition Metal Dichalcogenides

We report a very large spin-orbit torque (SOT) capability of chromium-based transition metal dichalcogenides (TMD) in their Janus forms CrXTe, with X=S,Se. The structural inversion symmetry breaking, inherent to Janus structures is responsible for a large SOT response generated by giant Rashba splitting, equivalent to that obtained by applying a transverse electric field of $\sim 100 \,\text{V} \,\text{nm}^{-1}$ in non-Janus CrTe\textsubscript{2}, completely out of experimental reach. By performing transport simulations on custom-made Wannier tight-binding models, Janus systems are found to exhibit a SOT performance comparable to the most efficient two-dimensional materials, while allowing for field-free perpendicular magnetization switching owing to their reduced in-plane symmetry. Altogether, our findings evidence that magnetic Janus TMDs stand as suitable candidates for ultimate SOT-MRAM devices.

cond-mat.mtrl-sci↗

arXiv2024

Domain wall migration-mediated ferroelectric switching and Rashba effect tuning in GeTe thin films

Germanium Telluride (GeTe), identified as a ferroelectric Rashba semiconductor, is a promising candidate for future electronic devices in computing and memory applications. However, its ferroelectric switching on a microscopic scale remains to be understood. Here, we propose that the migration of a domain wall can be the mechanism that mediates the ferroelectric switching. By employing $ab~initio$ methods, such a mechanism is characterized by an energy barrier of $66.8$ meV/nm$^2$, in a suitable range for retention and switchability. In accompanying the domain wall migration, the net Rashba effect is tunable, as it is a result of competition between layers with opposite electric polarization. These results shed light on the ferroelectric switching mechanism in GeTe, paving stones for the design of potential GeTe-based devices.

cond-mat.mtrl-sci↗