arXiv subjects

Lingzhi Wang

Publications and source records attributed to Lingzhi Wang.

At least 55 records · Page 3Linked to original sources

arXiv2024

A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers

Relation extraction (RE) involves identifying the relations between entities from underlying content. RE serves as the foundation for many natural language processing (NLP) and information retrieval applications, such as knowledge graph completion and question answering. In recent years, deep neural networks have dominated the field of RE and made noticeable progress. Subsequently, the large pre-trained language models have taken the state-of-the-art RE to a new level. This survey provides a comprehensive review of existing deep learning techniques for RE. First, we introduce RE resources, including datasets and evaluation metrics. Second, we propose a new taxonomy to categorize existing works from three perspectives, i.e., text representation, context encoding, and triplet prediction. Third, we discuss several important challenges faced by RE and summarize potential techniques to tackle these challenges. Finally, we outline some promising future directions and prospects in this field. This survey is expected to facilitate researchers' collaborative efforts to address the challenges of real-world RE systems.

cs.CL↗

arXiv2024

The Red Supergiant Progenitor of Type II Supernova 2024ggi

We present a detailed analysis of the progenitor and its local environment for the recently discovered type II supernova (SN) 2024ggi at a distance of about 6.7~Mpc, by utilizing the pre-explosion images from the Hubble Space Telescope (HST) and \textit{Spitzer} Space Telescope. The progenitor is identified as a red, bright variable star, with absolute $F814W$-band magnitudes being $-$6.2 mag in 1995 to $-$7.2 mag in 2003, respectively, consistent with that of a normal red supergiant (RSG) star. Combining with the historical mid-infrared light curves, a pulsational period of about 379~days can be inferred for the progenitor star. Fitting its spectral energy distribution with stellar spectral models yields the stellar parameters of temperature, radius and bolometric luminosity as $T_*=3290_{-27}^{+19}$~K, $R_*=887_{-51}^{+60}$~R$_{\odot}$, and log($L$/L$_{\odot}$)$=4.92_{-0.04}^{+0.05}$, respectively. The above parameters indicate that the progenitor of SN 2024ggi is consistent with the stellar evolutionary track of a solar-metallicity massive star with an initial mass of $13_{-1}^{+1}$~M$_{\odot}$. Moreover, our analysis indicates a relatively low mass loss rate (i.e., $< 3\times10^{-6}$~M$_{\odot}$~yr$^{-1}$) for the progenitor compared to that inferred from the flashed spectra and X-ray detection (i.e., $10^{-2}$$-$$ 10$$^{-5}$~M$_{\odot}$~yr$^{-1}$), implying a significant enhancement in mass loss within a few years prior to the explosion.

astro-ph.HE↗

arXiv2024

Decoding the MITRE Engenuity ATT&CK Enterprise Evaluation: An Analysis of EDR Performance in Real-World Environments

Endpoint detection and response (EDR) systems have emerged as a critical component of enterprise security solutions, effectively combating endpoint threats like APT attacks with extended lifecycles. In light of the growing significance of endpoint detection and response (EDR) systems, many cybersecurity providers have developed their own proprietary EDR solutions. It's crucial for users to assess the capabilities of these detection engines to make informed decisions about which products to choose. This is especially urgent given the market's size, which is expected to reach around 3.7 billion dollars by 2023 and is still expanding. MITRE is a leading organization in cyber threat analysis. In 2018, MITRE started to conduct annual APT emulations that cover major EDR vendors worldwide. Indicators include telemetry, detection and blocking capability, etc. Nevertheless, the evaluation results published by MITRE don't contain any further interpretations or suggestions. In this paper, we thoroughly analyzed MITRE evaluation results to gain further insights into real-world EDR systems under test. Specifically, we designed a whole-graph analysis method, which utilizes additional control flow and data flow information to measure the performance of EDR systems. Besides, we analyze MITRE evaluation's results over multiple years from various aspects, including detection coverage, detection confidence, detection modifier, data source, compatibility, etc. Through the above studies, we have compiled a thorough summary of our findings and gained valuable insights from the evaluation results. We believe these summaries and insights can assist researchers, practitioners, and vendors in better understanding the strengths and limitations of mainstream EDR products.

cs.CR↗

arXiv2024

A Shock Flash Breaking Out of a Dusty Red Supergiant

Shock breakout emission is light that arises when a shockwave, generated by core-collapse explosion of a massive star, passes through its outer envelope. Hitherto, the earliest detection of such a signal was at several hours after the explosion, though a few others had been reported. The temporal evolution of early light curves should reveal insights into the shock propagation, including explosion asymmetry and environment in the vicinity, but this has been hampered by the lack of multiwavelength observations. Here we report the instant multiband observations of a type II supernova (SN 2023ixf) in the galaxy M101 (at a distance of 6.85+/-0.15 Mpc), beginning at about 1.4 hours after the explosion. The exploding star was a red supergiant with a radius of about 440 solar radii. The light curves evolved rapidly, on timescales of 1-2 hours, and appeared unusually fainter and redder than predicted by models within the first few hours, which we attribute to an optically thick dust shell before it was disrupted by the shockwave. We infer that the breakout and perhaps the distribution of the surrounding dust were not spherically symmetric.

astro-ph.HE↗

arXiv2024

IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias Indicators

This study focuses on media bias detection, crucial in today's era of influential social media platforms shaping individual attitudes and opinions. In contrast to prior work that primarily relies on training specific models tailored to particular datasets, resulting in limited adaptability and subpar performance on out-of-domain data, we introduce a general bias detection framework, IndiVec, built upon large language models. IndiVec begins by constructing a fine-grained media bias database, leveraging the robust instruction-following capabilities of large language models and vector database techniques. When confronted with new input for bias detection, our framework automatically selects the most relevant indicator from the vector database and employs majority voting to determine the input's bias label. IndiVec excels compared to previous methods due to its adaptability (demonstrating consistent performance across diverse datasets from various sources) and explainability (providing explicit top-k indicators to interpret bias predictions). Experimental results on four political bias datasets highlight IndiVec's significant superiority over baselines. Furthermore, additional experiments and analysis provide profound insights into the framework's effectiveness.

cs.CL↗

arXiv2024

Newly Formed Dust within the Circumstellar Environment of SNIa-CSM 2018evt

Dust associated with various stellar sources in galaxies at all cosmic epochs remains a controversial topic, particularly whether supernovae (SNe) play an important role in dust production. We report evidence of dust formation in the cold, dense shell behind the ejecta-circumstellar medium (CSM) interaction in the Type Ia-CSM SN 2018evt three years after the explosion, characterized by a rise in the mid-infrared (MIR) emission accompanied by an accelerated decline in the optical radiation of the SN. Such a dust-formation picture is also corroborated by the concurrent evolution of the profiles of the Ha emission line. Our model suggests enhanced CSM dust concentration at increasing distances from the SN as compared to what can be expected from the density profile of the mass loss from a steady stellar wind. By the time of the last MIR observations at day +1041, a total amount of 1.2+-0.2x10^{-2} Msun of new dust has been formed by SN 2018evt, making SN 2018evt one of the most prolific dust factories among SNe with evidence of dust formation. The unprecedented witness of the intense production procedure of dust may shed light on the perceptions of dust formation in cosmic history.

astro-ph.HE↗

arXiv2023

The Dusty and Extremely Red Progenitor of the Type II Supernova 2023ixf in Messier 101

Stars with initial masses in the range of 8-25 solar masses are thought to end their lives as hydrogen-rich supernovae (SNe II). Based on the pre-explosion images of Hubble Space Telescope ($HST$) and $Spitzer$ Space Telescope, we place tight constraints on the progenitor candidate of type IIP SN 2023ixf in Messier 101. Fitting of the spectral energy distribution (SED) of its progenitor with dusty stellar spectral models results in an estimation of the effective temperature as 3091$^{+422}_{-258}$ K. The luminosity is estimated as log($L/$L$_{\odot}$)$\sim4.83$, consistent with a red supergiant (RSG) star with an initial mass of 12$^{+2}_{-1}$ M$_{\odot}$. The derived mass loss rate (6-9$\times10^{-6}$ M$_{\odot}$ yr$^{-1}$) is much lower than that inferred from the flash spectroscopy of the SN, suggesting that the progenitor experienced a sudden increase in mass loss when approaching the final explosion. In the infrared bands, significant deviation from the range of regular RSGs in the color-magnitude diagram and period-luminosity space of the progenitor star indicates enhanced mass loss and dust formation. Combining with new evidence of polarization at the early phases of SN 2023ixf, such a violent mass loss is likely a result of binary interaction.

astro-ph.SR↗

arXiv2023

TPE: Towards Better Compositional Reasoning over Conceptual Tools with Multi-persona Collaboration

Large language models (LLMs) have demonstrated exceptional performance in planning the use of various functional tools, such as calculators and retrievers, particularly in question-answering tasks. In this paper, we expand the definition of these tools, centering on conceptual tools within the context of dialogue systems. A conceptual tool specifies a cognitive concept that aids systematic or investigative thought. These conceptual tools play important roles in practice, such as multiple psychological or tutoring strategies being dynamically applied in a single turn to compose helpful responses. To further enhance the reasoning and planning capability of LLMs with these conceptual tools, we introduce a multi-persona collaboration framework: Think-Plan-Execute (TPE). This framework decouples the response generation process into three distinct roles: Thinker, Planner, and Executor. Specifically, the Thinker analyzes the internal status exhibited in the dialogue context, such as user emotions and preferences, to formulate a global guideline. The Planner then generates executable plans to call different conceptual tools (e.g., sources or strategies), while the Executor compiles all intermediate results into a coherent response. This structured approach not only enhances the explainability and controllability of responses but also reduces token redundancy. We demonstrate the effectiveness of TPE across various dialogue response generation tasks, including multi-source (FoCus) and multi-strategy interactions (CIMA and PsyQA). This reveals its potential to handle real-world dialogue interactions that require more complicated tool learning beyond just functional tools. The full code and data will be released for reproduction.

cs.AI↗

arXiv2023

Delta-LoRA: Fine-Tuning High-Rank Parameters with the Delta of Low-Rank Matrices

In this paper, we present Delta-LoRA, which is a novel parameter-efficient approach to fine-tune large language models (LLMs). In contrast to LoRA and other low-rank adaptation methods such as AdaLoRA, Delta-LoRA not only updates the low-rank matrices $\bA$ and $\bB$, but also propagate the learning to the pre-trained weights $\bW$ via updates utilizing the delta of the product of two low-rank matrices ($\bA^{(t+1)}\bB^{(t+1)} - \bA^{(t)}\bB^{(t)}$). Such a strategy effectively addresses the limitation that the incremental update of low-rank matrices is inadequate for learning representations capable for downstream tasks. Moreover, as the update of $\bW$ does not need to compute the gradients of $\bW$ and store their momentums, Delta-LoRA shares comparable memory requirements and computational costs with LoRA. Extensive experiments show that Delta-LoRA significantly outperforms existing low-rank adaptation methods. We further support these results with comprehensive analyses that underscore the effectiveness of Delta-LoRA.

cs.LG↗

arXiv2023

Possible Circumstellar Interaction Origin of the Early Excess Emission in Thermonuclear Supernovae

Type Ia supernovae (SNe Ia) arise from the thermonuclear explosion in binary systems involving carbon-oxygen white dwarfs (WDs). The pathway of WDs acquiring mass may produce circumstellar material (CSM). Observing SNe Ia within a few hours to a few days after the explosion can provide insight into the nature of CSM relating to the progenitor systems. In this paper, we propose a CSM model to investigate the effect of ejecta-CSM interaction on the early-time multi-band light curves of SNe Ia. By varying the mass-loss history of the progenitor system, we apply the ejecta-CSM interaction model to fit the optical and ultraviolet (UV) photometric data of eight SNe Ia with early excess. The photometric data of SNe Ia in our sample can be well-matched by our CSM model except for the UV-band light curve of iPTF14atg, indicating its early excess may not be due to the ejecta-CSM interaction. Meanwhile, the CSM interaction can generate synchrotron radiation from relativistic electrons in the shocked gas, making radio observations a distinctive probe of CSM. The radio luminosity based on our models suggests that positive detection of the radio signal is only possible within a few days after the explosion at higher radio frequencies (e.g., ~250 GHz); at lower frequencies (e.g., ~1.5 GHz) the detection is difficult. These models lead us to conclude that a multi-messenger approach that involves UV, optical, and radio observations of SNe Ia a few days past explosion is needed to address many of the outstanding questions concerning the progenitor systems of SNe Ia.

astro-ph.HE↗

arXiv2023

KGA: A General Machine Unlearning Framework Based on Knowledge Gap Alignment

Recent legislation of the "right to be forgotten" has led to the interest in machine unlearning, where the learned models are endowed with the function to forget information about specific training instances as if they have never existed in the training set. Previous work mainly focuses on computer vision scenarios and largely ignores the essentials of unlearning in NLP field, where text data contains more explicit and sensitive personal information than images. In this paper, we propose a general unlearning framework called KGA to induce forgetfulness. Different from previous work that tries to recover gradients or forces models to perform close to one specific distribution, KGA maintains distribution differences (i.e., knowledge gap). This relaxes the distribution assumption. Furthermore, we first apply the unlearning method to various NLP tasks (i.e., classification, translation, response generation) and propose several unlearning evaluation metrics with pertinence. Experiments on large-scale datasets show that KGA yields comprehensive improvements over baselines, where extensive analyses further validate the effectiveness of KGA and provide insight into unlearning for NLP tasks.

cs.CL↗

arXiv2023

Opportunities and Challenges in Neural Dialog Tutoring

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large language models (LLMs) and growth in available dialog corpora, dialog tutoring has largely remained unaffected by these advances. In this paper, we rigorously analyze various generative language models on two dialog tutoring datasets for language learning using automatic and human evaluations to understand the new opportunities brought by these advances as well as the challenges we must overcome to build models that would be usable in real educational settings. We find that although current approaches can model tutoring in constrained learning scenarios when the number of concepts to be taught and possible teacher strategies are small, they perform poorly in less constrained scenarios. Our human quality evaluation shows that both models and ground-truth annotations exhibit low performance in terms of equitable tutoring, which measures learning opportunities for students and how engaging the dialog is. To understand the behavior of our models in a real tutoring setting, we conduct a user study using expert annotators and find a significantly large number of model reasoning errors in 45% of conversations. Finally, we connect our findings to outline future work.

cs.CL↗

arXiv2023

Strategize Before Teaching: A Conversational Tutoring System with Pedagogy Self-Distillation

Conversational tutoring systems (CTSs) aim to help students master educational material with natural language interaction in the form of a dialog. CTSs have become a key pillar in educational data mining research. A key challenge in CTSs is to engage the student in the conversation while exposing them to a diverse set of teaching strategies, akin to a human teacher, thereby, helping them learn in the process. Different from previous work that generates responses given the strategies as input, we propose to jointly predict teaching strategies and generate tutor responses accordingly, which fits a more realistic application scenario. We benchmark several competitive models on three dialog tutoring datasets and propose a unified framework that combines teaching response generation and pedagogical strategy prediction, where a self-distillation mechanism is adopted to guide the teaching strategy learning and facilitate tutor response generation. Our experiments and analyses shed light on how teaching strategies affect dialog tutoring.

cs.CL↗

arXiv2023

Salt and pepper noise removal method based on stationary Framelet transform with non-convex sparsity regularization

Salt and pepper noise removal is a common inverse problem in image processing. Traditional denoising methods have two limitations. First, noise characteristics are often not described accurately. For example, the noise location information is often ignored and the sparsity of the salt and pepper noise is often described by L1 norm, which cannot illustrate the sparse variables clearly. Second, conventional methods separate the contaminated image into a recovered image and a noise part, thus resulting in recovering an image with unsatisfied smooth parts and detail parts. In this study, we introduce a noise detection strategy to determine the position of the noise, and a non-convex sparsity regularization depicted by Lp quasi-norm is employed to describe the sparsity of the noise, thereby addressing the first limitation. The morphological component analysis framework with stationary Framelet transform is adopted to decompose the processed image into cartoon, texture, and noise parts to resolve the second limitation. Then, the alternating direction method of multipliers (ADMM) is employed to solve the proposed model. Finally, experiments are conducted to verify the proposed method and compare it with some current state-of-the-art denoising methods. The experimental results show that the proposed method can remove salt and pepper noise while preserving the details of the processed image.

eess.IV↗

arXiv2022

The Interaction of Supernova 2018evt with a Substantial Amount of Circumstellar Matter -- An SN1997cy-like Event

A rare class of supernovae (SNe) is characterized by strong interaction between the ejecta and several solar masses of circumstellar matter (CSM) as evidenced by strong Balmer-line emission. Within the first few weeks after the explosion, they may display spectral features similar to overluminous Type Ia SNe, while at later phase their observation properties exhibit remarkable similarities with some extreme case of Type IIn SNe that show strong Balmer lines years after the explosion. We present polarimetric observations of SN2018evt obtained by the ESO Very Large Telescope from 172 to 219 days after the estimated time of peak luminosity to study the geometry of the CSM. The nonzero continuum polarization decreases over time, suggesting that the mass loss of the progenitor star is aspherical. The prominent H$α$ emission can be decomposed into a broad, time-evolving component and an intermediate-width, static component. The former shows polarized signals, and it is likely to arise from a cold dense shell (CDS) within the region between the forward and reverse shocks. The latter is significantly unpolarized, and it is likely to arise from shocked, fragmented gas clouds in the H-rich CSM. We infer that SN2018evt exploded inside a massive and aspherical circumstellar cloud. The symmetry axes of the CSM and the SN appear to be similar. SN\,2018evt shows observational properties common to events that display strong interaction between the ejecta and CSM, implying that they share similar circumstellar configurations. Our preliminary estimate also suggests that the circumstellar environment of SN2018evt has been significantly enriched at a rate of $\sim0.1$ M$_\odot$ yr$^{-1}$ over a period of $>100$ yr.

astro-ph.HE↗

arXiv2022

RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Models

Conversational Recommender System (CRS), which aims to recommend high-quality items to users through interactive conversations, has gained great research interest recently. A CRS is usually composed of a recommendation module and a generation module. In the previous work, these two modules are loosely connected in the model training and are shallowly integrated during inference, where a simple switching or copy mechanism is adopted to incorporate recommended items into generated responses. Moreover, the current end-to-end neural models trained on small crowd-sourcing datasets (e.g., 10K dialogs in the ReDial dataset) tend to overfit and have poor chit-chat ability. In this work, we propose a novel unified framework that integrates recommendation into the dialog (RecInDial) generation by introducing a vocabulary pointer. To tackle the low-resource issue in CRS, we finetune the large-scale pretrained language models to generate fluent and diverse responses, and introduce a knowledge-aware bias learned from an entity-oriented knowledge graph to enhance the recommendation performance. Furthermore, we propose to evaluate the CRS models in an end-to-end manner, which can reflect the overall performance of the entire system rather than the performance of individual modules, compared to the separate evaluations of the two modules used in previous work. Experiments on the benchmark dataset ReDial show our RecInDial model significantly surpasses the state-of-the-art methods. More extensive analyses show the effectiveness of our model.

cs.CL↗

arXiv2022

Improving Conversational Recommender System via Contextual and Time-Aware Modeling with Less Domain-Specific Knowledge

Conversational Recommender Systems (CRS) has become an emerging research topic seeking to perform recommendations through interactive conversations, which generally consist of generation and recommendation modules. Prior work on CRS tends to incorporate more external and domain-specific knowledge like item reviews to enhance performance. Despite the fact that the collection and annotation of the external domain-specific information needs much human effort and degenerates the generalizability, too much extra knowledge introduces more difficulty to balance among them. Therefore, we propose to fully discover and extract internal knowledge from the context. We capture both entity-level and contextual-level representations to jointly model user preferences for the recommendation, where a time-aware attention is designed to emphasize the recently appeared items in entity-level representations. We further use the pre-trained BART to initialize the generation module to alleviate the data scarcity and enhance the context modeling. In addition to conducting experiments on a popular dataset (ReDial), we also include a multi-domain dataset (OpenDialKG) to show the effectiveness of our model. Experiments on both datasets show that our model achieves better performance on most evaluation metrics with less external knowledge and generalizes well to other domains. Additional analyses on the recommendation and generation tasks demonstrate the effectiveness of our model in different scenarios.

cs.CL↗

arXiv2022

Observations of the Very Young Type Ia Supernova 2019np with Early-excess Emission

Early-time radiative signals from type Ia supernovae (SNe Ia) can provide important constraints on the explosion mechanism and the progenitor system. We present observations and analysis of SN 2019np, a nearby SN Ia discovered within 1-2 days after the explosion. Follow-up observations were conducted in optical, ultraviolet, and near-infrared bands, covering the phases from $\sim-$16.7 days to $\sim$+367.8 days relative to its $B-$band peak luminosity. The photometric and spectral evolutions of SN 2019np resembles the average behavior of normal SNe Ia. The absolute B-band peak magnitude and the post-peak decline rate are $M_{\rm max}(B)=-19.52 \pm 0.47$mag and $Δm_{\rm15}(B) =1.04 \pm 0.04$mag, respectively. No Hydrogen line has been detected in the near-infrared and nebular-phase spectra of SN 2019np. Assuming that the $^{56}$Ni powering the light curve is centrally located, we find that the bolometric light curve of SN 2019np shows a flux excess up to 5.0% in the early phase compared to the radiative diffusion model. Such an extra radiation perhaps suggests the presence of an additional energy source beyond the radioactive decay of central nickel. Comparing the observed color evolution with that predicted by different models such as interactions of SN ejecta with circumstellar matter (CSM)/companion star, a double-detonation explosion from a sub-Chandrasekhar mass white dwarf (WD), and surface $^{56}$Ni mixing, the latter one is favored.

astro-ph.HE↗