arXiv subjects

Zhen Wan

Publications and source records attributed to Zhen Wan.

At least 37 records · Page 2Linked to original sources

arXiv2025

UniPaint: Unified Space-time Video Inpainting via Mixture-of-Experts

In this paper, we present UniPaint, a unified generative space-time video inpainting framework that enables spatial-temporal inpainting and interpolation. Different from existing methods that treat video inpainting and video interpolation as two distinct tasks, we leverage a unified inpainting framework to tackle them and observe that these two tasks can mutually enhance synthesis performance. Specifically, we first introduce a plug-and-play space-time video inpainting adapter, which can be employed in various personalized models. The key insight is to propose a Mixture of Experts (MoE) attention to cover various tasks. Then, we design a spatial-temporal masking strategy during the training stage to mutually enhance each other and improve performance. UniPaint produces high-quality and aesthetically pleasing results, achieving the best quantitative results across various tasks and scale setups. The code and checkpoints are available at $\href{https://github.com/mmmmm-w/UniPaint}{this \ repository}$.

cs.CV↗

arXiv2025

A Glimpse of Satellite Galaxies in the Milky Way with the 2.5-meter Wide Field Survey Telescope (WFST): Bootes III and Draco

We carry out deep imaging of the Milky Way satellite galaxies, Bootes III and Draco, with WFST as one pilot observing program to demonstrate the capability of WFST. Combining catalogs with PS1 DR2 and Gaia DR3, we derive proper motions for candidate member stars in these two satellite galaxies over a 12-year time baseline, yielding uncertainties of ~1.8 mas/yr at 21 mag and ~3.0 mas/yr at 22 mag in the r band. The proper motions derived from bright and faint stars are consistent, indicating no significant variation in proper motion across stellar luminosity as these galaxies undergo tidal interactions with the MW. Meanwhile, we suggest that Bootes III represents the bound remnant of the progenitor galaxy that gave rise to the Styx stream, as evidenced by its elongated density profile and overdensity in both spatial and kinematic space. This is the first paper to use WFST to measure the proper motions of faint stars in Milky Way satellite galaxies. More detailed analyses will be presented in forthcoming papers from the wide field survey (WFS) program.

astro-ph.GA↗

arXiv2025

Real-time Light Curve Classification Framework for the Wide Field Survey Telescope Using Modified Semi-supervised Variational Auto-Encoder

Modern time-domain astronomy will benefit from the vast data collected by survey telescopes. The 2.5 m Wide Field Survey Telescope (WFST), with its powerful capabilities, is promising to make significant contributions in the era of large sky surveys. To harness the full potential of the enormous amount of unlabeled light curve data that the WFST will collect, we have developed a semisupervised light curve classification framework. This framework showcases several unique features. First, it is optimized for classifying events based on the early phase of the light curve (three days after trigger), which can help identify interesting events early and enable efficient follow-up observations. Second, the semisupervised nature of our framework allows it to leverage valuable information from large volumes of unlabeled data, potentially bridging the gap between simulations and real observations and achieving better generalization in practical scenarios. Compared to the commonly used Recurrent Neural Network models, our framework has shown a 5.59% improvement in accuracy for early classification tasks, as well as improvements in precision and recall in almost all subclasses. Moreover, our approach provides a reconstructed light curve, along with a compact latent representation, offering a different perspective that can be used for further downstream tasks beyond classification. The code and model weights used in this work are maintained and publicly available on our GitHub repository.

astro-ph.IM↗

arXiv2025

A pilot survey on globular clusters with the Wide Field Survey Telescope (WFST)

We carry out an imaging survey of six globular clusters (GCs) with a limit magnitude to 22 mag at the 5 sigma level, down to the main sequence stars of the respective cluster, as one of the pilot observing program of the Wide Field Survey Telescope (WFST). This paper present the early results of this survey, where we investigate the tidal characters at the periphery of the clusters NGC 4147, NGC 5024, NGC 5053, NGC 5272, NGC 5904 and NGC 6341. We present the estimated number density of cluster candidates and their spatial distribution. We confirm the presence of tidal arms in NGC 4147 and NGC 5904 and identify several intriguing potential tidal structures in NGC 4147, NGC 5024, NGC 5272, corroborated the elliptical morphology of the periphery of NGC 6341. WFST shows its ability to detect faint main-sequence stars of clusters beyond 15 kpc in helio-centric distance. Our findings underscore the WFST's capability for probing faint structural features in GCs, paving the way for future in-depth studies, especially for the search of the large scale tidal streams associated with the clusters with the future wide field survey.

astro-ph.GA↗

arXiv2025

Minute-cadence observations on Galactic plane with Wide Field Survey Telescope (WFST): Overview, methodology and early results

As the time-domain survey telescope of the highest survey power in the northern hemisphere currently, Wide Field Survey Telescope (WFST) is scheduled to hourly/daily/semi-weekly scan northern sky up to ~23 mag in four optical (ugri) bands. Unlike the observation cadences in the forthcoming regular survey missions, WFST performed "staring" observations toward Galactic plane in a cadence of $\approx$1 minute for a total on-source time of about 13 hours, during the commissioning and pilot observation phases. Such an observation cadence is well applied in producing densely sampling light curves and hunting for stars exhibiting fast stellar variabilities. Here we introduce the primary methodologies in detecting variability, periodicity, and stellar flares among a half million sources from the minute-cadence observations, and present the WFST g-/r-band light curves generated from periodic variable stars and flaring stars. Benefit from high photometric precisions and deep detection limits of WFST, the observations have captured several rare variable stars, such as a variable hot white dwarf (WD) and an ellipsoidal WD binary candidate. By surveying the almost unexplored parameter spaces for variables, WFST will lead to new opportunities in discovering unique variable stars in the northern sky.

astro-ph.SR↗

arXiv2025

Causal Tree Extraction from Medical Case Reports: A Novel Task for Experts-like Text Comprehension

Extracting causal relationships from a medical case report is essential for comprehending the case, particularly its diagnostic process. Since the diagnostic process is regarded as a bottom-up inference, causal relationships in cases naturally form a multi-layered tree structure. The existing tasks, such as medical relation extraction, are insufficient for capturing the causal relationships of an entire case, as they treat all relations equally without considering the hierarchical structure inherent in the diagnostic process. Thus, we propose a novel task, Causal Tree Extraction (CTE), which receives a case report and generates a causal tree with the primary disease as the root, providing an intuitive understanding of a case's diagnostic process. Subsequently, we construct a Japanese case report CTE dataset, J-Casemap, propose a generation-based CTE method that outperforms the baseline by 20.2 points in the human evaluation, and introduce evaluation metrics that reflect clinician preferences. Further experiments also show that J-Casemap enhances the performance of solving other medical tasks, such as question answering.

cs.CL↗

arXiv2025

Neuro-Symbolic Contrastive Learning for Cross-domain Inference

Pre-trained language models (PLMs) have made significant advances in natural language inference (NLI) tasks, however their sensitivity to textual perturbations and dependence on large datasets indicate an over-reliance on shallow heuristics. In contrast, inductive logic programming (ILP) excels at inferring logical relationships across diverse, sparse and limited datasets, but its discrete nature requires the inputs to be precisely specified, which limits their application. This paper proposes a bridge between the two approaches: neuro-symbolic contrastive learning. This allows for smooth and differentiable optimisation that improves logical accuracy across an otherwise discrete, noisy, and sparse topological space of logical functions. We show that abstract logical relationships can be effectively embedded within a neuro-symbolic paradigm, by representing data as logic programs and sets of logic rules. The embedding space captures highly varied textual information with similar semantic logical relations, but can also separate similar textual relations that have dissimilar logical relations. Experimental results demonstrate that our approach significantly improves the inference capabilities of the models in terms of generalisation and reasoning.

cs.LG↗

arXiv2025

A Heliocentric-orbiting Objects Processing System (HOPS) for the Wide Field Survey Telescope: Architecture, Processing Workflow, and Preliminary Results

Wide-field surveys have markedly enhanced the discovery and study of solar system objects (SSOs). The 2.5-meter Wide Field Survey Telescope (WFST) represents the foremost facility dedicated to optical time-domain surveys in the northern hemisphere. To fully exploit WFST's capabilities for SSO detection, we have developed a heliocentric-orbiting objects processing system (HOPS) tailored for identifying these objects. This system integrates HelioLinC3D, an algorithm well suited for the WFST survey cadence, characterized by revisiting the same sky field twice on the majority of nights. In this paper, we outline the architecture and processing flow of our SSO processing system. The application of the system to the WFST pilot survey data collected between March and May 2024 demonstrates exceptional performance in terms of both temporal efficiency and completeness. A total of 658,489 observations encompassing 38,520 known asteroids have been documented, and 241 newly discovered asteroids have been assigned provisional designations. In particular, 27% of these new discoveries were achieved using merely two observations per night on three nights. The preliminary results not only illuminate the effectiveness of integrating HelioLinC3D within the SSO processing system, but also emphasize the considerable potential contributions of WFST to the field of solar system science.

astro-ph.IM↗

arXiv2024

LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs

This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its activities, and technical reports on the LLMs developed by LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/.

cs.CL↗

arXiv2024

Backpropagation-Free Multi-modal On-Device Model Adaptation via Cloud-Device Collaboration

In our increasingly interconnected world, where intelligent devices continually amass copious personalized multi-modal data, a pressing need arises to deliver high-quality, personalized device-aware services. However, this endeavor presents a multifaceted challenge to prevailing artificial intelligence (AI) systems primarily rooted in the cloud. As these systems grapple with shifting data distributions between the cloud and devices, the traditional approach of fine-tuning-based adaptation (FTA) exists the following issues: the costly and time-consuming data annotation required by FTA and the looming risk of model overfitting. To surmount these challenges, we introduce a Universal On-Device Multi-modal Model Adaptation Framework, revolutionizing on-device model adaptation by striking a balance between efficiency and effectiveness. The framework features the Fast Domain Adaptor (FDA) hosted in the cloud, providing tailored parameters for the Lightweight Multi-modal Model on devices. To enhance adaptability across multi-modal tasks, the AnchorFrame Distribution Reasoner (ADR) minimizes communication costs. Our contributions, encapsulated in the Cloud-Device Collaboration Multi-modal Parameter Generation (CDC-MMPG) framework, represent a pioneering solution for on-Device Multi-modal Model Adaptation (DMMA). Extensive experiments validate the efficiency and effectiveness of our method, particularly in video question answering and retrieval tasks, driving forward the integration of intelligent devices into our daily lives.

cs.DC↗

arXiv2024

GRB 240529A: A Tale of Two Shocks

Thanks to the rapidly increasing time-domain facilities, we are entering a golden era of research on gamma-ray bursts (GRBs). In this Letter, we report our observations of GRB 240529A with the Burst Optical Observer and Transient Exploring System, the 1.5-meter telescope at Observatorio Sierra Nevada, the 2.5-meter Wide Field Survey Telescope of China, the Large Binocular Telescope, and the Telescopio Nazionale Galileo. The prompt emission of GRB 240529A shows two comparable energetic episodes separated by a quiescence time of roughly 400 s. Combining all available data on the GRB Coordinates Network, we reveal the simultaneous apparent X-ray plateau and optical re-brightening around $10^3-10^4$ s after the burst. Rather than the energy injection from the magnetar as widely invoked for similar GRBs, the multi-wavelength emissions could be better explained as two shocks launched from the central engine separately. The optical peak time and our numerical modeling suggest that the initial bulk Lorentz factor of the later shock is roughly 50, which indicates that the later jet should be accretion-driven and have a higher mass loading than a typical one. The quiescence time between the two prompt emission episodes may be caused by the transition between different accretion states of a central magnetar or black hole, or the fall-back accretion process. A sample of similar bursts with multiple emission episodes in the prompt phase and sufficient follow-up could help to probe the underlying physics of GRB central engines.

astro-ph.HE↗

arXiv2024

Beyond English-Centric LLMs: What Language Do Multilingual Language Models Think in?

In this study, we investigate whether non-English-centric LLMs, despite their strong performance, `think' in their respective dominant language: more precisely, `think' refers to how the representations of intermediate layers, when un-embedded into the vocabulary space, exhibit higher probabilities for certain dominant languages during generation. We term such languages as internal $\textbf{latent languages}$. We examine the latent language of three typical categories of models for Japanese processing: Llama2, an English-centric model; Swallow, an English-centric model with continued pre-training in Japanese; and LLM-jp, a model pre-trained on balanced English and Japanese corpora. Our empirical findings reveal that, unlike Llama2 which relies exclusively on English as the internal latent language, Japanese-specific Swallow and LLM-jp employ both Japanese and English, exhibiting dual internal latent languages. For any given target language, the model preferentially activates the latent language most closely related to it. In addition, we explore how intermediate layers respond to questions involving cultural conflicts between latent internal and target output languages. We further explore how the language identity shifts across layers while keeping consistent semantic meaning reflected in the intermediate layer representations. This study deepens the understanding of non-English-centric large language models, highlighting the intricate dynamics of language representation within their intermediate layers.

cs.CL↗

arXiv2024

Ly$α$ imaging around the hyperluminous dust-obscured quasar W2246$-$0526 at $z=4.6$

Hot dust-obscured galaxies (Hot DOGs) are a population of hyperluminous, heavily obscured quasars discovered by the \emph{Wide-field Infrared Survey Explorer} (\emph{WISE}) all-sky survey at high redshift. Observations suggested the growth of these galaxies may be driven by mergers. Previous environmental studies have statistically shown Hot DOGs may reside in dense regions. Here we use the Very Large Telescope (VLT) narrowband and broadband imaging to search for Ly$α$ emitters (LAEs) in the 6.8' * 6.8' field of the Hot DOG W2246$-$0526 at $z=4.6$. W2246$-$0526 is the most distant Hot DOG. We find that there is an overdensity of LAEs in W2246$-$0526 field compared with the blank fields. This is the direct evidence that this most distant Hot DOG is in an overdense environment on the Mpc scale, and the result relates to the merger origin of Hot DOGs.

astro-ph.GA↗

arXiv2024

The Host Galaxy Fluxes of Active Galaxy Nuclei Are Generally Overestimated by the Flux Variation Gradient Method

In terms of the variable nature of normal active galaxy nuclei (AGN) and luminous quasars, a so-called flux variation gradient (FVG) method has been widely utilized to estimate the underlying non-variable host galaxy fluxes. The FVG method assumes an invariable AGN color, but this assumption has been questioned by the intrinsic color variation of quasars and local Seyfert galaxies. Here, using an up-to-date thermal fluctuation model to simulate multi-wavelength AGN variability, we theoretically demonstrate that the FVG method generally overestimates the host galaxy flux; that is, it is more significant for brighter AGN/quasars. Furthermore, we observationally confirm that the FVG method indeed overestimates the host galaxy flux by comparing it to that estimated through other independent methods. We thus caution that applying the FVG method should be performed carefully in the era of time-domain astronomy.

astro-ph.GA↗

arXiv2024

Evaluating Saliency Explanations in NLP by Crowdsourcing

Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to explain models has become a key issue in the reliability of deep learning models in many important applications. Various saliency explanation methods, which give each feature of input a score proportional to the contribution of output, have been proposed to determine the part of the input which a model values most. Despite a considerable body of work on the evaluation of saliency methods, whether the results of various evaluation metrics agree with human cognition remains an open question. In this study, we propose a new human-based method to evaluate saliency methods in NLP by crowdsourcing. We recruited 800 crowd workers and empirically evaluated seven saliency methods on two datasets with the proposed method. We analyzed the performance of saliency methods, compared our results with existing automated evaluation methods, and identified notable differences between NLP and computer vision (CV) fields when using saliency methods. The instance-level data of our crowdsourced experiments and the code to reproduce the explanations are available at https://github.com/xtlu/lreccoling_evaluation.

cs.HC↗

arXiv2024

The Pristine Inner Galaxy Survey (PIGS) VIII: Characterising the orbital properties of the ancient, very metal-poor inner Milky Way

The oldest stars in the Milky Way (born in the first few billion years) are expected to have a high density in the inner few kpc, spatially overlapping with the Galactic bulge. We use spectroscopic data from the Pristine Inner Galaxy Survey (PIGS) to study the dynamical properties of ancient, metal-poor inner Galaxy stars. We compute distances using StarHorse, and orbital properties in a barred Galactic potential. With this paper, we release the spectroscopic AAT/PIGS catalogue (13 235 stars). We find that most PIGS stars have orbits typical for a pressure-supported population. The fraction of stars confined to the inner Galaxy decreases with decreasing metallicity, but many very metal-poor stars (VMP, [Fe/H] < -2.0) stay confined (~ 60% stay within 5 kpc). The azimuthal velocity v$_ϕ$ also decreases between [Fe/H] = -1.0 and -2.0, but is constant for VMP stars (at ~ 40 km/s). The carbon-enhanced metal-poor (CEMP) stars in PIGS appear to have similar orbital properties compared to normal VMP stars. Our results suggest a possible transition between two spheroidal components - a more metal-rich, more concentrated, faster rotating component, and a more metal-poor, more extended and slower/non-rotating component. We propose that the former may be connected to pre-disc in-situ stars (or those born in large building blocks), whereas the latter may be dominated by contributions from smaller galaxies. This is an exciting era where large metal-poor samples, such as in this work (as well as upcoming surveys, e.g., 4MOST), shed light on the earliest evolution of our Galaxy.

astro-ph.GA↗

arXiv2024

AT2023lli: A Tidal Disruption Event with Prominent Optical Early Bump and Delayed Episodic X-ray Emission

High-cadence, multiwavelength observations have continuously revealed the diversity of tidal disruption events (TDEs), thus greatly advancing our knowledge and understanding of TDEs. In this work, we conducted an intensive optical-UV and X-ray follow-up campaign of TDE AT2023lli, and found a remarkable month-long bump in its UV/optical light curve nearly two months prior to maximum brightness. The bump represents the longest separation time from the main peak among known TDEs to date. The main UV/optical outburst declines as $t^{-4.10}$, making it one of the fastest decaying optically selected TDEs. Furthermore, we detected sporadic X-ray emission 30 days after the UV/optical peak, accompanied by a reduction in the period of inactivity. It is proposed that the UV/optical bump could be caused by the self-intersection of the stream debris, whereas the primary peak is generated by the reprocessed emission of the accretion process. In addition, our results suggest that episodic X-ray radiation during the initial phase of decline may be due to the patched obscurer surrounding the accretion disk, a phenomenon associated with the inhomogeneous reprocessing process. The double TDE scenario, in which two stars are disrupted in sequence, is also a possible explanation for producing the observed early bump and main peak. We anticipate that the multicolor light curves of TDEs, especially in the very early stages, and the underlying physics can be better understood in the near future with the assistance of dedicated surveys such as the deep high-cadence survey of the 2.5-meter Wide Field Survey Telescope (WFST).

astro-ph.HE↗

arXiv2024

Rapidly Developing High-quality Instruction Data and Evaluation Benchmark for Large Language Models with Minimal Human Effort: A Case Study on Japanese

The creation of instruction data and evaluation benchmarks for serving Large language models often involves enormous human annotation. This issue becomes particularly pronounced when rapidly developing such resources for a non-English language like Japanese. Instead of following the popular practice of directly translating existing English resources into Japanese (e.g., Japanese-Alpaca), we propose an efficient self-instruct method based on GPT-4. We first translate a small amount of English instructions into Japanese and post-edit them to obtain native-level quality. GPT-4 then utilizes them as demonstrations to automatically generate Japanese instruction data. We also construct an evaluation benchmark containing 80 questions across 8 categories, using GPT-4 to automatically assess the response quality of LLMs without human references. The empirical results suggest that the models fine-tuned on our GPT-4 self-instruct data significantly outperformed the Japanese-Alpaca across all three base pre-trained models. Our GPT-4 self-instruct data allowed the LLaMA 13B model to defeat GPT-3.5 (Davinci-003) with a 54.37\% win-rate. The human evaluation exhibits the consistency between GPT-4's assessments and human preference. Our high-quality instruction data and evaluation benchmark have been released here.

cs.CL↗