arXiv subjects

Ziwei Wu

Publications and source records attributed to Ziwei Wu.

At least 19 recordsLinked to original sources

arXiv2026

Probing Variations in Earth's Ionosphere Using Pulsars

We present high cadence 10-minute rotation measure (RM) monitoring of PSR~J0814+7429 using the LOw-Frequency ARray, aiming to probe ionospheric variability along the pulsar line of sight (LoS). By separating the ionospheric contribution from the observed RM, we quantitatively reconstruct the diurnal variation of the ionospheric electron density along the pulsar LoS based on the World Magnetic Model. The derived variations exhibit clear solar-driven modulation, including the ionospheric noontime bite-out phenomenon, and show good agreement with the LoS total electron content reconstructed from independent global vertical total electron content maps. These results demonstrate the feasibility of using pulsars as probes of temporal variations in the electron density of the Earth's ionosphere.

astro-ph.HE↗

arXiv2026

No Strong Evidence for Plasma Lensing in FRB 20240114A

FRB~20240114A is an extremely active repeating fast radio burst for which plasma lensing has been proposed to explain its burst-rate variations, spectral evolution, and apparently ``carbon-copy'' burst pairs. Using FAST data and publicly available Parkes observations, we test this interpretation with a one-dimensional Gaussian plasma-lens model. Although the burst-rate enhancements can be fitted separately, the corresponding magnification peaks and demagnification troughs are offset by far more than predicted and show no consistent periodicity. Moreover, with more than 10,000 bursts detected, a few apparently ``carbon-copy'' pairs can readily occur by chance. The burst bandwidth is not systematically narrower during the proposed lensing interval, nor are the burst energies significantly enhanced during the predicted magnification interval. These results provide no compelling evidence that a single Gaussian plasma lens explains the observed variability, which is more likely dominated by intrinsic source activity.

astro-ph.HE↗

arXiv2026

Random Polarization Position Angle Behaviors across Bursts of Repeating Fast Radio Bursts

Fast radio bursts (FRBs), highly polarized, mostly have a nearly constant polarization position angle (PA) during each burst. Their PAs are observed to vary from burst to burst, with the statistical properties remaining stable across different observation sessions. We found that the intrinsic PAs of repeating FRBs are approximately Gaussian distributed, suggesting that the emission likely originates from a localized region within the neutron star's magnetosphere. A periodicity search of the PA time series using the Lomb-Scargle periodogram reveals no credible periodic signal in the period range from 10 ms to $10^7$ ms, and similar analyses of several active observations also yield null detections. We interpret these properties by extending the rotating vector model to include a dynamically evolving magnetosphere, in which the effective magnetic axis varies from burst to burst due to stochastic perturbations. In this framework, the observed PA distributions can naturally arise from geometric projection effects, and the absence of periodicity reflects the random wandering of the magnetic axis within a confined region. This scenario provides a natural explanation for both repeating and apparently non-repeating FRBs.

astro-ph.HE↗

arXiv2026

Pulsar scintillation studies with LOFAR III. Annual variations in PSR~J0814$+$7429

The interstellar scintillation observed in radio pulsars arises from interference between electromagnetic waves scattered by electron density fluctuations in the turbulent interstellar plasma, providing a critical tool for probing the small-scale structure of the ionized interstellar medium and the pulsar system itself. The primary aim of this work is to study long-term scintillation variations for a bright and nearby pulsar, PSR J0814$+$7429, carried out from 2013 September to 2023 September with the LOw-Frequency ARray (LOFAR) High Band Antennae in the frequency range of 120 - 170 MHz. We derive the basic scintillation parameters, scintillation bandwidth ($\Delta\nu_{\rm d}$) and scintillation timescale ($\Delta\tau_{\rm d}$), from the two-dimensional (2D) auto-covariance function of the dynamic spectra that are a 2D matrix of pulse intensity as a function of time and frequency. We present the long-term monitoring of $\Delta\nu_{\rm d}$ and $\Delta\tau_{\rm d}$ for PSR J0814$+7429$, which shows a strong annual variation in the time series of the $\Delta\tau_{\rm d}$. From our modeling of the annual variations of scintillation velocities, the scattering screen is anisotropic and located at $0.23\pm0.02$ kpc from the Earth, likely corresponding to the boundary of the Local Bubble.

astro-ph.HE↗

arXiv2025

Improving pulsar search efficiency in next-generation pulsar surveys with artificial intelligence

Pulsar searching with next-generation radio telescopes requires efficiently sifting through millions of candidates generated by search pipelines to identify the most promising ones. This challenge has motivated the utilization of Artificial Intelligence (AI)-based tools. In this work, we explore an optimized pulsar search pipeline that utilizes deep learning to sift ``snapshot'' candidates generated by folding de-dispersed time series data. This approach significantly accelerates the search process by reducing the time spent on the folding step. We also developed a script to generate simulated pulsars for benchmarking and model fine-tuning. The benchmark analysis used the NGC 5904 globular cluster data and simulated pulsar data, showing that our pipeline reduces candidate folding time by a factor of $\sim$10 and achieves 100% recall by recovering all known detectable pulsars in the restricted parameter space. We also tested the speed-up using data of known pulsars from a single observation in the Southern-sky MWA Rapid Two-metre (SMART) survey, achieving a conservatively estimated speed-up factor of 60 in the folding step over a large parameter space. We tested the model's ability to classify pulsar candidates using real data collected from the FAST, GBT, MWA, Arecibo, and Parkes, demonstrating that our method can be generalized to different telescopes. The results show that the optimized pipeline identifies pulsars with an accuracy of 0.983 and a recall of 0.9844 on the real dataset. This approach can be used to improve the processing efficiency for the SMART and is also relevant for future SKA pulsar surveys.

astro-ph.IM↗

arXiv2025

Multi-Faceted Emission Properties of PSR J2129+4119 Observed with FAST

We present a detailed single-pulse study of the long-period pulsar PSR J2129+4119 using high-sensitivity FAST observations. Despite locating well below the traditional death line, the pulsar exhibits sustained and multi-modal emission behavior, including nulls, weak pulses, regular emission, and occasional bright pulses. The nulling fraction is measured to be $8.13\% \pm 0.51\%$, with null durations typically under four pulse periods. Fluctuation spectral analysis reveals both phase-modulated subpulse drifting and intermittent beat-like modulation. At the same time, polarization profiles show high linear polarization and stable polarization position angle (PPA) swings consistent with a near-tangential sightline geometry. Quasi-periodic microstructures are detected in 11.54\% of regular pulses, with a mean periodicity and width of 4.57 ms and 4.30 ms, respectively. A well-defined scintillation arc in the secondary spectrum confirms the presence of a localized scattering screen. These results indicate that PSR J2129+4119 remains magnetospherically active and coherently emitting despite its low energy loss rate, offering key insights into pulsar emission physics near the death line.

astro-ph.HE↗

arXiv2025

The double neutron star PSR J1946+2052 I. Masses and tests of general relativity

We conducted high-precision timing of PSR J1946+2052 to determine the masses of the two neutron stars in the system, test general relativity (GR) and assessed the system's potential for future measurement of the moment of inertia of the pulsar. We analysed seven years of timing data from the Arecibo 305-m radio telescope, the Green Bank Telescope (GBT), and the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The data processing accounted for dispersion measure variations and relativistic spin precession-induced profile evolution. We employed both DDFWHE and DDGR binary models to measure the spin parameters, kinematic parameters and orbital parameters. The timing campaign has resulted in the precise measurement of five post-Keplerian parameters, which yield very precise masses for the system and three tests of general relativity. One of these is the second most precise test of the radiative properties of gravity to date: the intrinsic orbital decay, $\dot{P}_{\rm b,int}=-1.8288(16)\times10^{-12}\rm\,s\,s^{-1}$, represents $1.00005(91)$ of the GR prediction, indicating that the theory has passed this stringent test. The other two tests, of the Shapiro delay parameters, have precisions of 6\% and 5\% respectively; this is caused by the moderate orbital inclination of the system, $\sim 74^{\circ}$; the measurements of the Shapiro delay parameters also agree with the GR predictions. Additionally, we analysed the higher-order contributions of $\dot{\omega}$, including the Lense-Thirring contribution. Both the second post-Newtonian and the Lense-Thirring contributions are larger than the current uncertainty of $\dot{\omega}$ ($\delta\dot{\omega}=4\times10^{-4}\,\rm deg\,yr^{-1}$), leading to the higher-order correction for the total mass.

astro-ph.HE↗

arXiv2025

Polarization Position Angle Swing and the Rotating Vector Model of Repeating Fast Radio Bursts

Fast radio bursts (FRBs), typically highly polarized, usually have a nearly constant polarization position angle (PA) during each burst. Some bursts show significant PA variations, and one of them was claimed to have a PA variation pattern consistent with the prediction of the rotating vector model (RVM) commonly adopted to fit the PA variations in radio pulsars. We systematically study the PA evolution pattern of 1727 bursts from three active repeating FRB sources monitored by the Five-hundred-meter Aperture Spherical Telescope (FAST). We identify 46 bursts whose PA variations are fully consistent with the RVM. However, the inferred geometrical parameters and rotation periods derived from these RVM fitting are inconsistent from each other. This suggests that the magnetosphere of the FRB central engine is constantly distorted by the FRB emitter, and the magnetic configuration is dynamically evolving.

astro-ph.HE↗

arXiv2025

Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative

While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information, remains in its infancy. With recent progress in large language models and time series learning, we revisit the integration of paired texts with time series through the Platonic Representation Hypothesis, which posits that representations of different modalities converge to shared spaces. In this context, we identify that time-series-paired texts may naturally exhibit periodic properties that closely mirror those of the original time series. Building on this insight, we propose a novel framework, Texts as Time Series (TaTS), which considers the time-series-paired texts to be auxiliary variables of the time series. TaTS can be plugged into any existing numerical-only time series models and effectively enable them to handle time series data with paired texts. Through extensive experiments on both multimodal time series forecasting and imputation tasks across benchmark datasets with various existing time series models, we demonstrate that TaTS can enhance multimodal predictive performance without modifying model architectures. Our Code is available at https://github.com/iDEA-iSAIL-Lab-UIUC/TaTS.

cs.LG↗

arXiv2024

Fair Anomaly Detection For Imbalanced Groups

Anomaly detection (AD) has been widely studied for decades in many real-world applications, including fraud detection in finance, and intrusion detection for cybersecurity, etc. Due to the imbalanced nature between protected and unprotected groups and the imbalanced distributions of normal examples and anomalies, the learning objectives of most existing anomaly detection methods tend to solely concentrate on the dominating unprotected group. Thus, it has been recognized by many researchers about the significance of ensuring model fairness in anomaly detection. However, the existing fair anomaly detection methods tend to erroneously label most normal examples from the protected group as anomalies in the imbalanced scenario where the unprotected group is more abundant than the protected group. This phenomenon is caused by the improper design of learning objectives, which statistically focus on learning the frequent patterns (i.e., the unprotected group) while overlooking the under-represented patterns (i.e., the protected group). To address these issues, we propose FairAD, a fairness-aware anomaly detection method targeting the imbalanced scenario. It consists of a fairness-aware contrastive learning module and a rebalancing autoencoder module to ensure fairness and handle the imbalanced data issue, respectively. Moreover, we provide the theoretical analysis that shows our proposed contrastive learning regularization guarantees group fairness. Empirical studies demonstrate the effectiveness and efficiency of FairAD across multiple real-world datasets.

cs.LG↗

arXiv2024

Scintillation velocity and arc observations of FRB 20201124A

We present the scintillation velocity measurements of FRB~20201124A from the FAST observations, which reveal an annual variation. This annual variation is further supported by changes detected in the scintillation arc as observed from the secondary spectrum. We attribute the annual velocity variation to the presence of a moderately anisotropic scattering screen located at a distance of 0.4$\pm$0.1~kpc from Earth. Our results prove that the scintillation of this FRB is mainly caused by material close to Earth on a Galactic scale. However, scintillation observations of other FRBs may expose their surrounding environment or uncover possible orbital motion if scintillation is caused by materials in their host galaxy.

astro-ph.HE↗

arXiv2024

Neural Active Learning Beyond Bandits

We study both stream-based and pool-based active learning with neural network approximations. A recent line of works proposed bandit-based approaches that transformed active learning into a bandit problem, achieving both theoretical and empirical success. However, the performance and computational costs of these methods may be susceptible to the number of classes, denoted as $K$, due to this transformation. Therefore, this paper seeks to answer the question: "How can we mitigate the adverse impacts of $K$ while retaining the advantages of principled exploration and provable performance guarantees in active learning?" To tackle this challenge, we propose two algorithms based on the newly designed exploitation and exploration neural networks for stream-based and pool-based active learning. Subsequently, we provide theoretical performance guarantees for both algorithms in a non-parametric setting, demonstrating a slower error-growth rate concerning $K$ for the proposed approaches. We use extensive experiments to evaluate the proposed algorithms, which consistently outperform state-of-the-art baselines.

cs.LG↗

arXiv2024

Ziya2: Data-centric Learning is All LLMs Need

Various large language models (LLMs) have been proposed in recent years, including closed- and open-source ones, continually setting new records on multiple benchmarks. However, the development of LLMs still faces several issues, such as high cost of training models from scratch, and continual pre-training leading to catastrophic forgetting, etc. Although many such issues are addressed along the line of research on LLMs, an important yet practical limitation is that many studies overly pursue enlarging model sizes without comprehensively analyzing and optimizing the use of pre-training data in their learning process, as well as appropriate organization and leveraging of such data in training LLMs under cost-effective settings. In this work, we propose Ziya2, a model with 13 billion parameters adopting LLaMA2 as the foundation model, and further pre-trained on 700 billion tokens, where we focus on pre-training techniques and use data-centric optimization to enhance the learning process of Ziya2 on different stages. We define three data attributes and firstly establish data-centric scaling laws to illustrate how different data impacts LLMs. Experiments show that Ziya2 significantly outperforms other models in multiple benchmarks especially with promising results compared to representative open-source ones. Ziya2 (Base) is released at https://huggingface.co/IDEA-CCNL/Ziya2-13B-Base and https://modelscope.cn/models/Fengshenbang/Ziya2-13B-Base/summary.

cs.CL↗

arXiv2024

Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support

Recent advancements in text-to-image models have significantly enhanced image generation capabilities, yet a notable gap of open-source models persists in bilingual or Chinese language support. To address this need, we present Taiyi-Diffusion-XL, a new Chinese and English bilingual text-to-image model which is developed by extending the capabilities of CLIP and Stable-Diffusion-XL through a process of bilingual continuous pre-training. This approach includes the efficient expansion of vocabulary by integrating the most frequently used Chinese characters into CLIP's tokenizer and embedding layers, coupled with an absolute position encoding expansion. Additionally, we enrich text prompts by large vision-language model, leading to better images captions and possess higher visual quality. These enhancements are subsequently applied to downstream text-to-image models. Our empirical results indicate that the developed CLIP model excels in bilingual image-text retrieval.Furthermore, the bilingual image generation capabilities of Taiyi-Diffusion-XL surpass previous models. This research leads to the development and open-sourcing of the Taiyi-Diffusion-XL model, representing a notable advancement in the field of image generation, particularly for Chinese language applications. This contribution is a step forward in addressing the need for more diverse language support in multimodal research. The model and demonstration are made publicly available at \href{https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-XL-3.5B/}, fostering further research and collaboration in this domain.

cs.CL↗

arXiv2023

FairIF: Boosting Fairness in Deep Learning via Influence Functions with Validation Set Sensitive Attributes

Most fair machine learning methods either highly rely on the sensitive information of the training samples or require a large modification on the target models, which hinders their practical application. To address this issue, we propose a two-stage training algorithm named FAIRIF. It minimizes the loss over the reweighted data set (second stage) where the sample weights are computed to balance the model performance across different demographic groups (first stage). FAIRIF can be applied on a wide range of models trained by stochastic gradient descent without changing the model, while only requiring group annotations on a small validation set to compute sample weights. Theoretically, we show that, in the classification setting, three notions of disparity among different groups can be mitigated by training with the weights. Experiments on synthetic data sets demonstrate that FAIRIF yields models with better fairness-utility trade-offs against various types of bias; and on real-world data sets, we show the effectiveness and scalability of FAIRIF. Moreover, as evidenced by the experiments with pretrained models, FAIRIF is able to alleviate the unfairness issue of pretrained models without hurting their performance.

cs.LG↗

arXiv2023

iDesigner: A High-Resolution and Complex-Prompt Following Text-to-Image Diffusion Model for Interior Design

With the open-sourcing of text-to-image models (T2I) such as stable diffusion (SD) and stable diffusion XL (SD-XL), there is an influx of models fine-tuned in specific domains based on the open-source SD model, such as in anime, character portraits, etc. However, there are few specialized models in certain domains, such as interior design, which is attributed to the complex textual descriptions and detailed visual elements inherent in design, alongside the necessity for adaptable resolution. Therefore, text-to-image models for interior design are required to have outstanding prompt-following capabilities, as well as iterative collaboration with design professionals to achieve the desired outcome. In this paper, we collect and optimize text-image data in the design field and continue training in both English and Chinese on the basis of the open-source CLIP model. We also proposed a fine-tuning strategy with curriculum learning and reinforcement learning from CLIP feedback to enhance the prompt-following capabilities of our approach so as to improve the quality of image generation. The experimental results on the collected dataset demonstrate the effectiveness of the proposed approach, which achieves impressive results and outperforms strong baselines.

cs.CV↗

arXiv2023

Periodic interstellar scintillation variations of PSRs~J0613$-$0200 and J0636+5128 associated with the Local Bubble shell

Annual variations of interstellar scintillation can be modelled to constrain parameters of the ionized interstellar medium. If a pulsar is in a binary system, then investigating the orbital parameters is possible through analysis of the orbital variation of scintillation. In observations carried out from 2011 January to 2020 August by the European Pulsar Timing Array radio telescopes, PSRs~J0613$-$0200 and J0636+5128 show strong annual variations in their scintillation velocity, while the former additionally exhibits an orbital fluctuation. Bayesian theory and Markov-chain-Monte-Carlo methods are used to interpret these periodic variations. We assume a thin and anisotropic scattering screen model, and discuss the mildly and extremely anisotropic scattering cases. PSR~J0613$-$0200 is best described by mildly anisotropic scattering, while PSR~J0636+5128 exhibits extremely anisotropic scattering. We measure the distance, velocity and degree of anisotropy of the scattering screen for our two pulsars, finding that scattering screen distances from Earth for PSRs~J0613$-$0200 and J0636+5128 are 316$^{+28}_{-20}$\,pc and 262$^{+96}_{-38}$\,pc, respectively. The positions of these scattering screens are coincident with the shell of the Local Bubble towards both pulsars. These associations add to the growing evidence of the Local Bubble shell as a dominant region of scattering along many sightlines.

astro-ph.HE↗

arXiv2023

Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligence

Nowadays, foundation models become one of fundamental infrastructures in artificial intelligence, paving ways to the general intelligence. However, the reality presents two urgent challenges: existing foundation models are dominated by the English-language community; users are often given limited resources and thus cannot always use foundation models. To support the development of the Chinese-language community, we introduce an open-source project, called Fengshenbang, which leads by the research center for Cognitive Computing and Natural Language (CCNL). Our project has comprehensive capabilities, including large pre-trained models, user-friendly APIs, benchmarks, datasets, and others. We wrap all these in three sub-projects: the Fengshenbang Model, the Fengshen Framework, and the Fengshen Benchmark. An open-source roadmap, Fengshenbang, aims to re-evaluate the open-source community of Chinese pre-trained large-scale models, prompting the development of the entire Chinese large-scale model community. We also want to build a user-centered open-source ecosystem to allow individuals to access the desired models to match their computing resources. Furthermore, we invite companies, colleges, and research institutions to collaborate with us to build the large-scale open-source model-based ecosystem. We hope that this project will be the foundation of Chinese cognitive intelligence.

cs.CL↗