arXiv subjects

Siyuan Chen

Publications and source records attributed to Siyuan Chen.

At least 73 records · Page 4Linked to original sources

arXiv2025

Domain Adaptation for Big Data in Agricultural Image Analysis: A Comprehensive Review

With the wide application of computer vision in agriculture, image analysis has become the key to tasks such as crop health monitoring and pest detection. However, the significant domain shifts caused by environmental changes, different crop types, and diverse data acquisition methods seriously hinder the generalization ability of the model in cross-region, cross-season, and complex agricultural scenarios. This paper explores how domain adaptation (DA) techniques can address these challenges to improve cross-domain transferability in agricultural image analysis. DA is considered a promising solution in the case of limited labeled data, insufficient model adaptability, and dynamic changes in the field environment. This paper systematically reviews the latest advances in DA in agricultural images in recent years, focusing on application scenarios such as crop health monitoring, pest and disease detection, and fruit identification, in which DA methods have significantly improved cross-domain performance. We categorize DA methods into shallow learning and deep learning methods, including supervised, semi-supervised and unsupervised strategies, and pay special attention to the adversarial learning-based techniques that perform well in complex scenarios. In addition, this paper also reviews the main public datasets of agricultural images, and evaluates their advantages and limitations in DA research. Overall, this study provides a complete framework and some key insights that can be used as a reference for the research and development of domain adaptation methods in future agricultural vision tasks.

cs.CV↗

arXiv2025

Advances in Quantum Defect Embedding Theory

Quantum defect embedding theory (QDET) is a many-body embedding method designed to describe condensed systems with correlated electrons localized within a given region of space, for example spin defects in semiconductors and insulators. Although the QDET approach has been successful in predicting the electronic properties of several point defects, several limitations of the method remain. In this work, we propose multiple advances to the QDET formalism. We derive a double-counting correction that consistently treats the frequency dependence of the screened Coulomb interaction, and we illustrate the effect of including unoccupied orbitals in the active space. In addition, we propose a method to describe hybridization effects between the active space and the environment, and we compare the results of several impurity solvers, providing further insights into improving the reliability and applicability of the method. We present results for defects in diamond and for molecular qubits, including a detailed comparison with experiments.

cond-mat.mtrl-sci↗

arXiv2025

Orthogonal Finetuning for Direct Preference Optimization

DPO is an effective preference optimization algorithm. However, the DPO-tuned models tend to overfit on the dispreferred samples, manifested as overly long generations lacking diversity. While recent regularization approaches have endeavored to alleviate this issue by modifying the objective function, they achieved that at the cost of alignment performance degradation. In this paper, we innovatively incorporate regularization from the perspective of weight updating to curb alignment overfitting. Through the pilot experiment, we discovered that there exists a positive correlation between overfitting and the hyperspherical energy fluctuation. Hence, we introduce orthogonal finetuning for DPO via a weight-Rotated Preference Optimization (RoPO) method, which merely conducts rotational and magnitude-stretching updates on the weight parameters to maintain the hyperspherical energy invariant, thereby preserving the knowledge encoded in the angle between neurons. Extensive experiments demonstrate that our model aligns perfectly with human preferences while retaining the original expressive capacity using only 0.0086% of the trainable parameters, suggesting an effective regularization against overfitting. Specifically, RoPO outperforms DPO by up to 10 points on MT-Bench and by up to 2.8 points on AlpacaEval 2, while enhancing the generation diversity by an average of 6 points.

cs.CL↗

arXiv2025

Weights-Rotated Preference Optimization for Large Language Models

Despite the efficacy of Direct Preference Optimization (DPO) in aligning Large Language Models (LLMs), reward hacking remains a pivotal challenge. This issue emerges when LLMs excessively reduce the probability of rejected completions to achieve high rewards, without genuinely meeting their intended goals. As a result, this leads to overly lengthy generation lacking diversity, as well as catastrophic forgetting of knowledge. We investigate the underlying reason behind this issue, which is representation redundancy caused by neuron collapse in the parameter space. Hence, we propose a novel Weights-Rotated Preference Optimization (RoPO) algorithm, which implicitly constrains the output layer logits with the KL divergence inherited from DPO and explicitly constrains the intermediate hidden states by fine-tuning on a multi-granularity orthogonal matrix. This design prevents the policy model from deviating too far from the reference model, thereby retaining the knowledge and expressive capabilities acquired during pre-training and SFT stages. Our RoPO achieves up to a 3.27-point improvement on AlpacaEval 2, and surpasses the best baseline by 6.2 to 7.5 points on MT-Bench with merely 0.015% of the trainable parameters, demonstrating its effectiveness in alleviating the reward hacking problem of DPO.

cs.CL↗

arXiv2025

Towards AI-based Sustainable and XR-based human-centric manufacturing: Implementation of ISO 23247 for digital twins of production systems

Since the introduction of Industry 4.0, digital twin technology has significantly evolved, laying the groundwork for a transition toward Industry 5.0 principles centered on human-centricity, sustainability, and resilience. Through digital twins, real-time connected production systems are anticipated to be more efficient, resilient, and sustainable, facilitating communication and connectivity between digital and physical systems. However, environmental performance and integration with virtual reality (VR) and artificial intelligence (AI) of such systems remain challenging. Further exploration of digital twin technologies is needed to validate the real-world impact and benefits. This paper investigates these challenges by implementing a real-time digital twin based on the ISO 23247 standard, connecting the physical factory and simulation software with VR capabilities. This digital twin system provides cognitive assistance and a user-friendly interface for operators, thereby improving cognitive ergonomics. The connection of the Internet of Things (IoT) platform allows the digital twin to have real-time bidirectional communication, collaboration, monitoring, and assistance. A lab-scale drone factory was used as the digital twin application to test and evaluate the ISO 23247 standard and its potential benefits. Additionally, AI integration and environmental performance Key Performance Indicators (KPIs) have been considered as the next stages in improving VR-integrated digital twins. With a solid theoretical foundation and a demonstration of the VR-integrated digital twins, this paper addresses integration issues between various technologies and advances the framework of digital twins based on ISO 23247.

cs.HC↗

arXiv2025

H I absorption line and anomalous dispersion in the radio pulses of PSR B1937+21

We use the Five-hundred-meter Aperture Spherical radio Telescope to observe the bright millisecond pulsar PSR B1937+21 (J1939+2134) and record the data in the band from 1.0 to 1.5 GHz. We measure the neutral hydrogen (HI) emission and absorption lines near 1420 MHz ($λ\simeq 21$ cm). We derive the kinematic distance of the pulsar with the HI observation. By comparing this with the archival absorption spectra observed decades ago, we notice possible variations in the absorption spectra toward this pulsar, which correspond to a possible tiny-scale atomic structure of a few astronomical units in size. We also verify the apparent faster-than-light anomalous dispersion at the HI absorption line of this pulsar previously reported.

astro-ph.HE↗

arXiv2025

Detecting Intermediate-mass Black Holes Using Miniature Pulsar Timing Arrays in Globular Clusters

Theoretical models predict that intermediate-mass black holes (IMBHs) exist in globular clusters (GCs), but observational evidence remains elusive. Millisecond pulsars (MSPs), which are abundant in GCs and have served as precise probes for gravitational waves (GWs), offer a unique opportunity to detect potential IMBH binaries in GCs. Here, we consider the possibility of using multiple MSPs in a GC to form a miniature pulsar timing array (PTA), so as to take advantage of their correlated timing residuals to search for potential IMBH binaries in the same cluster. Our semi-analytical calculations reveal that nearby IMBH binaries around MSPs in GCs could induce microsecond-level timing residuals. In GCs like $ω$ Centauri and M15, favorable configurations are found which could lead to the detection of binaries with mass ratios $q\gtrsim0.1$ and orbital periods of a few days. We estimate that future higher-precision timing programs could achieve $100$-nanosecond sensitivity, substantially expanding the searchable parameter space and establishing mini-PTAs as powerful detectors of IMBHs.

astro-ph.HE↗

arXiv2025

Simulation studies of a high-repetition-rate electron-driven surface muon beamline at SHINE

A high-repetition-rate pulsed muon source operating at approximately 50\,kHz holds the potential to improve the sensitivity of various particle physics and material science experiments involving muons. In this article, we propose utilizing the high-repetition-rate pulsed electron beam at the SHINE facility to generate a surface muon beam. Our simulation studies indicate that an 8\,GeV, 100\,pC charge pulsed electron beam impinging on a copper target can produce up to $2 \times 10^{3}$ muons per pulse. Beamline optimization results demonstrate that approximately 60 surface muons per electron bunch can be efficiently transported to the end of the beamline. This translates to a surface muon rate of $3 \times 10^{6}\,μ^{+}$/s when the pulsed electron beam is operated at 50\,kHz, which is comparable to existing muon facilities. This high-repetition-rate pulsed muon beam, with its ideal time structure, represents a unique and pioneering effort once constructed. It serves as a model for building cost-effective muon sources at existing electron machines with GeV electron energies. In addition to the typical challenges encountered in conventional muon beamlines, such as the installation and construction of the target station and beamline, the removal of substantial quantities of positrons is also a major challenge. A potential solution to this issue is also discussed.

physics.acc-ph↗

arXiv2025

The Chinese Pulsar Timing Array data release I. Single pulsar noise analysis

The Chinese Pulsar Timing Array (CPTA) has collected observations from 57 millisecond pulsars using the Five-hundred-meter Aperture Spherical Radio Telescope (FAST) for close to three years, for the purpose of searching for gravitational waves (GWs). To robustly search for ultra-low-frequency GWs, pulsar timing arrays (PTAs) need to use models to describe the noise from the individual pulsars. We report on the results from the single pulsar noise analysis of the CPTA data release I (DR1). Conventionally, power laws in the frequency domain are used to describe pulsar red noise and dispersion measurement (DM) variations over time. Employing Bayesian methods, we found the choice of number and range of frequency bins with the highest evidence for each pulsar individually. A comparison between a dataset using DM piecewise measured (DMX) values and a power-law Gaussian process to describe the DM variations shows strong Bayesian evidence in favour of the power-law model. Furthermore, we demonstrate that the constraints obtained from four independent software packages are very consistent with each other. The short time span of the CPTA DR1, paired with the large sensitivity of FAST, has proved to be a challenge for the conventional noise model using a power law. This mainly shows in the difficulty to separate different noise terms due to their covariances with each other. Nineteen pulsars are found to display covariances between the short-term white noise and long-term red and DM noise. With future CPTA datasets, we expect that the degeneracy can be broken. Finally, we compared the CPTA DR1 results against the noise properties found by other PTA collaborations. While we can see broad agreement, there is some tension between different PTA datasets for some of the overlapping pulsars. This could be due to the differences in the methods and frequency range compared to the other PTAs.

astro-ph.HE↗

arXiv2025

An Inclusive Foundation Model for Generalizable Cytogenetics in Precision Oncology

Chromosome analysis is vital for diagnosing genetic disorders and guiding cancer therapy decisions through the identification of somatic clonal aberrations. However, developing an AI model are hindered by the overwhelming complexity and diversity of chromosomal abnormalities, requiring extensive annotation efforts, while automated methods remain task-specific and lack generalizability due to the scarcity of comprehensive datasets spanning diverse resource conditions. Here, we introduce CHROMA, a foundation model for cytogenomics, designed to overcome these challenges by learning generalizable representations of chromosomal abnormalities. Pre-trained on over 84,000 specimens (~4 million chromosomal images) via self-supervised learning, CHROMA outperforms other methods across all types of abnormalities, even when trained on fewer labelled data and more imbalanced datasets. By facilitating comprehensive mapping of instability and clonal leisons across various aberration types, CHROMA offers a scalable and generalizable solution for reliable and automated clinical analysis, reducing the annotation workload for experts and advancing precision oncology through the early detection of rare genomic abnormalities, enabling broad clinical AI applications and making advanced genomic analysis more accessible.

q-bio.QM↗

arXiv2025

Self-evolving Agents with reflective and memory-augmented abilities

Large language models (LLMs) have made significant advances in the field of natural language processing, but they still face challenges such as continuous decision-making. In this research, we propose a novel framework by integrating iterative feedback, reflective mechanisms, and a memory optimization mechanism based on the Ebbinghaus forgetting curve, it significantly enhances the agents' capabilities in handling multi-tasking and long-span information.

cs.CL↗

arXiv2025

The Chinese pulsar timing array data release I. Polarimetry for 56 millisecond pulsars

We present polarization pulse profiles for 56 millisecond pulsars (MSPs) monitored by the Chinese Pulsar Timing Array (CPTA) collaboration using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The observations centered at 1.25 GHz with a raw bandwidth of 500 MHz. Due to the high sensitivity ($\sim$16 K/Jy) of the FAST telescope and our long integration time, the high signal-to-noise ratio polarization profiles show features hardly detected before. Among 56 pulsars, the polarization profiles of PSRs J0406$+$3039, J1327$+$3423, and J2022$+$2534 were not previously reported. 80\% of MSPs in the sample show weak components below 3\% of peak flux, 25\% of pulsars show interpulse-like structures, and most pulsars show linear polarization position angle jumps. Six pulsars seem to be emitting for full rotation phase, with another thirteen pulsars being good candidates for such a 360$^\circ$ radiator. We find that the distribution of the polarization percentage in our sample is compatible with the normal pulsar distribution. Our detailed evaluation of the MSP polarization properties suggests that the wave propagation effects in the pulsar magnetosphere are important in shaping the MSP polarization pulse profiles.

astro-ph.HE↗

arXiv2025

HOPE: A Reinforcement Learning-based Hybrid Policy Path Planner for Diverse Parking Scenarios

Automated parking stands as a highly anticipated application of autonomous driving technology. However, existing path planning methodologies fall short of addressing this need due to their incapability to handle the diverse and complex parking scenarios in reality. While non-learning methods provide reliable planning results, they are vulnerable to intricate occasions, whereas learning-based ones are good at exploration but unstable in converging to feasible solutions. To leverage the strengths of both approaches, we introduce Hybrid pOlicy Path plannEr (HOPE). This novel solution integrates a reinforcement learning agent with Reeds-Shepp curves, enabling effective planning across diverse scenarios. HOPE guides the exploration of the reinforcement learning agent by applying an action mask mechanism and employs a transformer to integrate the perceived environmental information with the mask. To facilitate the training and evaluation of the proposed planner, we propose a criterion for categorizing the difficulty level of parking scenarios based on space and obstacle distribution. Experimental results demonstrate that our approach outperforms typical rule-based algorithms and traditional reinforcement learning methods, showing higher planning success rates and generalization across various scenarios. We also conduct real-world experiments to verify the practicability of HOPE. The code for our solution is openly available on https://github.com/jiamiya/HOPE.

cs.RO↗

arXiv2025

Quasars can Signpost Supermassive Black Hole Binaries

Supermassive black holes (SMBHs) are found in the centers of massive galaxies, and galaxy mergers should eventually lead to SMBH mergers. Quasar activity has long been associated with galaxy mergers, so here we investigate if supermassive black hole binaries (SMBHBs) are preferentially found in quasars. Our multimessenger investigation folds together a gravitational wave background signal from NANOGrav, a sample of periodic AGN candidates from the Catalina Real-Time Transient Survey, and a quasar mass function, to estimate an upper limit on the fraction of quasars which could host a SMBHB. We find at 95\% confidence that quasars are at most five times as likely to host a SMBHB as a random galaxy. Pulsar timing arrays may therefore be more likely to find SMBHBs by prioritizing quasars over a random selection of galaxies in their searches.

astro-ph.HE↗

arXiv2025

SLOs-Serve: Optimized Serving of Multi-SLO LLMs

This paper introduces SLOs-Serve, a system designed for serving multi-stage large language model (LLM) requests with application- and stage-specific service level objectives (SLOs). The key idea behind SLOs-Serve is to customize the allocation of tokens to meet these SLO requirements. SLOs-Serve uses a multi-SLO dynamic programming-based algorithm to continuously optimize token allocations under SLO constraints by exploring the full design space of chunked prefill and (optional) speculative decoding. Leveraging this resource planning algorithm, SLOs-Serve effectively supports multi-SLOs and multi-replica serving with dynamic request routing while being resilient to bursty arrivals. Our evaluation across 6 LLM application scenarios (including summarization, coding, chatbot, tool calling, and reasoning) demonstrates that SLOs-Serve improves per-GPU serving capacity by 2.2x on average compared to prior state-of-the-art systems.

cs.DC↗

arXiv2025

Learnable Group Transform: Enhancing Genotype-to-Phenotype Prediction for Rice Breeding with Small, Structured Datasets

Genotype-to-Phenotype (G2P) prediction plays a pivotal role in crop breeding, enabling the identification of superior genotypes based on genomic data. Rice (Oryza sativa), one of the most important staple crops, faces challenges in improving yield and resilience due to the complex genetic architecture of agronomic traits and the limited sample size in breeding datasets. Current G2P prediction methods, such as GWAS and linear models, often fail to capture complex non-linear relationships between genotypes and phenotypes, leading to suboptimal prediction accuracy. Additionally, population stratification and overfitting are significant obstacles when models are applied to small datasets with diverse genetic backgrounds. This study introduces the Learnable Group Transform (LGT) method, which aims to overcome these challenges by combining the advantages of traditional linear models with advanced machine learning techniques. LGT utilizes a group-based transformation of genotype data to capture spatial relationships and genetic structures across diverse rice populations, offering flexibility to generalize even with limited data. Through extensive experiments on the Rice529 dataset, a panel of 529 rice accessions, LGT demonstrated substantial improvements in prediction accuracy for multiple agronomic traits, including yield and plant height, compared to state-of-the-art baselines such as linear models and recent deep learning approaches. Notably, LGT achieved an R^2 improvement of up to 15\% for yield prediction, significantly reducing error and demonstrating its ability to extract meaningful signals from high-dimensional, noisy genomic data. These results highlight the potential of LGT as a powerful tool for genomic prediction in rice breeding, offering a promising solution for accelerating the identification of high-yielding and resilient rice varieties.

q-bio.GN↗

arXiv2025

Design of a CsI(Tl) Calorimeter for Muonium-to-Antimuonium Conversion Experiment

The Muonium-to-Antimuonium Conversion Experiment (MACE) is proposed to search for charged lepton flavor violation and increase the sensitivity by more than two orders of magnitude compared to the MACS experiment at PSI in 1999. A clear signature of this conversion is the positron produced from antimuonium decay. This paper presents a near-$4π$-coverage calorimeter designed for MACE, which can provide an energy resolution of 10.8% at 511 keV, and a signal efficiency of 78.3% for annihilation $γ$-ray events. Detailed Monte-Carlo simulations using MACE offline software based on Geant4 are performed for geometry optimization, coincidence system design, background estimation, and benchmark detector validation.

physics.ins-det↗

arXiv2025

Genotype-to-Phenotype Prediction in Rice with High-Dimensional Nonlinear Features

Genotype-to-Phenotype prediction can promote advances in modern genomic research and crop improvement, guiding precision breeding and genomic selection. However, high-dimensional nonlinear features often hinder the accuracy of genotype-to-phenotype prediction by increasing computational complexity. The challenge also limits the predictive accuracy of traditional approaches. Therefore, effective solutions are needed to improve the accuracy of genotype-to-phenotype prediction. In our paper, we propose MLFformer. MLFformer is a Transformer-based architecture that incorporates the Fast Attention mechanism and a multilayer perceptron module to handle high-dimensional nonlinear features. In MLFformer, the Fast Attention mechanism is utilized to handle computational complexity and enhance processing efficiency. In addition, the MLP structure further captures high-dimensional nonlinear features. Through experiments, the results show that MLFformer reduces the average MAPE by 7.73% compared to the vanilla Transformer. In univariate and multivariate prediction scenarios, MLFformer achieves the best predictive performance among all compared models.

q-bio.GN↗