arXiv subjects

Cheng Liu

Publications and source records attributed to Cheng Liu.

At least 91 records · Page 5Linked to original sources

arXiv2025

Sequential Multi-objective Multi-agent Reinforcement Learning Approach for Predictive Maintenance

Existing predictive maintenance (PdM) methods typically focus solely on whether to replace system components without considering the costs incurred by inspection. However, a well-considered approach should be able to minimize Remaining Useful Life (RUL) at engine replacement while maximizing inspection interval. To achieve this, multi-agent reinforcement learning (MARL) can be introduced. However, due to the sequential and mutually constraining nature of these 2 objectives, conventional MARL is not applicable. Therefore, this paper introduces a novel framework and develops a Sequential Multi-objective Multi-agent Proximal Policy Optimization (SMOMA-PPO) algorithm. Furthermore, to provide comprehensive and effective degradation information to RL agents, we also employed Gated Recurrent Unit, quantile regression, and probability distribution fitting to develop a GRU-based RUL Prediction (GRP) model. Experiments demonstrate that the GRP method significantly improves the accuracy of RUL predictions in the later stages of system operation compared to existing methods. When incorporating its output into SMOMA-PPO, we achieve at least a 15% reduction in average RUL without unscheduled replacements (UR), nearly a 10% increase in inspection interval, and an overall decrease in maintenance costs. Importantly, our approach offers a new perspective for addressing multi-objective maintenance planning with sequential constraints, effectively enhancing system reliability and reducing maintenance expenses.

eess.SY↗

arXiv2025

Low-temperature magnetic behaviour on the triangular lattice in hexagonal Ba$_3$Tb(BO$_3$)$_3$

The hexagonal polymorph of Ba$_3$Tb(BO$_3$)$_3$ contains Tb$^{3+}$ ions on a quasi-2D triangular lattice, resulting in geometric magnetic frustration. Powder samples of Ba$_3$Tb(BO$_3$)$_3$ have been investigated using specific heat, powder neutron diffraction (PND), inelastic neutron scattering (INS) and muon-spin relaxation spectroscopy ($μ$SR). No long-range magnetic ordering is observed down to the lowest measured temperatures of 75 mK in PND and specific heat data and 1.5 K in the $μ$SR data. Modelling the INS spectrum using a point charge model suggests that the ground state is a singlet with a low-lying doublet on each of the two crystallographically independent Tb$^{3+}$ sites and that both the Tb ions display weak XY single-ion anisotropy.

cond-mat.str-el↗

arXiv2025

Magnetoelastic coupling in the stretched diamond lattice of TbTaO$_4$

The magnetic structure of diamond-like lattice has been studied extensively in terms of the magnetic frustration. Here we report the distortion of stretched diamond lattice of Tb$^{3+}$ (4$f^8$) in M-TbTaO$_4$ on application of a magnetic field. We have investigated the structural and magnetic properties of M phase terbium tantalate M-TbTaO$_4$ as a function of temperature and magnetic field using magnetometry and powder neutron diffraction. Sharp $λ$-shape transitions in $d(χT)/dT$, $dM/dH$ and specific heat data confirm the previously reported three-dimensional (3D) antiferromagnetic ordering at $T_N \approx 2.25$ K. On application of a magnetic field the Néel temperature is found to decrease and variable field neutron diffraction experiments below $T_N$ at 1.6 K show an increase in both the bond and angle distortion of the stretched diamond lattice with magnetic field, indicating a potential magneto-elastic coupling effect. By combining our magnetometry, heat capacity and neutron diffraction results we generate a magnetic phase diagram for M-TbTaO$_4$ as a function of temperature and field.

cond-mat.str-el↗

arXiv2025

LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Accelerator

The emergence of neural network capabilities invariably leads to a significant surge in computational demands due to expanding model sizes and increased computational complexity. To reduce model size and lower inference costs, recent research has focused on simplifying models and designing hardware accelerators using low-bit quantization. However, due to numerical representation limits, scalar quantization cannot reduce bit width lower than 1-bit, diminishing its benefits. To break through these limitations, we introduce LUT-DLA, a Look-Up Table (LUT) Deep Learning Accelerator Framework that utilizes vector quantization to convert neural network models into LUTs, achieving extreme low-bit quantization. The LUT-DLA framework facilitates efficient and cost-effective hardware accelerator designs and supports the LUTBoost algorithm, which helps to transform various DNN models into LUT-based models via multistage training, drastically cutting both computational and hardware overhead. Additionally, through co-design space exploration, LUT-DLA assesses the impact of various model and hardware parameters to fine-tune hardware configurations for different application scenarios, optimizing performance and efficiency. Our comprehensive experiments show that LUT-DLA achieves improvements in power efficiency and area efficiency with gains of $1.4$~$7.0\times$ and $1.5$~$146.1\times$, respectively, while maintaining only a modest accuracy drop. For CNNs, accuracy decreases by $0.1\%$~$3.1\%$ using the $L_2$ distance similarity, $0.1\%$~$3.4\%$ with the $L_1$ distance similarity, and $0.1\%$~$3.8\%$ when employing the Chebyshev distance similarity. For transformer-based models, the accuracy drop ranges from $1.4\%$ to $3.0\%$.

cs.AR↗

arXiv2025

Rational map associated with the Sigmoid Beverton-Holt model on the projective line over $\mathbb{Q}_p$

We describe the dynamical structure of the $p$-adic rational dynamical systems associated with the Sigmoid Beverton-Holt model on the projective line over the field $\mathbb{Q}_p$ of $p$-adic numbers. Our methods are minimal decomposition of $p$-adic polynomials with coefficients in $\mathbb{Z}_p$ established by Fan and Liao and the chaotic description of $p$-adic repellers of Fan, Liao, Wang and Zhou.

math.DS↗

arXiv2024

Graph Coarsening via Supervised Granular-Ball for Scalable Graph Neural Network Training

Graph Neural Networks (GNNs) have demonstrated significant achievements in processing graph data, yet scalability remains a substantial challenge. To address this, numerous graph coarsening methods have been developed. However, most existing coarsening methods are training-dependent, leading to lower efficiency, and they all require a predefined coarsening rate, lacking an adaptive approach. In this paper, we employ granular-ball computing to effectively compress graph data. We construct a coarsened graph network by iteratively splitting the graph into granular-balls based on a purity threshold and using these granular-balls as super vertices. This granulation process significantly reduces the size of the original graph, thereby greatly enhancing the training efficiency and scalability of GNNs. Additionally, our algorithm can adaptively perform splitting without requiring a predefined coarsening rate. Experimental results demonstrate that our method achieves accuracy comparable to training on the original graph. Noise injection experiments further indicate that our method exhibits robust performance. Moreover, our approach can reduce the graph size by up to 20 times without compromising test accuracy, substantially enhancing the scalability of GNNs.

cs.LG↗

arXiv2024

Minute-cadence Observations of the LAMOST Fields with the TMTS: VI. Absolute Physical Parameters of Contact Binaries

With the development of wide-field surveys, a large amount of data on short-period W UMa contact binaries have been obtained. Continuous and uninterrupted light curves as well as high-resolution spectroscopic data are crucial in determining the absolute physical parameters. Targets with both TMTS light curves and LAMOST medium-resolution spectra were selected. The absolute physical parameters were inferred with the W-D code for ten systems, all of them are W-type shallow or medium contact binaries. The O'Connell effect observed in the light curves can be explained by adding a spot on the primary or secondary component in the models. According to O-C analysis, the orbital periods exhibit a long-term increasing or decreasing trend, amongst which J0132, J1300, and J1402 show periodic variations that may be attributed to the presence of a third body or magnetic activity cycles. Spectral subtraction analysis revealed that the equivalent width of H$α$ indicates strong magnetic activity in J0047, J0305, J0638, and J1402. Among the 10 selected binary systems, except for J0132 and J0913, the more massive components are found to be main-sequence stars while the less massive components have evolved off the main sequence. In J0132, both components are in the main sequence, whereas both components of J0913 lie above the terminal-age main sequence. Based on the relationship between orbital angular momentum and total mass for these two systems, as well as their low fill-out factors, it is possible that these two systems are newly formed contact binaries, having recently evolved from the detached configuration.

astro-ph.SR↗

arXiv2024

Receiver-device-independent quantum secure direct communication

Quantum secure direct communication (QSDC) enables the message sender to directly send secure messages to the receiver through the quantum channel without keys. Device-independent (DI) and measurement-device-independent (MDI) QSDC protocols can enhance QSDC's practical security in theory. DI QSDC requires extremely high global detection efficiency and has quite low secure communication distance. DI and MDI QSDC both require high-quality entanglement. Current entanglement sources prepare entangled photon pairs with low efficiency, largely reducing their practical communication efficiency. In the paper, we propose a single-photon-based receiver-device-independent (RDI) QSDC protocol. It only relies on the trusted single-photon source, which is nearly on-demand under current technology, and treats all the receiving devices in both communication parties as ``black-boxes''. The parties ensure the message security only from the observed statistics. We develop a numerical method to simulate its performance in practical noisy communication situation. RDI QSDC provides the same security level as MDI QSDC. Compared with DI and MDI QSDC, RDI QSDC has some advantages. First, it uses the single-photon source and single-photon measurement, which makes it obtain the practical communication efficiency about 3415 times of that in DI QSDC and easy to implement. The whole protocol is feasible with current technology. Second, it has higher photon loss robustness and noise tolerance than DI QSDC, which enables it to have a secure communication distance about 26 times of that in DI QSDC. Based on above features, the RDI QSDC protocol makes it possible to achieve highly-secure and high-efficient QSDC in the near future.

quant-ph↗

arXiv2024

The LAMOST Spectroscopic Survey of Supergiants in M31 and M33

We present systematic identifications of supergiants of M31/M33 based on massive LAMOST spectroscopic survey. Radial velocities of nearly 5000 photometrically selected M31/M33 supergiant candidates have been properly derived from the qualified spectra released in LAMOST DR10. By comparing their radial velocities with those predicted from the rotation curves of M31, as well as utilizing {\it Gaia} astrometric measurements to exclude foreground contaminations, 199 supergiant members in M31, including 168 `Rank1' and 31 `Rank2', have been successfully identified. This sample contains 62 blue supergiants (BSGs, all `Rank1'), 134 yellow supergiants (YSGs, 103 `Rank1' and 31 `Rank2') and 3 red supergiants (RSGs, all `Rank1'). For M33, we identify 84 supergiant members (56 `Rank1' and 28 `Rank2'), which includes 28 BSGs (all `Rank1'), 53 YSGs (25 `Rank1' and 28 `Rank2') and 3 RSGs (all `Rank1'). So far, this is one of the largest supergiant sample of M31/M33 with full optical wavelength coverage (3700 \textless $λ$ \textless 9100 Å). This sample is valuable for understanding the star formation and stellar evolution under different environments.

astro-ph.GA↗

arXiv2024

Enabling Energy-Efficient Deployment of Large Language Models on Memristor Crossbar: A Synergy of Large and Small

Large language models (LLMs) have garnered substantial attention due to their promising applications in diverse domains. Nevertheless, the increasing size of LLMs comes with a significant surge in the computational requirements for training and deployment. Memristor crossbars have emerged as a promising solution, which demonstrated a small footprint and remarkably high energy efficiency in computer vision (CV) models. Memristors possess higher density compared to conventional memory technologies, making them highly suitable for effectively managing the extreme model size associated with LLMs. However, deploying LLMs on memristor crossbars faces three major challenges. Firstly, the size of LLMs increases rapidly, already surpassing the capabilities of state-of-the-art memristor chips. Secondly, LLMs often incorporate multi-head attention blocks, which involve non-weight stationary multiplications that traditional memristor crossbars cannot support. Third, while memristor crossbars excel at performing linear operations, they are not capable of executing complex nonlinear operations in LLM such as softmax and layer normalization. To address these challenges, we present a novel architecture for the memristor crossbar that enables the deployment of state-of-the-art LLM on a single chip or package, eliminating the energy and time inefficiencies associated with off-chip communication. Our testing on BERT_Large showed negligible accuracy loss. Compared to traditional memristor crossbars, our architecture achieves enhancements of up to 39X in area overhead and 18X in energy consumption. Compared to modern TPU/GPU systems, our architecture demonstrates at least a 68X reduction in the area-delay product and a significant 69% energy consumption reduction.

cs.AI↗

arXiv2024

Human Stone Toolmaking Action Grammar (HSTAG): A Challenging Benchmark for Fine-grained Motor Behavior Recognition

Action recognition has witnessed the development of a growing number of novel algorithms and datasets in the past decade. However, the majority of public benchmarks were constructed around activities of daily living and annotated at a rather coarse-grained level, which lacks diversity in domain-specific datasets, especially for rarely seen domains. In this paper, we introduced Human Stone Toolmaking Action Grammar (HSTAG), a meticulously annotated video dataset showcasing previously undocumented stone toolmaking behaviors, which can be used for investigating the applications of advanced artificial intelligence techniques in understanding a rapid succession of complex interactions between two hand-held objects. HSTAG consists of 18,739 video clips that record 4.5 hours of experts' activities in stone toolmaking. Its unique features include (i) brief action durations and frequent transitions, mirroring the rapid changes inherent in many motor behaviors; (ii) multiple angles of view and switches among multiple tools, increasing intra-class variability; (iii) unbalanced class distributions and high similarity among different action sequences, adding difficulty in capturing distinct patterns for each action. Several mainstream action recognition models are used to conduct experimental analysis, which showcases the challenges and uniqueness of HSTAG https://nyu.databrary.org/volume/1697.

cs.CV↗

arXiv2024

Ordering-Based Causal Discovery for Linear and Nonlinear Relations

Identifying causal relations from purely observational data typically requires additional assumptions on relations and/or noise. Most current methods restrict their analysis to datasets that are assumed to have pure linear or nonlinear relations, which is often not reflective of real-world datasets that contain a combination of both. This paper presents CaPS, an ordering-based causal discovery algorithm that effectively handles linear and nonlinear relations. CaPS introduces a novel identification criterion for topological ordering and incorporates the concept of "parent score" during the post-processing optimization stage. These scores quantify the strength of the average causal effect, helping to accelerate the pruning process and correct inaccurate predictions in the pruning step. Experimental results demonstrate that our proposed solutions outperform state-of-the-art baselines on synthetic data with varying ratios of linear and nonlinear relations. The results obtained from real-world data also support the competitiveness of CaPS. Code and datasets are available at https://github.com/E2real/CaPS.

cs.LG↗

arXiv2024

Remaining Useful Life Prediction: A Study on Multidimensional Industrial Signal Processing and Efficient Transfer Learning Based on Large Language Models

Remaining useful life (RUL) prediction is crucial for maintaining modern industrial systems, where equipment reliability and operational safety are paramount. Traditional methods, based on small-scale deep learning or physical/statistical models, often struggle with complex, multidimensional sensor data and varying operating conditions, limiting their generalization capabilities. To address these challenges, this paper introduces an innovative regression framework utilizing large language models (LLMs) for RUL prediction. By leveraging the modeling power of LLMs pre-trained on corpus data, the proposed model can effectively capture complex temporal dependencies and improve prediction accuracy. Extensive experiments on the Turbofan engine's RUL prediction task show that the proposed model surpasses state-of-the-art (SOTA) methods on the challenging FD002 and FD004 subsets and achieves near-SOTA results on the other subsets. Notably, different from previous research, our framework uses the same sliding window length and all sensor signals for all subsets, demonstrating strong consistency and generalization. Moreover, transfer learning experiments reveal that with minimal target domain data for fine-tuning, the model outperforms SOTA methods trained on full target domain data. This research highlights the significant potential of LLMs in industrial signal processing and RUL prediction, offering a forward-looking solution for health management in future intelligent industrial systems.

cs.LG↗

arXiv2024

Whale Detection Enhancement through Synthetic Satellite Images

With a number of marine populations in rapid decline, collecting and analyzing data about marine populations has become increasingly important to develop effective conservation policies for a wide range of marine animals, including whales. Modern computer vision algorithms allow us to detect whales in images in a wide range of domains, further speeding up and enhancing the monitoring process. However, these algorithms heavily rely on large training datasets, which are challenging and time-consuming to collect particularly in marine or aquatic environments. Recent advances in AI however have made it possible to synthetically create datasets for training machine learning algorithms, thus enabling new solutions that were not possible before. In this work, we present a solution - SeaDroneSim2 benchmark suite, which addresses this challenge by generating aerial, and satellite synthetic image datasets to improve the detection of whales and reduce the effort required for training data collection. We show that we can achieve a 15% performance boost on whale detection compared to using the real data alone for training, by augmenting a 10% real data. We open source both the code of the simulation platform SeaDroneSim2 and the dataset generated through it.

cs.CV↗

arXiv2024

Structure evolution path of ferroelectric hafnium zirconium oxide nanocrystals under in-situ biasing

Fluorite-type $\mathrm{HfO_2}$-based ferroelectric (FE) oxides have rekindled interest in FE memories due to their compatibility with silicon processing and potential for high-density integration. The polarization characteristics of FE devices are governed by the dynamics of metastable domain structure evolution. Insightful design of FE devices for encoding and storage necessitates a comprehensive understanding of the internal structural evolution. Here, we demonstrate the evolution of domain structures through a transient polar orthorhombic (O)-$Pmn2_1$-like configuration via $in$-$situ$ biasing on $\mathrm{TiN/Hf_{0.5}Zr_{0.5}O_2/TiN}$ capacitors within spherical aberration-corrected transmission electron microscope, combined with theoretical calculations. Furthermore, it is directly evidenced that the non-FE O-$Pbca$ transforms into the FE O-$Pca2_1$ phase under electric field, with the polar axis of the FE-phase aligning towards the bias direction through ferroelastic transformation, thereby enhancing FE polarization. As cycling progresses further, however, the polar axis collapses, leading to FE degradation. These novel insights into the intricate structural evolution path under electrical field cycling facilitate optimization and design strategies for $\mathrm{HfO_2}$-based FE memory devices.

cond-mat.mtrl-sci↗

arXiv2024

The Giant Radio Array for Neutrino Detection (GRAND) Collaboration -- Contributions to the 38th International Cosmic Ray Conference (ICRC 2023)

The Giant Radio Array for Neutrino Detection (GRAND) is an envisioned observatory of ultra-high-energy particles of cosmic origin, with energies in excess of 100 PeV. GRAND uses large surface arrays of autonomous radio-detection units to look for the radio emission from extensive air showers that are triggered by the interaction of ultra-high-energy cosmic rays, gamma rays, and neutrinos in the atmosphere or underground. In particular, for ultra-high-energy neutrinos, the future final phase of GRAND aims to be sensitive enough to discover them in spite of their plausibly tiny flux. Presently, three prototype GRAND radio arrays are in operation: GRANDProto300, in China, GRAND@Auger, in Argentina, and GRAND@Nancay, in France. Their goals are to field-test the design of the radio-detection units, understand the radio background to which they are exposed, and develop tools for diagnostic, data gathering, and data analysis. This list of contributions to the 38th International Cosmic Ray Conference (ICRC 2023) presents an overview of GRAND, in its present and future incarnations, and a look at the first data collected by GRANDProto13, the first phase of GRANDProto300.

hep-ex↗

arXiv2024

The Giant Radio Array for Neutrino Detection (GRAND) Collaboration -- Contributions to the 10th International Workshop on Acoustic and Radio EeV Neutrino Detection Activities (ARENA 2024)

This is an index of the contributions by the Giant Radio Array for Neutrino Detection (GRAND) Collaboration to the 10th International Workshop on Acoustic and Radio EeV Neutrino Detection Activities (ARENA 2024, University of Chicago, June 11-14, 2024). The contributions include an overview of GRAND in its present and future incarnations, methods of radio-detection that are being developed for them, and ongoing joint work between the GRAND and BEACON experiments.

astro-ph.IM↗

arXiv2024

IICPilot: An Intelligent Integrated Circuit Backend Design Framework Using Open EDA

Open-source EDA tools are rapidly advancing, fostering collaboration, innovation, and knowledge sharing within the EDA community. However, the growing complexity of these tools, characterized by numerous design parameters and heuristics, poses a significant barrier to their widespread adoption. This complexity is particularly pronounced in integrated circuit (IC) backend designs, which place substantial demands on engineers' expertise in EDA tools. To tackle this challenge, we introduce IICPilot, an intelligent IC backend design system based on LLM technology. IICPilot automates various backend design procedures, including script generation, EDA tool invocation, design space exploration of EDA parameters, container-based computing resource allocation, and exception management. By automating these tasks, IICPilot significantly lowers the barrier to entry for open-source EDA tools. Specifically, IICPilot utilizes LangChain's multi-agent framework to efficiently handle distinct design tasks, enabling flexible enhancements independently. Moreover, IICPilot separates the backend design workflow from specific open-source EDA tools through a unified EDA calling interface. This approach allows seamless integration with different open-source EDA tools like OpenROAD and iEDA, streamlining the backend design and optimization across the EDA tools.

cs.AR↗