arXiv subjects

Ning Xu

Publications and source records attributed to Ning Xu.

At least 55 records · Page 3Linked to original sources

arXiv2025

Error Bounds Revisited, and How to Use Bayesian Statistics While Remaining a Frequentist

Signal processing makes extensive use of point estimators and accompanying error bounds. These work well up until the likelihood function has two or more high peaks. When it is important for an estimator to remain reliable, it becomes necessary to consider alternatives, such as set estimators. An obvious first choice might be confidence intervals or confidence regions, but there can be difficulties in computing and interpreting them (and sometimes they might still be blind to multiple peaks in the likelihood). Bayesians seize on this to argue for replacing confidence regions with credible regions. Yet Bayesian statistics require a prior, which is not always a natural part of the problem formulation. This paper demonstrates how a re-interpretation of the prior as a weighting function makes an otherwise Bayesian estimator meaningful in the frequentist context. The weighting function interpretation also serves as a reminder that an estimator should always be designed in the context of its intended application; unlike a prior which ostensibly depends on prior knowledge, a weighting function depends on the intended application. This paper uses the time-of-arrival (TOA) problem to illustrate all these points. It also derives a basic theory of region-based estimators distinct from confidence regions.

stat.ME↗

arXiv2025

A double-layer placement algorithm for integrated circuit-based modules on printed circuit board

Considering that the physical design of printed circuit board (PCB) follows the principle of modularized design, this paper proposes an automatic placement algorithm for functional modules. We first model the placement problem as a mixed-variable optimization problem, and then, developed tailored algorithms of global placement and legalization for the top-layer centralized placement subproblem and the bottom-layer pin-oriented placement subproblem. Numerical comparison demonstrates that the proposed mixed-variable optimization scheme can get optimized total wirelength of placement. Meanwhile, experimental results on several industrial PCB cases show that the developed centralized strategies can well accommodate the requirement of top-layer placement, and the pin-oriented global placement based on bin clustering contributes to optimized placement results meeting the requirement of pin-oriented design.

cs.OH↗

arXiv2024

Doping evolution of the normal state magnetic excitations in pressurized La3Ni2O7

The doping evolution behaviors of the normal state magnetic excitations (MEs) of the nickelate La3Ni2O7 are theoretically studied in this paper. For a filling of n = 3.0 which corresponds roughly to the material which realizes the superconductivity of about 80 K under moderately high pressures above 14 GPa, the MEs exhibit a square-like pattern centered at (0,0) which originates from the intrapocket particle-hole scatterings. Furthermore, it was found that the MEs show very strong modulations on the interlayer momentum qz. With the increasing of qz, the patterns of the MEs change dramatically. In the large qz regime, they turn to be ruled by the interpocket excitation modes with significantly larger intensity which may play a vital role in the superconducting pairing. This hidden feature of the MEs was not revealed by previous studies. The established features of the MEs are found to be very robust against doping. They persist in the wide hole- or electron-doping regime around n = 3.0. However, in the heavily electron-doped regime, a Lifshitz transition will occur. Consequently, the behaviors of the MEs change qualitatively across this transition. With the absence of the hole pocket, we predict that a strong tendency toward the spin-density-wave (SDW) order will develop due to the perfect nesting between the electron and the hole pockets at n = 4.0. Thus, we have investigated the normal state behaviors of the MEs and their doping evolutions which may shed light on the mechanism of superconductivity in pressurized La3Ni2O7.

cond-mat.supr-con↗

arXiv2024

Reduction-based Pseudo-label Generation for Instance-dependent Partial Label Learning

Instance-dependent Partial Label Learning (ID-PLL) aims to learn a multi-class predictive model given training instances annotated with candidate labels related to features, among which correct labels are hidden fixed but unknown. The previous works involve leveraging the identification capability of the training model itself to iteratively refine supervision information. However, these methods overlook a critical aspect of ID-PLL: the training model is prone to overfitting on incorrect candidate labels, thereby providing poor supervision information and creating a bottleneck in training. In this paper, we propose to leverage reduction-based pseudo-labels to alleviate the influence of incorrect candidate labels and train our predictive model to overcome this bottleneck. Specifically, reduction-based pseudo-labels are generated by performing weighted aggregation on the outputs of a multi-branch auxiliary model, with each branch trained in a label subspace that excludes certain labels. This approach ensures that each branch explicitly avoids the disturbance of the excluded labels, allowing the pseudo-labels provided for instances troubled by these excluded labels to benefit from the unaffected branches. Theoretically, we demonstrate that reduction-based pseudo-labels exhibit greater consistency with the Bayes optimal classifier compared to pseudo-labels directly generated from the predictive model.

cs.LG↗

arXiv2024

Progressively Label Enhancement for Large Language Model Alignment

Large Language Models (LLM) alignment aims to prevent models from producing content that misaligns with human expectations, which can lead to ethical and legal concerns. In the last few years, Reinforcement Learning from Human Feedback (RLHF) has been the most prominent method for achieving alignment. Due to challenges in stability and scalability with RLHF stages, which arise from the complex interactions between multiple models, researchers are exploring alternative methods to achieve effects comparable to those of RLHF. However, these methods often rely on large high-quality datasets. Despite some methods considering the generation of additional data to expand datasets, they often treat model training and data generation as separate and static processes, overlooking the fact that these processes are highly interdependent, leading to inefficient utilization of the generated data. To deal with this problem, we propose PLE, i.e., Progressively Label Enhancement for LLM Alignment, a framework that dynamically adjusts the model's training process based on the evolving quality of the generated data. Specifically, we prompt the model to generate responses for both the original query and the query guided by a set of carefully designed principles, and then utilize a dynamic threshold to determine the appropriate training approach for both responses based on their corresponding reward scores. Experimental results demonstrate the effectiveness of PLE compared to existing LLM alignment methods.

cs.CL↗

arXiv2024

Dynamical study of $T_{ss}$ systems at a chiral quark model

Since the discovery of $T_{cc}$ by LHCb, there has been considerable interest in $T_{cc}$ and its heavy-flavor partners. However, the study of its strange partner $T_{ss}$ has been largely overlooked. Within the framework of the chiral quark model, we conducted a systematic study of the bound states of $T_{ss}$ utilizing the Gaussian Expansion Method. Considering all physical channels with $01^{+}$, including molecular and diquark structures. Our calculations revealed that upon considering the coupling between diquarks and molecular states, we identified a deep bound state with a bounding energy of 60 MeV, primarily composed of $K K^{*}$. Using the $^3P_0$ model, we calculated the decay width of $K^{*}$ within the $KK^{*}$ bound state, which is approximated as the decay width of the bound state in the $T_{ss}$ system. The results indicate that due to the effect of binding energy, the decay width of $K^{*}$ in $KK^{*}$ is approximately $3$ MeV smaller than that of $K^{*}$ in vacuum. Additionally, resonance state calculations were performed. Utilizing the real-scaling method, we searched for possible resonance states in the $T_{ss}$ sysytem. Due to the strong attraction in the $[K^{*}]_8[K^{*}]_8$ configuration, four resonance states were found in the vicinity of $2.2$-$2.8$ GeV, predominantly featuring hidden-color structures, and their decay widths are all less than $10$ MeV. We strongly recommend experimental efforts to search for the resonance states in the $T_{ss}$ system predicted by our calculations.

hep-ph↗

arXiv2024

LSVOS Challenge Report: Large-scale Complex and Long Video Object Segmentation

Despite the promising performance of current video segmentation models on existing benchmarks, these models still struggle with complex scenes. In this paper, we introduce the 6th Large-scale Video Object Segmentation (LSVOS) challenge in conjunction with ECCV 2024 workshop. This year's challenge includes two tasks: Video Object Segmentation (VOS) and Referring Video Object Segmentation (RVOS). In this year, we replace the classic YouTube-VOS and YouTube-RVOS benchmark with latest datasets MOSE, LVOS, and MeViS to assess VOS under more challenging complex environments. This year's challenge attracted 129 registered teams from more than 20 institutes across over 8 countries. This report include the challenge and dataset introduction, and the methods used by top 7 teams in two tracks. More details can be found in our homepage https://lsvos.github.io/.

cs.CV↗

arXiv2024

Order metrics of jammed solids: Structures, hyperuniformity, and implications for ultra-stable glasses

Due to the lack of long-range order, it remains challenging to characterize the structure of disordered solids and understand the nature of the glass transition. Here we propose a new structural order parameter by taking into account multiple rotational symmetries. By studying its statistics for two-dimensional disordered packings of hard particles along the jamming transition line, we observe the evolution from disordered-particle-rich states to ordered-particle-rich states with the increase of packing fraction, together with the unusual non-monotonic change of the degree of hyperuniformity. At the high packing fraction end of the jamming transition line, the packings are mostly composed of ordered particles and are nearly hyperuniform beyond a finite length. Our work links the local order fluctuations to the thermodynamic stability and density fluctuations of disordered solids. Taking advantage of the order parameter, we propose the structural characteristic of ultra-stable glasses: Although globally disordered evaluated by any single symmetry, they are rich of ordered particles and effectively `globally ordered' with crystal-like density fluctuations.

cond-mat.soft↗

arXiv2024

Ideal noncrystals: A possible new class of ordered matter without apparent broken symmetry

Order and disorder constitute two fundamental and opposite themes in condensed matter physics and materials science. Crystals are considered the epitome of order, characterised by long-range translational order. The discovery of quasicrystals, which exhibit rotational symmetries forbidden in crystals and lack periodicity, led to a paradigm shift in solid-state physics. Moving one step forward, it is intriguing to ask whether ordered matter can exist without apparent symmetry breaking. The same question arises considering how ordered amorphous (noncrystalline) solids can be structured. Here, we present the discovery of ideal noncrystals in two dimensions, which are disordered in the conventional sense, lacking Bragg peaks, but exhibit high orderliness based on the steric order, i.e., they are ideally packed. A path-integral-like scheme reveals the underlying long-range structural correlation. We find that these ideal noncrystals are characterised by phononic vibrational modes following the Debye law, fully affine elastic responses, and suppressed density fluctuations at longer wavelengths, reminiscent of hyperuniformity -- all characteristics typically associated with crystals. Therefore, ideal noncrystals represent a peculiar form of matter with a mixed nature -- noncrystalline yet possessing crystal-like properties. Notably, these states are found to be thermodynamically favourable, indicating them as a possible new class of ordered matter without apparent symmetry breaking. Our findings significantly broaden the conceptualization of ordered states of matter and may contribute to a deeper understanding of entropy-driven ordering, particularly in generic amorphous materials.

cond-mat.soft↗

arXiv2024

ChipExpert: The Open-Source Integrated-Circuit-Design-Specific Large Language Model

The field of integrated circuit (IC) design is highly specialized, presenting significant barriers to entry and research and development challenges. Although large language models (LLMs) have achieved remarkable success in various domains, existing LLMs often fail to meet the specific needs of students, engineers, and researchers. Consequently, the potential of LLMs in the IC design domain remains largely unexplored. To address these issues, we introduce ChipExpert, the first open-source, instructional LLM specifically tailored for the IC design field. ChipExpert is trained on one of the current best open-source base model (Llama-3 8B). The entire training process encompasses several key stages, including data preparation, continue pre-training, instruction-guided supervised fine-tuning, preference alignment, and evaluation. In the data preparation stage, we construct multiple high-quality custom datasets through manual selection and data synthesis techniques. In the subsequent two stages, ChipExpert acquires a vast amount of IC design knowledge and learns how to respond to user queries professionally. ChipExpert also undergoes an alignment phase, using Direct Preference Optimization, to achieve a high standard of ethical performance. Finally, to mitigate the hallucinations of ChipExpert, we have developed a Retrieval-Augmented Generation (RAG) system, based on the IC design knowledge base. We also released the first IC design benchmark ChipICD-Bench, to evaluate the capabilities of LLMs across multiple IC design sub-domains. Through comprehensive experiments conducted on this benchmark, ChipExpert demonstrated a high level of expertise in IC design knowledge Question-and-Answer tasks.

cs.AR↗

arXiv2024

ISPO: An Integrated Ontology of Symptom Phenotypes for Semantic Integration of Traditional Chinese Medical Data

Symptom phenotypes are one of the key types of manifestations for diagnosis and treatment of various disease conditions. However, the diversity of symptom terminologies is one of the major obstacles hindering the analysis and knowledge sharing of various types of symptom-related medical data particularly in the fields of Traditional Chinese Medicine (TCM). Objective: This study aimed to construct an Integrated Ontology of symptom phenotypes (ISPO) to support the data mining of Chinese EMRs and real-world study in TCM field. Methods: To construct an integrated ontology of symptom phenotypes (ISPO), we manually annotated classical TCM textbooks and large-scale Chinese electronic medical records (EMRs) to collect symptom terms with support from a medical text annotation system. Furthermore, to facilitate the semantic interoperability between different terminologies, we incorporated public available biomedical vocabularies by manual mapping between Chinese terms and English terms with cross-references to source vocabularies. In addition, we evaluated the ISPO using independent clinical EMRs to provide a high-usable medical ontology for clinical data analysis. Results: By integrating 78,696 inpatient cases of EMRs, 5 biomedical vocabularies, 21 TCM books and dictionaries, ISPO provides 3,147 concepts, 23,475 terms, and 55,552 definition or contextual texts. Adhering to the taxonomical structure of the related anatomical systems of symptom phenotypes, ISPO provides 12 top-level categories and 79 middle-level sub-categories. The validation of data analysis showed the ISPO has a coverage rate of 95.35%, 98.53% and 92.66% for symptom terms with occurrence rates of 0.5% in additional three independent curated clinical datasets, which can demonstrate the significant value of ISPO in mapping clinical terms to ontologies.

cs.CL↗

arXiv2024

Exploring Real World Map Change Generalization of Prior-Informed HD Map Prediction Models

Building and maintaining High-Definition (HD) maps represents a large barrier to autonomous vehicle deployment. This, along with advances in modern online map detection models, has sparked renewed interest in the online mapping problem. However, effectively predicting online maps at a high enough quality to enable safe, driverless deployments remains a significant challenge. Recent work on these models proposes training robust online mapping systems using low quality map priors with synthetic perturbations in an attempt to simulate out-of-date HD map priors. In this paper, we investigate how models trained on these synthetically perturbed map priors generalize to performance on deployment-scale, real world map changes. We present a large-scale experimental study to determine which synthetic perturbations are most useful in generalizing to real world HD map changes, evaluated using multiple years of real-world autonomous driving data. We show there is still a substantial sim2real gap between synthetic prior perturbations and observed real-world changes, which limits the utility of current prior-informed HD map prediction models.

cs.RO↗

arXiv2024

Can Class-Priors Help Single-Positive Multi-Label Learning?

Single-positive multi-label learning (SPMLL) is a typical weakly supervised multi-label learning problem, where each training example is annotated with only one positive label. Existing SPMLL methods typically assign pseudo-labels to unannotated labels with the assumption that prior probabilities of all classes are identical. However, the class-prior of each category may differ significantly in real-world scenarios, which makes the predictive model not perform as well as expected due to the unrealistic assumption on real-world application. To alleviate this issue, a novel framework named {\proposed}, i.e., Class-pRiors Induced Single-Positive multi-label learning, is proposed. Specifically, a class-priors estimator is introduced, which could estimate the class-priors that are theoretically guaranteed to converge to the ground-truth class-priors. In addition, based on the estimated class-priors, an unbiased risk estimator for classification is derived, and the corresponding risk minimizer could be guaranteed to approximately converge to the optimal risk minimizer on fully supervised data. Experimental results on ten MLL benchmark datasets demonstrate the effectiveness and superiority of our method over existing SPMLL approaches.

cs.LG↗

arXiv2024

Rule-driven News Captioning

News captioning task aims to generate sentences by describing named entities or concrete events for an image with its news article. Existing methods have achieved remarkable results by relying on the large-scale pre-trained models, which primarily focus on the correlations between the input news content and the output predictions. However, the news captioning requires adhering to some fundamental rules of news reporting, such as accurately describing the individuals and actions associated with the event. In this paper, we propose the rule-driven news captioning method, which can generate image descriptions following designated rule signal. Specifically, we first design the news-aware semantic rule for the descriptions. This rule incorporates the primary action depicted in the image (e.g., "performing") and the roles played by named entities involved in the action (e.g., "Agent" and "Place"). Second, we inject this semantic rule into the large-scale pre-trained model, BART, with the prefix-tuning strategy, where multiple encoder layers are embedded with news-aware semantic rule. Finally, we can effectively guide BART to generate news sentences that comply with the designated rule. Extensive experiments on two widely used datasets (i.e., GoodNews and NYTimes800k) demonstrate the effectiveness of our method.

cs.CL↗

arXiv2024

How to Understand Named Entities: Using Common Sense for News Captioning

News captioning aims to describe an image with its news article body as input. It greatly relies on a set of detected named entities, including real-world people, organizations, and places. This paper exploits commonsense knowledge to understand named entities for news captioning. By ``understand'', we mean correlating the news content with common sense in the wild, which helps an agent to 1) distinguish semantically similar named entities and 2) describe named entities using words outside of training corpora. Our approach consists of three modules: (a) Filter Module aims to clarify the common sense concerning a named entity from two aspects: what does it mean? and what is it related to?, which divide the common sense into explanatory knowledge and relevant knowledge, respectively. (b) Distinguish Module aggregates explanatory knowledge from node-degree, dependency, and distinguish three aspects to distinguish semantically similar named entities. (c) Enrich Module attaches relevant knowledge to named entities to enrich the entity description by commonsense information (e.g., identity and social position). Finally, the probability distributions from both modules are integrated to generate the news captions. Extensive experiments on two challenging datasets (i.e., GoodNews and NYTimes) demonstrate the superiority of our method. Ablation studies and visualization further validate its effectiveness in understanding named entities.

cs.CL↗

arXiv2023

Causality is all you need

In the fundamental statistics course, students are taught to remember the well-known saying: "Correlation is not Causation". Till now, statistics (i.e., correlation) have developed various successful frameworks, such as Transformer and Pre-training large-scale models, which have stacked multiple parallel self-attention blocks to imitate a wide range of tasks. However, in the causation community, how to build an integrated causal framework still remains an untouched domain despite its excellent intervention capabilities. In this paper, we propose the Causal Graph Routing (CGR) framework, an integrated causal scheme relying entirely on the intervention mechanisms to reveal the cause-effect forces hidden in data. Specifically, CGR is composed of a stack of causal layers. Each layer includes a set of parallel deconfounding blocks from different causal graphs. We combine these blocks via the concept of the proposed sufficient cause, which allows the model to dynamically select the suitable deconfounding methods in each layer. CGR is implemented as the stacked networks, integrating no confounder, back-door adjustment, front-door adjustment, and probability of sufficient cause. We evaluate this framework on two classical tasks of CV and NLP. Experiments show CGR can surpass the current state-of-the-art methods on both Visual Question Answer and Long Document Classification tasks. In particular, CGR has great potential in building the "causal" pre-training large-scale model that effectively generalizes to diverse tasks. It will improve the machines' comprehension of causal relationships within a broader semantic space.

cs.AI↗

arXiv2023

T2IW: Joint Text to Image & Watermark Generation

Recent developments in text-conditioned image generative models have revolutionized the production of realistic results. Unfortunately, this has also led to an increase in privacy violations and the spread of false information, which requires the need for traceability, privacy protection, and other security measures. However, existing text-to-image paradigms lack the technical capabilities to link traceable messages with image generation. In this study, we introduce a novel task for the joint generation of text to image and watermark (T2IW). This T2IW scheme ensures minimal damage to image quality when generating a compound image by forcing the semantic feature and the watermark signal to be compatible in pixels. Additionally, by utilizing principles from Shannon information theory and non-cooperative game theory, we are able to separate the revealed image and the revealed watermark from the compound image. Furthermore, we strengthen the watermark robustness of our approach by subjecting the compound image to various post-processing attacks, with minimal pixel distortion observed in the revealed watermark. Extensive experiments have demonstrated remarkable achievements in image quality, watermark invisibility, and watermark robustness, supported by our proposed set of evaluation metrics.

cs.CV↗

arXiv2023

A flexible and accurate total variation and cascaded denoisers-based image reconstruction algorithm for hyperspectrally compressed ultrafast photography

Hyperspectrally compressed ultrafast photography (HCUP) based on compressed sensing and the time- and spectrum-to-space mappings can simultaneously realize the temporal and spectral imaging of non-repeatable or difficult-to-repeat transient events passively in a single exposure. It possesses an incredibly high frame rate of tens of trillions of frames per second and a sequence depth of several hundred, and plays a revolutionary role in single-shot ultrafast optical imaging. However, due to the ultra-high data compression ratio induced by the extremely large sequence depth as well as the limited fidelities of traditional reconstruction algorithms over the reconstruction process, HCUP suffers from a poor image reconstruction quality and fails to capture fine structures in complex transient scenes. To overcome these restrictions, we propose a flexible image reconstruction algorithm based on the total variation (TV) and cascaded denoisers (CD) for HCUP, named the TV-CD algorithm. It applies the TV denoising model cascaded with several advanced deep learning-based denoising models in the iterative plug-and-play alternating direction method of multipliers framework, which can preserve the image smoothness while utilizing the deep denoising networks to obtain more priori, and thus solving the common sparsity representation problem in local similarity and motion compensation. Both simulation and experimental results show that the proposed TV-CD algorithm can effectively improve the image reconstruction accuracy and quality of HCUP, and further promote the practical applications of HCUP in capturing high-dimensional complex physical, chemical and biological ultrafast optical scenes.

physics.optics↗