arXiv subjects

Dan Li

Publications and source records attributed to Dan Li.

At least 109 records · Page 6Linked to original sources

arXiv2024

Deep learning solutions to telescope pointing and guiding

The WIYN 3.5m Telescope at Kitt Peak National Observatory hosts a suite of optical and near infrared instruments, including an extreme precision, optical spectrograph, NEID, built for exoplanet radial velocity studies. In order to achieve sub ms precision, NEID has strict requirements on survey efficiency, stellar image positioning, and guiding performance, which have exceeded the native capabilities of the telescope's original pointing and tracking system. In order to improve the operational efficiency of the telescope we have developed a novel telescope pointing system, built on a recurrent neural network, that does not rely on the usual pointing models (TPoint or other quasi physical bases). We discuss the development of this system, how the intrinsic properties of the pointing problem inform our network design, and show preliminary results from our best models. We also discuss plans for the generalization of this framework, so that it can be applied at other sites.

astro-ph.IM↗

arXiv2024

Asymptotic limits of the attached eddy model derived from an adiabatic atmosphere

The attached-eddy model (AEM) predicts mean velocity and streamwise velocity variance profiles that follow a logarithmic shape in the overlap region of high Reynolds number wall-bounded turbulent flows. Moreover, the AEM coefficients are presumed to attain asymptotically constant values at very high Reynolds numbers. Here, the logarithmic behaviour of the AEM predictions in the near-neutral atmospheric surface layer is examined using sonic anemometer measurements from a 62-m meteorological tower located in the Eastern Snake River Plain, Idaho, US. Utilizing an extensive 210-day dataset, the inertial sublayer (ISL) is first identified by analyzing the measured momentum flux and mean velocity profile. The logarithmic behaviour of the streamwise velocity variance and the associated `-1' scaling of the streamwise velocity energy spectra are then investigated. The findings indicate that the Townsend-Perry coefficient ($A_1$) is influenced by mild non-stationarity that manifests itself as a Reynolds number dependence. After excluding non-stationary runs and requiring a Reynolds number higher than $4 \times 10^7$, the inferred $A_1$ converges to values ranging between 1 and 1.25, consistent with laboratory experiments. Moreover, the independence of the normalized vertical velocity variance from the wall-normal distance in the ISL is further checked and the constant coefficient value agrees with reported laboratory experiments at very high Reynolds numbers as well as many surface layer experiments. Furthermore, nine benchmark cases selected through a restrictive quality control reveal a closer relationship between the `-1' scaling in the streamwise velocity energy spectrum and the logarithmic behaviour of streamwise velocity variance at higher Reynolds numbers, though no direct equivalence between them is observed.

physics.flu-dyn↗

arXiv2024

Extremal spectral radius and $g$-good $r$-component connectivity

For $F\subseteq V(G)$, if $G-F$ is a disconnected graph with at least $r$ components and each vertex $v\in V(G)\backslash F$ has at least $g$ neighbors, then $F$ is called a $g$-good $r$-component cut of $G$. The $g$-good $r$-component connectivity of $G$, denoted by $cκ_{g,r}(G)$, is the minimum cardinality of $g$-good $r$-component cuts of $G$. Let $\mathcal{G}_n^{k,δ}$ be the set of graphs of order $n$ with minimum degree $δ$ and $g$-good $r$-component connectivity $cκ_{g,r}(G)=k$. In the paper, we determine the extremal graphs attaining the maximum spectral radii among all graphs in $\mathcal{G}_n^{k,δ}$. A subset $F\subseteq V(G)$ is called a $g$-good neighbor cut of $G$ if $G-F$ is disconnected and each vertex $v\in V(G)\backslash F$ has at least $g$ neighbors. The $g$-good neighbor connectivity $κ_g(G)$ of a graph $G$ is the minimum cardinality of $g$-good neighbor cuts of $G$. The condition of $g$-good neighbor connectivity is weaker than that of $g$-good $r$-component connectivity, and there is no requirement on the number of components. As a counterpart, we also study similar problem for $g$-good neighbor connectivity.

math.CO↗

arXiv2024

Pistis-RAG: Enhancing Retrieval-Augmented Generation with Human Feedback

RAG systems face limitations when semantic relevance alone does not guarantee improved generation quality. This issue becomes particularly evident due to the sensitivity of large language models (LLMs) to the ordering of few-shot prompts, which can affect model performance. To address this challenge, aligning LLM outputs with human preferences using structured feedback, such as options to copy, regenerate, or dislike, offers a promising method for improvement. This feedback is applied to the entire list of inputs rather than giving specific ratings for individual documents, making it a Listwide Labels Learning-to-Rank task. To address this task, we propose Pistis-RAG, a new RAG framework designed with a content-centric approach to better align LLMs with human preferences. Pistis-RAG effectively utilizes human feedback, enhancing content ranking and generation quality. To validate our framework, we use public datasets to simulate human feedback, allowing us to evaluate and refine our method effectively. Experimental results indicate that Pistis-RAG improves alignment with human preferences relative to the baseline RAG system, showing a 6.06% increase in MMLU (English) and a 7.08% increase in C-EVAL (Chinese) accuracy metrics. These results highlight Pistis-RAG's effectiveness in overcoming the limitations associated with traditional RAG approaches.

cs.IR↗

arXiv2024

EEG-based Multimodal Representation Learning for Emotion Recognition

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal framework that accommodates not only conventional modalities such as video, images, and audio, but also incorporates EEG data. Our framework is designed to flexibly handle varying input sizes, while dynamically adjusting attention to account for feature importance across modalities. We evaluate our approach on a recently introduced emotion recognition dataset that combines data from three modalities, making it an ideal testbed for multimodal learning. The experimental results provide a benchmark for the dataset and demonstrate the effectiveness of the proposed framework. This work highlights the potential of integrating EEG into multimodal systems, paving the way for more robust and comprehensive applications in emotion recognition and beyond.

cs.CV↗

arXiv2024

GLA-DA: Global-Local Alignment Domain Adaptation for Multivariate Time Series

Unlike images and natural language tokens, time series data is highly semantically sparse, resulting in labor-intensive label annotations. Unsupervised and Semi-supervised Domain Adaptation (UDA and SSDA) have demonstrated efficiency in addressing this issue by utilizing pre-labeled source data to train on unlabeled or partially labeled target data. However, in domain adaptation methods designed for downstream classification tasks, directly adapting labeled source samples with unlabelled target samples often results in similar distributions across various classes, thereby compromising the performance of the target classification task. To tackle this challenge, we proposed a Global-Local Alignment Domain Adaptation (GLA-DA) method for multivariate time series data. Data from two domains were initially encoded to align in an intermediate feature space adversarially, achieving Global Feature Alignment (GFA). Subsequently, GLA-DA leveraged the consistency between similarity-based and deep learning-based models to assign pseudo labels to unlabeled target data. This process aims to preserve differences among data with distinct labels by aligning the samples with the same class labels together, achieving Local Class Alignment (LCA). We implemented GLA-DA in both UDA and SSDA scenarios, showcasing its superiority over state-of-the-art methods through extensive experiments on various public datasets. Ablation experiments underscored the significance of key components within GLA-DA.

cs.LG↗

arXiv2024

Mapping effective connectivity by virtually perturbing a surrogate brain

Effective connectivity (EC), indicative of the causal interactions between brain regions, is fundamental to understanding information processing in the brain. Traditional approaches, which infer EC from neural responses to stimulations, are not suited for mapping whole-brain EC in humans due to being invasive and having limited spatial coverage of stimulations. To address this gap, we present Neural Perturbational Inference (NPI), a data-driven framework designed to map EC across the entire brain. NPI employs an artificial neural network trained to learn large-scale neural dynamics as a computational surrogate of the brain. NPI maps EC by perturbing each region of the surrogate brain and observing the resulting responses in all other regions. NPI captures the directionality, strength, and excitatory/inhibitory properties of brain-wide EC. Our validation of NPI, using models having ground-truth EC, shows its superiority over Granger causality and dynamic causal modeling. Applying NPI to resting-state fMRI data from diverse datasets reveals consistent and structurally supported EC. Further validation using a cortico-cortical evoked potentials dataset reveals a significant correlation between NPI-inferred EC and real stimulation propagation pathways. By transitioning from correlational to causal understandings of brain functionality, NPI marks a stride in decoding the brain's functional architecture and facilitating both neuroscience research and clinical applications.

q-bio.NC↗

arXiv2024

eWAPA: An eBPF-based WASI Performance Analysis Framework for WebAssembly Runtimes

WebAssembly (Wasm) is a low-level bytecode format that can run in modern browsers. With the development of standalone runtimes and the improvement of the WebAssembly System Interface (WASI), Wasm has further provided a more complete sandboxed runtime experience for server-side applications, effectively expanding its application scenarios. However, the implementation of WASI varies across different runtimes, and suboptimal interface implementations can lead to performance degradation during interactions between the runtime and the operating system. Existing research mainly focuses on overall performance evaluation of runtimes, while studies on WASI implementations are relatively scarce. To tackle this problem, we propose an eBPF-based WASI performance analysis framework. It collects key performance metrics of the runtime under different I/O load conditions, such as total execution time, startup time, WASI execution time, and syscall time. We can comprehensively analyze the performance of the runtime's I/O interactions with the operating system. Additionally, we provide a detailed analysis of the causes behind two specific WASI performance anomalies. These analytical results will guide the optimization of standalone runtimes and WASI implementations, enhancing their efficiency.

cs.SE↗

arXiv2024

Observational features of deformed Schwarzschild black holes illuminated by an anisotropic accretion disk

The projection effect of an anisotropic accretion disk causes its electromagnetic radiation to depend on the emission angle. Although this dependency has the potential to influence the observational characteristics of black holes, it has not received sufficient attention. In this paper, we employ a relativistic ray-tracing algorithm to numerically simulate 86 GHz and 230 GHz images of deformed Schwarzschild black holes illuminated by an equatorial anisotropic accretion disk, aiming to reveal the observational signatures of the target black hole and the impact of the projection effect on the images. The study demonstrates that while the introduction of the projection effect does not alter the profiles of the black hole's inner shadow and critical curve, it significantly suppresses the specific intensity of light rays, particularly in direct emission, thereby reducing image brightness. The extent of this reduction depends on both the observation inclination and frequency. This phenomenon aids in the extraction of geometric information from higher-order subrings in the image. Furthermore, we find that increasing the deformation parameter enhances the brightness of the deformed Schwarzschild black hole image, accompanied by a reduction in the size of the critical curve and inner shadow. This relationship establishes a connection between the intrinsic properties of deformed Schwarzschild black holes and their observational characteristics, providing a reliable tool for testing the no-hair theorem and gravitational theories. Specifically, we propose a novel method for constraining parameters based on the silhouette of the inner shadow, which holds promise for extension to any spherically symmetric black hole in other gravitational theories.

gr-qc↗

arXiv2024

Revisiting the Time Cost Model of AllReduce

AllReduce is an important and popular collective communication primitive, which has been widely used in areas such as distributed machine learning and high performance computing. To design, analyze, and choose from various algorithms and implementations of AllReduce, the time cost model plays a crucial role, and the predominant one is the $(α,β,γ)$ model. In this paper, we revisit this model, and reveal that it cannot well characterize the time cost of AllReduce on modern clusters; thus must be updated. We perform extensive measurements to identify two additional terms contributing to the time cost: the incast term and the memory access term. We augment the $(α,β,γ)$ model with these two terms, and present GenModel as a result. Using GenModel, we discover two new optimalities for AllReduce algorithms, and prove that they cannot be achieved simultaneously. Finally, striking the balance between the two new optimalities, we design GenTree, an AllReduce plan generation algorithm specialized for tree-like topologies. Experiments on a real testbed with 64 GPUs show that GenTree can achieve 1.22$\times$ to 1.65$\times$ speed-up against NCCL. Large-scale simulations also confirm that GenTree can improve the state-of-the-art AllReduce algorithm by a factor of $1.2$ to $7.4$ in scenarios where the two new terms dominate.

cs.DC↗

arXiv2024

ProphetFuzz: Fully Automated Prediction and Fuzzing of High-Risk Option Combinations with Only Documentation via Large Language Model

Vulnerabilities related to option combinations pose a significant challenge in software security testing due to their vast search space. Previous research primarily addressed this challenge through mutation or filtering techniques, which inefficiently treated all option combinations as having equal potential for vulnerabilities, thus wasting considerable time on non-vulnerable targets and resulting in low testing efficiency. In this paper, we utilize carefully designed prompt engineering to drive the large language model (LLM) to predict high-risk option combinations (i.e., more likely to contain vulnerabilities) and perform fuzz testing automatically without human intervention. We developed a tool called ProphetFuzz and evaluated it on a dataset comprising 52 programs collected from three related studies. The entire experiment consumed 10.44 CPU years. ProphetFuzz successfully predicted 1748 high-risk option combinations at an average cost of only \$8.69 per program. Results show that after 72 hours of fuzzing, ProphetFuzz discovered 364 unique vulnerabilities associated with 12.30\% of the predicted high-risk option combinations, which was 32.85\% higher than that found by state-of-the-art in the same timeframe. Additionally, using ProphetFuzz, we conducted persistent fuzzing on the latest versions of these programs, uncovering 140 vulnerabilities, with 93 confirmed by developers and 21 awarded CVE numbers.

cs.CR↗

arXiv2024

Utilizing Photometry from Multiple Sources to Mitigate Stellar Variability in Precise Radial Velocities: A Case Study of Kepler-21

We present a new analysis of Kepler-21, the brightest (V = 8.5) Kepler system with a known transiting exoplanet, Kepler-21 b. Kepler-21 b is a radius valley planet ($R = 1.6\pm 0.2 R_{\oplus}$) with an Earth-like composition (8.38$\pm$1.62 g/cc), though its mass and radius fall in the regime of possible "water worlds." We utilize new Keck/HIRES and WIYN/NEID radial velocity (RV) data in conjunction with Kepler and TESS photometry to perform a detailed study of activity mitigation between photometry and RVs. We additionally refine the system parameters, and we utilize Gaia astrometry to place constraints on a long-term RV trend. Our activity analysis affirms the quality of Kepler photometry for removing correlated noise from RVs, despite its temporal distance, though we reveal some cases where TESS may be superior. Using refined orbital parameters and updated composition curves, we rule out a ``water world" scenario for Kepler-21 b, and we identify a long period super-Jupiter planetary candidate, Kepler-21 (c).

astro-ph.EP↗

arXiv2024

Online Optimization and Ambiguity-based Learning of Distributionally Uncertain Dynamic Systems

This paper proposes a novel approach to construct data-driven online solutions to optimization problems (P) subject to a class of distributionally uncertain dynamical systems. The introduced framework allows for the simultaneous learning of distributional system uncertainty via a parameterized, control-dependent ambiguity set using a finite historical data set, and its use to make online decisions with probabilistic regret function bounds. Leveraging the merits of Machine Learning, the main technical approach relies on the theory of Distributional Robust Optimization (DRO), to hedge against uncertainty and provide less conservative results than standard Robust Optimization approaches. Starting from recent results that describe ambiguity sets via parameterized, and control-dependent empirical distributions as well as ambiguity radii, we first present a tractable reformulation of the corresponding optimization problem while maintaining the probabilistic guarantees. We then specialize these problems to the cases of 1) optimal one-stage control of distributionally uncertain nonlinear systems, and 2) resource allocation under distributional uncertainty. A novelty of this work is that it extends DRO to online optimization problems subject to a distributionally uncertain dynamical system constraint, handled via a control-dependent ambiguity set that leads to online-tractable optimization with probabilistic guarantees on regret bounds. Further, we introduce an online version of Nesterov's accelerated-gradient algorithm, and analyze its performance to solve this class of problems via dissipativity theory.

eess.SY↗

arXiv2024

Maximizing the index of signed complete graphs with spanning trees on $k$ pendant vertices

A signed graph $Σ=(G,σ)$ consists of an underlying graph $G=(V,E)$ with a sign function $σ:E\rightarrow\{-1,1\}$. Let $A(Σ)$ be the adjacency matrix of $Σ$ and $λ_1(Σ)$ denote the largest eigenvalue (index) of $Σ$.Define $(K_n,H^-)$ as a signed complete graph whose negative edges induce a subgraph $H$. In this paper, we focus on the following problem: which spanning tree $T$ with a given number of pendant vertices makes the $λ_1(A(Σ))$ of the unbalanced $(K_n,T^-)$ as large as possible? To answer the problem, we characterize the extremal signed graph with maximum $λ_1(A(Σ))$ among graphs of type $(K_n,T^-)$.

math.CO↗

arXiv2024

A unified approach to the spectral radius, connectivity and edge-connectivity of graphs

For two integers $r\geq 2$ and $h\geq 0$, the \emph{$h$-extra $r$-component connectivity} $κ^h_r(G)$ of a graph $G$ is defined to be the minimum size of a subset of vertices whose removal disconnects $G$, and there are at least $r$ connected components in $G\!-\!S$ and each component has at least $h+1$ vertices. Denote by $\mathcal{G}_{n,δ}^{κ_r^h}$ the set of graphs with $h$-extra $r$-component connectivity $κ^h_r(G)$ and minimum degree $δ$. The following problem concerning spectral radius was proposed by Brualdi and Solheid [On the spectral radius of complementary acyclic matrices of zeros and one, SIAM J. Algebra Discrete Methods 7 (1986) 265-272]: Given a set of graphs $\mathscr{S}$, find an upper bound for the spectral radius of graphs in $\mathscr{S}$ and characterize the graphs in which the maximal spectral radius is attained. We study this question for $\mathscr{S}=\mathcal{G}_{n,δ}^{κ_r^h}$ where $r\geq 2$ and $h\geq 0$. Fan, Gu and Lin [$l$-connectivity, $l$-edge-connectivity and spectral radius of graphs, \emph{arXiv}:2309.05247] give the answer to $r\geq 2$ and $h=0$. In this paper, we solve this problem completely for $r\geq 2$ and $h\geq1$. Moreover, we also investigate analogous problems for the edge version. Our results can break the restriction of the extremum structure of the conditional connectivity. This implies some previous results in connectivity and edge-connectivity.

math.CO↗

arXiv2024

Essential connectivity and spectral radius of graphs

A graph is trivial if it contains one vertex and no edges. The essential connectivity $κ^{\prime}$ of $G$ is defined to be the minimum number of vertices of $G$ whose removal produces a disconnected graph with at least two non-trivial components. Let $\mathcal{A}_n^{κ',δ}$ be the set of graphs of order $n$ with minimum degree $δ$ and essential connectivity $κ'$. In this paper, we determine the graphs attaining the maximum spectral radii among all graphs in $\mathcal{A}_n^{κ',δ}$ and characterize the corresponding extremal graphs. In addition, we also determine the digraphs which achieve the maximum spectral radii among all strongly connected digraphs with given essential connectivity and give the exact values of the spectral radii of these digraphs.

math.CO↗

arXiv2024

Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition

Few-shot named entity recognition (NER) systems recognize entities using a few labeled training examples. The general pipeline consists of a span detector to identify entity spans in text and an entity-type classifier to assign types to entities. Current span detectors rely on extensive manual labeling to guide training. Almost every span detector requires initial training on basic span features followed by adaptation to task-specific features. This process leads to repetitive training of the basic span features among span detectors. Additionally, metric-based entity-type classifiers, such as prototypical networks, typically employ a specific metric that gauges the distance between the query sample and entity-type referents, ultimately assigning the most probable entity type to the query sample. However, these classifiers encounter the sample dependency problem, primarily stemming from the limited samples available for each entity-type referent. To address these challenges, we proposed an improved few-shot NER pipeline. First, we introduce a steppingstone span detector that is pre-trained on open-domain Wikipedia data. It can be used to initialize the pipeline span detector to reduce the repetitive training of basic features. Second, we leverage a large language model (LLM) to set reliable entity-type referents, eliminating reliance on few-shot samples of each type. Our model exhibits superior performance with fewer training steps and human-labeled data compared with baselines, as demonstrated through extensive experiments on various datasets. Particularly in fine-grained few-shot NER settings, our model outperforms strong baselines, including ChatGPT. We will publicly release the code, datasets, LLM outputs, and model checkpoints.

cs.CL↗

arXiv2024

LLM-based Knowledge Pruning for Time Series Data Analytics on Edge-computing Devices

Limited by the scale and diversity of time series data, the neural networks trained on time series data often overfit and show unsatisfacotry performances. In comparison, large language models (LLMs) recently exhibit impressive generalization in diverse fields. Although massive LLM based approaches are proposed for time series tasks, these methods require to load the whole LLM in both training and reference. This high computational demands limit practical applications in resource-constrained settings, like edge-computing and IoT devices. To address this issue, we propose Knowledge Pruning (KP), a novel paradigm for time series learning in this paper. For a specific downstream task, we argue that the world knowledge learned by LLMs is much redundant and only the related knowledge termed as "pertinent knowledge" is useful. Unlike other methods, our KP targets to prune the redundant knowledge and only distill the pertinent knowledge into the target model. This reduces model size and computational costs significantly. Additionally, different from existing LLM based approaches, our KP does not require to load the LLM in the process of training and testing, further easing computational burdens. With our proposed KP, a lightweight network can effectively learn the pertinent knowledge, achieving satisfactory performances with a low computation cost. To verify the effectiveness of our KP, two fundamental tasks on edge-computing devices are investigated in our experiments, where eight diverse environments or benchmarks with different networks are used to verify the generalization of our KP. Through experiments, our KP demonstrates effective learning of pertinent knowledge, achieving notable performance improvements in regression (19.7% on average) and classification (up to 13.7%) tasks, showcasing state-of-the-art results.

cs.LG↗