Searcharxiv⌕ Search

arXiv subjects

Jun Hu

Publications and source records attributed to Jun Hu.

At least 91 records · Page 5Linked to original sources

RGL: A Graph-Centric, Modular Framework for Efficient Retrieval-Augmented Generation on Graphs

Recent advances in graph learning have paved the way for innovative retrieval-augmented generation (RAG) systems that leverage the inherent relational structures in graph data. However, many existing approaches suffer from rigid, fixed settings and significant engineering overhead, limiting their adaptability and scalability. Additionally, the RAG community has largely overlooked the decades of research in the graph database community regarding the efficient retrieval of interesting substructures on large-scale graphs. In this work, we introduce the RAG-on-Graphs Library (RGL), a modular framework that seamlessly integrates the complete RAG pipeline-from efficient graph indexing and dynamic node retrieval to subgraph construction, tokenization, and final generation-into a unified system. RGL addresses key challenges by supporting a variety of graph formats and integrating optimized implementations for essential components, achieving speedups of up to 143x compared to conventional methods. Moreover, its flexible utilities, such as dynamic node filtering, allow for rapid extraction of pertinent subgraphs while reducing token consumption. Our extensive evaluations demonstrate that RGL not only accelerates the prototyping process but also enhances the performance and applicability of graph-based RAG systems across a range of tasks.

cs.IR↗

The sharpness condition for constructing a finite element from a superspline

This paper addresses sharpness conditions for constructing $C^r$ conforming finite element spaces from a superspline spaces on general simplicial triangulations. We introduce the concept of extendability for the pre-element spaces, which encompasses both the superspline spaces and the finite element spaces. By examining the extendability condition for both types of spaces, we provide an answer to the conditions regarding the construction. A corollary of our results is that constructing $C^r$ conforming elements in $d$ dimensions generally requires an extra $C^{2^{s}r}$ continuity on $s$-codimensional simplices, and the polynomial degree is at least $(2^d r + 1)$.

math.NA↗

Intrinsic higher-order topological states in 2D honeycomb Z_2 quantum spin Hall insulators

The exploration of topological phases remains a cutting-edge research frontier, driven by their promising potential for next-generation electronic and quantum technologies. In this work, we employ first-principles calculations and tight-binding modeling to systematically investigate the topological properties of freestanding two-dimensional (2D) honeycomb Bi, HgTe, and Al2O3(0001)-supported HgTe. Remarkably, all three systems exhibit coexistence of first-order and higher-order topological insulator states, manifested by gapless edge states in one-dimensional (1D) nanoribbons and symmetry-related corner states in zero-dimensional (0D) nanoflakes. Furthermore, fractional electron charges may accumulate at the corners of armchair-edged nanoflakes. Among these materials, HgTe/Al2O3(0001) is particularly promising due to its experimentally feasible atomic configuration and low-energy corner states. Our findings highlight the importance of exploring higher-order topological phases in Z_2 quantum spin Hall insulators and pave the way for new possibilities in device applications.

cond-mat.mtrl-sci↗

Beam test result and digitization of TaichuPix-3: A Monolithic Active Pixel Sensors for CEPC vertex detector

The Circular Electron-Positron Collider (CEPC), as the next-generation electron-positron collider, is tasked with advancing not only Higgs physics but also the discovery of new physics. Achieving these goals requires high-precision measurements of particles. Taichu seires, Monolithic Active Pixel Sensor (MAPS), a key component of the vertex detector for CEPC was designed to meet the CEPC's requirements. For the geometry of vertex detector is long barrel with no endcap, and current silicon lacks a complete digitization model, precise estimation of cluster size particularly causing by particle with large incident angle is needed. Testbeam results were conducted at the Beijing Synchrotron Radiation Facility (BSRF) to evaluate cluster size dependence on different incident angles and threshold settings. Experimental results confirmed that cluster size increases with incident angle. Simulations using the Allpix$^2$ framework replicated experimental trends at small angles but exhibited discrepancies at large angles, suggesting limitations in linear electric field assumptions and sensor thickness approximations. The results from both testbeam and simulations have provided insights into the performance of the TaichuPix chip at large incident angles, offering a crucial foundation for the establishment of a digital model and addressing the estimation of cluster size in the forward region of the long barrel. Furthermore, it offers valuable references for future iterations of TaichuPix, the development of digital models, and the simulation and estimation of the vertex detector's performance.

physics.ins-det↗

Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs

In this technical report, we tackle the challenges of training large-scale Mixture of Experts (MoE) models, focusing on overcoming cost inefficiency and resource limitations prevalent in such systems. To address these issues, we present two differently sized MoE large language models (LLMs), namely Ling-Lite and Ling-Plus (referred to as "Bailing" in Chinese, spelled Bǎilíng in Pinyin). Ling-Lite contains 16.8 billion parameters with 2.75 billion activated parameters, while Ling-Plus boasts 290 billion parameters with 28.8 billion activated parameters. Both models exhibit comparable performance to leading industry benchmarks. This report offers actionable insights to improve the efficiency and accessibility of AI development in resource-constrained settings, promoting more scalable and sustainable technologies. Specifically, to reduce training costs for large-scale MoE models, we propose innovative methods for (1) optimization of model architecture and training processes, (2) refinement of training anomaly handling, and (3) enhancement of model evaluation efficiency. Additionally, leveraging high-quality data generated from knowledge graphs, our models demonstrate superior capabilities in tool use compared to other models. Ultimately, our experimental findings demonstrate that a 300B MoE LLM can be effectively trained on lower-performance devices while achieving comparable performance to models of a similar scale, including dense and MoE models. Compared to high-performance devices, utilizing a lower-specification hardware system during the pre-training phase demonstrates significant cost savings, reducing computing costs by approximately 20%. The models can be accessed at https://huggingface.co/inclusionAI.

cs.LG↗

Strain-engineering quantum anomalous Hall effect in janus MnBi2SexTe4-x monolayers

Exploring intrinsic magnetic topological insulators (TIs) for next-generation spintronic devices is still challenging in recent years. Here, we present a theoretical investigation on the electronic, magnetic and topological properties of monolayer (ML) Janus MnBi2TexSe4-x, derived from two trivial magnetic semiconductors ML MnBi2Se4 and MnBi2Te4. Our band structure analysis reveals that two out of the eight Janus structures exhibit band inversion induced by spin-orbit coupling. These structures are confirmed to have nonzero integer Chern numbers, indicating their topological nature. Moreover, the topological state is robust under moderate biaxial strains. Interestingly, applying compressive strain results in a high Chern number of 2 and enhances their magnetic stability at elevated temperatures. Our findings offer an effective strategy to engineer magnetic TI states within the ML MnBi2Te4 family.

cond-mat.mtrl-sci↗

A Test System for the JUNO 20-inch PMTs Prior to Installation

The JUNO experiment requires an excellent energy resolution of 3\% at 1 MeV. To achieve this objective, a total of 20,012 20-inch photomultiplier tubes (PMTs) will be deployed for JUNO, comprising 15,012 multi-channel plate (MCP) PMTs and 5,000 dynode PMTs. Currently, JUNO is in the process of detector installation, with PMTs being installed from the top to the bottom of the stainless-steel structure located in the underground experimental hall. In order to validate the functionality of the PMTs and ensure there are no malfunctions prior to installation, a test system has been established at the JUNO site, and testing is being conducted. This paper presents an overview of the test system and reports on the initial test results.

physics.ins-det↗

Robust 4D Radar-aided Inertial Navigation for Aerial Vehicles

While LiDAR and cameras are becoming ubiquitous for unmanned aerial vehicles (UAVs) but can be ineffective in challenging environments, 4D millimeter-wave (MMW) radars that can provide robust 3D ranging and Doppler velocity measurements are less exploited for aerial navigation. In this paper, we develop an efficient and robust error-state Kalman filter (ESKF)-based radar-inertial navigation for UAVs. The key idea of the proposed approach is the point-to-distribution radar scan matching to provide motion constraints with proper uncertainty qualification, which are used to update the navigation states in a tightly coupled manner, along with the Doppler velocity measurements. Moreover, we propose a robust keyframe-based matching scheme against the prior map (if available) to bound the accumulated navigation errors and thus provide a radar-based global localization solution with high accuracy. Extensive real-world experimental validations have demonstrated that the proposed radar-aided inertial navigation outperforms state-of-the-art methods in both accuracy and robustness.

cs.RO↗

One Model for All: Large Language Models are Domain-Agnostic Recommendation Systems

Sequential recommendation systems aim to predict users' next likely interaction based on their history. However, these systems face data sparsity and cold-start problems. Utilizing data from other domains, known as multi-domain methods, is useful for alleviating these problems. However, traditional multi-domain methods rely on meaningless ID-based item representation, which makes it difficult to align items with similar meanings from different domains, yielding sup-optimal knowledge transfer. This paper introduces LLM-Rec, a framework that utilizes pre-trained large language models (LLMs) for domain-agnostic recommendation. Specifically, we mix user's behaviors from multiple domains and concatenate item titles into a sentence, then use LLMs for generating user and item representations. By mixing behaviors across different domains, we can exploit the knowledge encoded in LLMs to bridge the semantic across over multi-domain behaviors, thus obtaining semantically rich representations and improving performance in all domains. Furthermore, we explore the underlying reasons why LLMs are effective and investigate whether LLMs can understand the semantic correlations as the recommendation model, and if advanced techniques like scaling laws in NLP also work in recommendations. We conduct extensive experiments with LLMs ranging from 40M to 6.7B to answer the above questions and to verify the effectiveness of LLM-Rec in multi-domain recommendation.

cs.IR↗

Trace forms on the cyclotomic Hecke algebras and cocenters of the cyclotomic Schur algebras

We define a unified trace form $τ$ on the cyclotomic Hecke algebras $\mathscr{H}_{n,K}$ of type $A$, which generalize both Malle-Mathas' trace form on the non-degenerate version (with Hecke parameter $ξ\neq 1$) and Brundan-Kleshchev's trace form on the degenerate version. We use seminormal basis theory to construct a pair of dual bases for $\mathscr{H}_{n,K}$ with respect to the form. We also construct an explicit basis for the cocenter (i.e., the $0$th Hochschild homology) of the corresponding cyclotomic Schur algebra, which shows that the cocenter has dimension independent of the ground field $K$, the Hecke parameter $ξ$ and the cyclotomic parameters $Q_1,\cdots,Q_\ell$.

math.RT↗

A 64-Channel Precision Time-to-Digital Converter with Average 4.77 ps RMS Implemented in a 28 nm FPGA

We have developed a Time-to-Digital Converter (TDC) application in a Xilinx Kintex-7 Field Programmable Gate Array (FPGA). This TDC, based on the Tapped-Delay Line (TDL) and Wave Union A (WU-A) techniques, achieves an independent time measurement on 32-channel rising edges and 32-channel falling edges. The average time resolution or the Least Significant Bit (LSB) of the 64 channels is measured to be 3 ps level, with an average root mean square (RMS) precision of 4.77 ps, and a maximum RMS below 8 ps. We also propose an online processing scheme that handles the bubble issues caused by clock region skew.

physics.ins-det↗

Modality-Independent Graph Neural Networks with Global Transformers for Multimodal Recommendation

Multimodal recommendation systems can learn users' preferences from existing user-item interactions as well as the semantics of multimodal data associated with items. Many existing methods model this through a multimodal user-item graph, approaching multimodal recommendation as a graph learning task. Graph Neural Networks (GNNs) have shown promising performance in this domain. Prior research has capitalized on GNNs' capability to capture neighborhood information within certain receptive fields (typically denoted by the number of hops, $K$) to enrich user and item semantics. We observe that the optimal receptive fields for GNNs can vary across different modalities. In this paper, we propose GNNs with Modality-Independent Receptive Fields, which employ separate GNNs with independent receptive fields for different modalities to enhance performance. Our results indicate that the optimal $K$ for certain modalities on specific datasets can be as low as 1 or 2, which may restrict the GNNs' capacity to capture global information. To address this, we introduce a Sampling-based Global Transformer, which utilizes uniform global sampling to effectively integrate global information for GNNs. We conduct comprehensive experiments that demonstrate the superiority of our approach over existing methods. Our code is publicly available at https://github.com/CrawlScript/MIG-GT.

cs.SI↗

Seeing is Believing: Vision-driven Non-crash Functional Bug Detection for Mobile Apps

Mobile app GUI (Graphical User Interface) pages now contain rich visual information, with the visual semantics of each page helping users understand the application logic. However, these complex visual and functional logic present new challenges to software testing. Existing automated GUI testing methods, constrained by the lack of reliable testing oracles, are limited to detecting crash bugs with obvious abnormal signals. Consequently, many non-crash functional bugs, ranging from unexpected behaviors to logical errors, often evade detection by current techniques. While these non-crash functional bugs can exhibit visual cues that serve as potential testing oracles, they often entail a sequence of screenshots, and detecting them necessitates an understanding of the operational logic among GUI page transitions, which is challenging traditional techniques. Considering the remarkable performance of Multimodal Large Language Models (MLLM) in visual and language understanding, this paper proposes Trident, a novel vision-driven, multi-agent collaborative automated GUI testing approach for detecting non-crash functional bugs. It comprises three agents: Explorer, Monitor, and Detector, to guide the exploration, oversee the testing progress, and spot issues. We also address several challenges, i.e., align visual and textual information for MLLM input, achieve functionality-oriented exploration, and infer test oracles for non-crash bugs, to enhance the performance of functionality bug detection. We evaluate Trident on 590 non-crash bugs and compare it with 12 baselines, it can achieve more than 14%-112% and 108%-147% boost in average recall and precision compared with the best baseline. The ablation study further proves the contribution of each module. Moreover, Trident identifies 43 new bugs on Google Play, of which 31 have been fixed.

cs.SE↗

Crystallization morphology and self-assembly of polyacrylamide solutions during evaporation

This study investigates the crystallization and self-assembly phenomena of polyacrylamide (PAM) solutions during evaporation. While traditional thin-film fabrication methods such as spin coating and drop casting are commonly used, this study utilizes a simple evaporation approach to gain insights into the self-assembly processes of PAM solutions. We examined PAM solutions with varying concentrations (1%, 2%, and 5%) and observed the resulting crystalline structures and morphological changes during evaporation. Spectroscopic absorbance measurements were employed to analyze concentration gradients and crystallization patterns. The findings reveal that the concentration gradient during evaporation significantly impacts the crystallization behavior of PAM solutions. The 2% solution exhibited the clearest and most regular crystalline patterns, whereas the 1% and 5% solutions displayed more complex and irregular morphologies. These observations provide new insights into how solution concentration influences PAM crystallization, contributing to a better understanding of polymer thin-film self-assembly. The novelty of this study lies in exploring PAM self-assembly through controlled evaporation, offering valuable insights for the development of polymer films.

cond-mat.soft↗

Cubic polynomials with a 2-cycle of Siegel disks

Under conjugation by affine transformations, the dynamical moduli space of cubic polynomials $f$ with a $2$-cycle of Siegel disks is parameterized by a three-punctured complex plane as a degree-$2$ cover. Assuming the rotation number of $f^2$ on the Siegel disk is of bounded type, we show that on the three-punctured complex plane, the locus of the cubic polynomials with both finite critical points on the boundaries of the Siegel disks on the $2$-cycle is comprised of two arcs, corresponding to the cases with two critical points on the boundary of the same Siegel disk, and a Jordan curve, corresponding to the cases with two critical points on the boundaries of different Siegel disks.

math.DS↗

Seminormal basis for the cyclotomic Hecke algebra of type $G(r,p,n)$

The cyclotomic Hecke algebra $H_{r,p,n}$ of type $G(r,p,n)$ (where $r=pd$) can be realized as the $σ$-fixed point subalgebra of certain cyclotomic Hecke algebra $H_{r,n}$ of type $G(r,1,n)$ with some special cyclotomic parameters, where $σ$ is an automorphism of $H_{r,n}$ of order $p$. In this paper we prove a number of rational properties on the $γ$-coefficients arising in the construction of the seminormal basis for the semisimple Hecke algebra $H_{r,n}$. Using these properties, we construct a seminormal basis for the semisimple Hecke algebra $H_{r,p,n}$ in terms of the seminormal basis for the semisimple Hecke algebra $H_{r,n}$. The proof relies on some careful and subtle study on some rational and symmetric properties of some quotients and/or products of $γ$-coefficients of $H_{r,n}$. As applications, we obtain an explicit basis for the center $Z(H_{r,p,n})$ and an explicit basis for the $σ$-twisted $k$-center $Z(H_{r,n})^{(k)}$ of $H_{r,n}$ for each $k\in\mathbb{Z}/p\mathbb{Z}$.

math.RT↗

Lower order mixed elements for the linear elasticity problem in 2D and 3D

In this paper, we construct two lower order mixed elements for the linear elasticity problem in the Hellinger-Reissner formulation, one for the 2D problem and one for the 3D problem, both on macro-element meshes. The discrete stress spaces enrich the analogous $P_k$ stress spaces in [J. Hu and S. Zhang, arxiv, 2014, J. Hu and S. Zhang, Sci. China Math., 2015] with simple macro-element bubble functions, and the discrete displacement spaces are discontinuous piecewise $P_{k-1}$ polynomial spaces, with $k=2,3$, respectively. Discrete stability and optimal convergence is proved by using the macro-element technique. As a byproduct, the discrete stability and optimal convergence of the $P_2-P_1$ mixed element in [L. Chen and X. Huang, SIAM J. Numer. Anal., 2022] in 3D is proved on another macro-element mesh. For the mixed element in 2D, an $H^2$-conforming composite element is constructed and an exact discrete elasticity sequence is presented. Numerical experiments confirm the theoretical results.

math.NA↗

Online Multi-Label Classification under Noisy and Changing Label Distribution

Multi-label data stream usually contains noisy labels in the real-world applications, namely occuring in both relevant and irrelevant labels. However, existing online multi-label classification methods are mostly limited in terms of label quality and fail to deal with the case of noisy labels. On the other hand, the ground-truth label distribution may vary with the time changing, which is hidden in the observed noisy label distribution and difficult to track, posing a major challenge for concept drift adaptation. Motivated by this, we propose an online multi-label classification algorithm under Noisy and Changing Label Distribution (NCLD). The convex objective is designed to simultaneously model the label scoring and the label ranking for high accuracy, whose robustness to NCLD benefits from three novel works: 1) The local feature graph is used to reconstruct the label scores jointly with the observed labels, and an unbiased ranking loss is derived and applied to learn reliable ranking information. 2) By detecting the difference between two adjacent chunks with the unbiased label cardinality, we identify the change in the ground-truth label distribution and reset the ranking or all information learned from the past to match the new distribution. 3) Efficient and accurate updating is achieved based on the updating rule derived from the closed-form optimal model solution. Finally, empirical experimental results validate the effectiveness of our method in classifying instances under NCLD.

cs.LG↗