SearcharxivSearch

arXiv subjects

Haitao Jiang

Publications and source records attributed to Haitao Jiang.

At least 19 recordsLinked to original sources

Supervised Fine-Tuning versus Reinforcement Learning: A Study of Post-Training Methods for Large Language Models

Pre-trained Large Language Model (LLM) exhibits broad capabilities, yet, for specific tasks or domains their attainment of higher accuracy and more reliable reasoning generally depends on post-training through Supervised Fine-Tuning (SFT) or Reinforcement Learning (RL). Although often treated as distinct methodologies, recent theoretical and empirical developments demonstrate that SFT and RL are closely connected. This study presents a comprehensive and unified perspective on LLM post-training with SFT and RL. We first provide an in-depth overview of both techniques, examining their objectives, algorithmic structures, and data requirements. We then systematically analyze their interplay, highlighting frameworks that integrate SFT and RL, hybrid training pipelines, and methods that leverage their complementary strengths. Drawing on a representative set of recent application studies from 2023 to 2025, we identify emerging trends, characterize the rapid shift toward hybrid post-training paradigms, and distill key takeaways that clarify when and why each method is most effective. By synthesizing theoretical insights, practical methodologies, and empirical evidence, this study establishes a coherent understanding of SFT and RL within a unified framework and outlines promising directions for future research in scalable, efficient, and generalizable LLM post-training.

cs.AI

Anomalous Non-Hermitian Topological Anderson Insulator

Strong disorder drives conventional Hermitian systems into Anderson insulating states, suppressing all topological phases. Here, we unveil symmetry-protected, anomalous topological phases in the strong disorder limit of a non-Hermitian system, characterized by a scale-invariant merging of zero-energy modes. Using the maximally symmetric Jx lattice as an ideal platform and introducing specifically engineered (ABBA-type) symmetry-preserving non-Hermitian disorder, we observe a sequence of disorder-induced phase transitions: from a trivial insulator into and through a non-Hermitian topological Anderson insulator (TAI) phase, culminating in a stable anomalous non-Hermitian TAI phase characterized by a quantized polarization P_x \approx 0.25. Within this anomalous phase protected by the mobility gap, the zero-energy modes exhibit a distinct (N/2)-mode coalescence that scales with system size. Our findings demonstrate that non-Hermitian disorder engineered to preserve symmetry can induce and protect novel topological order inaccessible to conventional Hermitian disorder, thereby advancing the fundamental understanding of topological phenomena mediated by the interplay of disorder and non-Hermiticity.

cond-mat.mes-hall

PABU: Progress-Aware Belief Update for Efficient LLM Agents

Large Language Model (LLM) agents commonly condition actions on full action-observation histories, which introduce task-irrelevant information that easily leads to redundant actions and higher inference cost. We propose Progress-Aware Belief Update (PABU), a belief-state framework that compactly represents an agent's state by explicitly modeling task progress and selectively retaining past actions and observations. At each step, the agent predicts its relative progress since the previous round and decides whether the newly encountered interaction should be stored, conditioning future decisions only on the retained subset. Across eight environments in the AgentGym benchmark, and using identical training trajectories, PABU achieves an 81.0% task completion rate, outperforming previous State of the art (SoTA) models with full-history belief by 23.9%. Additionally, PABU's progress-oriented action selection improves efficiency, reducing the average number of interaction steps to 9.5, corresponding to a 26.9% reduction. Ablation studies show that both explicit progress prediction and selective retention are necessary for robust belief learning and performance gains.

cs.AI

IM-GIV: an effective integrity monitoring scheme for tightly-coupled GNSS/INS/Vision integration based on factor graph optimization

Global Navigation Satellite System/Inertial Navigation System (GNSS/INS)/Vision integration based on factor graph optimization (FGO) has recently attracted extensive attention in navigation and robotics community. Integrity monitoring (IM) capability is required when FGO-based integrated navigation system is used for safety-critical applications. However, traditional researches on IM of integrated navigation system are mostly based on Kalman filter. It is urgent to develop effective IM scheme for FGO-based GNSS/INS/Vision integration. In this contribution, the position error bounding formula to ensure the integrity of the GNSS/INS/Vision integration based on FGO is designed and validated for the first time. It can be calculated by the linearized equations from the residuals of GNSS pseudo-range, IMU pre-integration and visual measurements. The specific position error bounding is given in the case of GNSS, INS and visual measurement faults. Field experiments were conducted to evaluate and validate the performance of the proposed position error bounding. Experimental results demonstrate that the proposed position error bounding for the GNSS/INS/Vision integration based on FGO can correctly fit the position error against different fault modes, and the availability of integrity in six fault modes is 100% after correct and timely fault exclusion.

cs.RO

LLM4Causal: Democratized Causal Tools for Everyone via Large Language Model

Large Language Models (LLMs) have shown their success in language understanding and reasoning on general topics. However, their capability to perform inference based on user-specified structured data and knowledge in corpus-rare concepts, such as causal decision-making is still limited. In this work, we explore the possibility of fine-tuning an open-sourced LLM into LLM4Causal, which can identify the causal task, execute a corresponding function, and interpret its numerical results based on users' queries and the provided dataset. Meanwhile, we propose a data generation process for more controllable GPT prompting and present two instruction-tuning datasets: (1) Causal-Retrieval-Bench for causal problem identification and input parameter extraction for causal function calling and (2) Causal-Interpret-Bench for in-context causal interpretation. By conducting end-to-end evaluations and two ablation studies, we showed that LLM4Causal can deliver end-to-end solutions for causal problems and provide easy-to-understand answers, which significantly outperforms the baselines.

cs.CL

Men Can't Always be Transformed into Mice: Decision Algorithms and Complexity for Sorting by Symmetric Reversals

Sorting a permutation by reversals is a famous problem in genome rearrangements. Since 1997, quite some biological evidence were found that in many genomes the reversed regions are usually flanked by a pair of inverted repeats. This type of reversals are called symmetric reversals, which, unfortunately, were largely ignored until recently. In this paper, we investigate the problem of sorting by symmetric reversals, which requires a series of symmetric reversals to transform one chromosome $A$ into the another chromosome $B$. The decision problem of sorting by symmetric reversals is referred to as {\em SSR} (when the input chromosomes $A$ and $B$ are given, we use {\em SSR(A,B)}) and the corresponding optimization version (i.e., when the answer for {\em SSR(A,B)} is yes, using the minimum number of symmetric reversals to convert $A$ to $B$), is referred to as {\em SMSR(A,B)}. The main results of this paper are summarized as follows, where the input is a pair of chromosomes $A$ and $B$ with $n$ repeats. (1) We present an $O(n^2)$ time algorithm to solve the decision problem {\em SSR(A,B)}, i.e., determine whether a chromosome $A$ can be transformed into $B$ by a series of symmetric reversals. (2) We design an $O(n^2)$ time algorithm for a special 2-balanced case of {\em SMSR(A,B)}, where chromosomes $A$ and $B$ both have duplication number 2 and every repeat appears twice in different orientations in $A$ and $B$. (3) We show that SMSR is NP-hard even if the duplication number of the input chromosomes are at most 2, hence showing that the above positive optimization result is the best possible. As a by-product, we show that the \emph{minimum Steiner tree} problem on \emph{circle graphs} is NP-hard, settling the complexity status of a 38-year old open problem.

cs.DS

Photonic Dirac Nodal Line Semimetals Realized by Hyper-crystal

Recently, the gapless Dirac/Weyl nodal semimetals with linear dispersion and topologically protected modes degeneracy are rapidly growing frontiers of topological physics. Especially, type-I, type-II, and critical type-III nodal semimetals are discovered according to the tilt angles of the Dirac/Weyl cones. Here, by introducing hyperbolic metamaterials into one-dimensional photonic crystals, we design the "hyper-crystal" and study the photonic four-fold degenerate Dirac nodal line semimetals (DNLSs) with two types of perpendicularly polarized waves. Moreover, the flexibly controlled photonic DNLSs using the phase compensation effect of hyperbolic dispersion are studied. Our results not only demonstrate a new platform to realize the various photonic DNLSs, where the optical polarization plays the role of electron spin in electronic DNLSs, but also may pave a novel way to explore the abundant Dirac/Weyl physics in the simple classical wave systems.

physics.optics

Locally Aggregated Feature Attribution on Natural Language Model Understanding

With the growing popularity of deep-learning models, model understanding becomes more important. Much effort has been devoted to demystify deep neural networks for better interpretability. Some feature attribution methods have shown promising results in computer vision, especially the gradient-based methods where effectively smoothing the gradients with reference data is key to a robust and faithful result. However, direct application of these gradient-based methods to NLP tasks is not trivial due to the fact that the input consists of discrete tokens and the "reference" tokens are not explicitly defined. In this work, we propose Locally Aggregated Feature Attribution (LAFA), a novel gradient-based feature attribution method for NLP models. Instead of relying on obscure reference tokens, it smooths gradients by aggregating similar reference texts derived from language model embeddings. For evaluation purpose, we also design experiments on different NLP tasks including Entity Recognition and Sentiment Analysis on public datasets as well as key feature detection on a constructed Amazon catalogue dataset. The superior performance of the proposed method is demonstrated through experiments.

cs.CL

Omnidirectional nonreciprocal absorber realized by the magneto-optical hypercrystal

Photonic bandgap design is one of the most basic ways to effectively control the interaction between light and matter. However, the traditional photonic bandgap is always dispersive (blueshift with the increase of the incident angle), which is disadvantageous to the construction of wide-angle optical devices. Hypercrystal, that the photonic crystal with layered hyperbolic metamaterials (HMMs), can strongly modify the bandgap properties based on the anomalous wavevector dispersion of the HMM. Here, based on phase variation compensation between HMM and isotropic dielectric layers, we propose for the first time to design nonreciprocal and flexible photonic bandgaps using magneto-optical HMMs in one-dimensional photonic crystals. Especially for the forward and backward incident light, the blueshift and dispersionless of the forward and backward cavity modes are designed respectively to realize the interesting omnidirectional nonreciprocal absorber. Our results show high (low) absorption about 0.99 (0.25) in an angle range of 20-75 degrees for the forward (backward) incident light at the wavelength of 367 nm. The nonreciprocal omnidirectional cavity mode not only facilitates the design of perfect unidirectional optical absorbers working in a wide-angle range, but also possesses significant applications for all-angle reflectors and filters.

physics.optics

Zero-index and Hyperbolic Metacavities: Fundamentals and Applications

As a basic building block, optical resonant cavities (ORCs) are widely used in light manipulation; they can confine electromagnetic waves and improve the interaction between light and matter, which also plays an important role in cavity quantum electrodynamics, nonlinear optics and quantum optics. Especially in recent years, the rise of metamaterials, artificial materials composed of subwavelength unit cells, greatly enriches the design and function of ORCs. Here, we review zero-index and hyperbolic metamaterials for constructing the novel ORCs. Firstly, this paper introduces the classification and implementation of zero-index and hyperbolic metamaterials. Secondly, the distinctive properties of zero-index and hyperbolic cavities are summarized, including the geometry-invariance, homogeneous/inhomogeneous field distribution, and the topological protection (anomalous scaling law, size independence, continuum of high-order modes, and dispersionless modes) for the zero-index (hyperbolic) metacavities. Finally, the paper introduces some typical applications of zero-index and hyperbolic metacavities, and prospects the research of metacavities.

physics.optics

Wireless power transfer via topological modes in dimer chains

The topological characteristics, including invariant topological orders, band inversion, and the topological edge mode (TEM) in the photonic insulators, have been widely studied. Whether people can take advantage of intriguing topological modes in simple one-dimensional systems to implement some practical applications is an issue which people are increasingly concerned about. In this work, based on a photonic dimer chain composed of ultra-subwavelength resonators, we verify experimentally that the TEM in the effective second-order parity-time (PT) system is immune to the inner disorder perturbation, and can be used to realize the long-range wireless power transfer (WPT) with high transmission efficiency. To intuitively show the TEM can be used for WPT, a power signal source is used to excite the TEM. It can be clearly seen that two LED lamps with 0.5-W at both ends of the structure are lighted up with the aid of TEMs. In addition, in order to solve the special technical problems of standby power loss and frequency tracking, we further propose that a WPT system with effective third-order PT symmetry can be constructed by using one topological interface mode and two TEMs. Inspired by the long-range WPT with TEMs in this work, it is expected to use more complex topological structures to achieve energy transmission with more functions, such as the WPT devices whose direction can be selected flexibly in the quasiperiodic or trimer topological chains.

physics.app-ph

Significant enhancement of magnetic shielding effect by using the composite metamaterial composed of mu-near-zero media and ferrite

The magnetic shield plays an important role in magnetic near-field control. However, the requirements of efficient, ultrathin, lightweight and cheap are still the challenges. Here, we firstly propose a composite metamaterial in which the mu-near-zero media is covered with a ferrite slab. We verify that this structure can enhance the shielding effectiveness in a small area. Furthermore, we optimize the magnetic path by changing the bulk ferrite slab into a patterned slab. In this way, significant shielding effectiveness enhancement can be achieved in a large area. Experimental results show that the maximum shielding effectiveness (SE) of the composite metamaterial with a patterned ferrite is 20.56 dB, which is nearly 19 dB higher than that of a single ferrite slab with the same thickness of the composite metamaterial. The results on the composite metamaterial would be very useful in the applications involving magnetic shielding.

physics.app-ph

Synthetic high-order PT symmetry in a single coil resonator

The exploration of non-Hermitian systems with parity-time (PT) symmetry has witnessed immense research interest both fundamentally and technologically in a wide range of subject areas in physics and engineering. One significant example of the principal emerging fields in this context is the PT symmetric wireless applications using multiple coils that are spatially separated but mutually coupled with position-dependent coupling strength. Such a spatial PT configuration limits the flexibility and miniaturization of the PT symmetric designs. As far as this is concerned, inspired by scattering induced two opposite whispering-gallery (WG) modes in an optical resonator, analogously here we experimentally demonstrate a specially constructed second-order (2-nd order) PT symmetry in a single coil resonator, whose currents with two different directions are excited by internal bypass capacitor. Our proposed structure has the following peculiar feature: First, the bypass capacitor induces coupling in spectral resonances allow us to observe a 2-nd order phase transition between symmetry regimes, without the need of a second coil in the spatial PT case. Under this circumstance, this specially constructed PT symmetry can be regarded as synthetic PT symmetry, which is enabled by coupling modes with different directions. Second, by introducing two or more internal bypass capacitors, the synthetic high-order PT symmetric system bearing such as third-order exceptional point in a single coil resonator can be realized. These results will provide a new paradigm to realize higher-order PT symmetry towards the investigation of non-Hermitian physics in a synthetic perspective, which can be extended to other physical platforms such as optics and acoustics.

physics.app-ph

Miniaturized backward coupler realized by the circuit-based magnetic hyperbolic waveguide

Planar waveguides can limit the transmission of electromagnetic waves in a specific direction and have a wide range of applications in filters, sensors, and energy-transfer devices. However, given the increasing demand for planar integrated photonics, new waveguides are required with excellent characteristics such as more functionality, greater efficiency, and smaller size. In this work, we report the experimental results for a subwavelength planar microwave-regime waveguide fabricated from circuit-based magnetic hyperbolic metamaterial (HMM) and develop the associated theory. HMM is a special type of anisotropic metamaterial whose isofrequency contour (IFC) takes the form of an open hyperboloid. Because of the open-dispersion IFCs, HMMs support propagating high-k modes with large effective refractive indices, which allows planar hyperbolic waveguides to be miniaturized. In particular, as opposed to the traditional dielectric slab waveguide, the group velocity of the hyperbolic guided modes is negative-a characteristic that can be exploited to realize the backward propagation of electromagnetic waves. Furthermore, we study the abnormal photonic spin Hall effect and experimentally demonstrate an ultracompact backward coupler based on hyperbolic waveguides. The experimental results are consistent with numerical simulations. This work not only reveals the significant potential of circuit-based platforms for the experimental study of the propagation and coupling of guided modes but also promotes the use of HMMs in the microwave regime for numerous integrated functional devices.

physics.app-ph

One-dimensional topological quasiperiodic chain for directional wireless power transfer

As an important class of systems with unique topological effects beyond the periodic lattices, quasiperiodic topological structures have attracted much attention in recent years. Due to the quasiperiodic modulation, the topological states in the quasiperiodic topological structures have the characteristics of self-similarity, which can be used to observe the charming Hofstadter butterfly. In addition, because of the asymmetric distribution, the edge states in quasiperiodic chain can be used to realize the adiabatic pumping. When the topological parameters in quasiperiodic topological lattices are considered as synthetic dimensions, they can also be used to study the topological properties with higher dimensions. Here, by using ultra-subwavelength resonators, we design and fabricate a type of one-dimensional quasiperiodic Harper chain with asymmetric topological edge states for the directional wireless power transfer (WPT). By further introducing a power source into the system, we selectively light up two Chinese characters which is composed of LED lamps at both ends of the chain. Moreover, the directional WPT implemented by the topological quasiperiodic chain has the property of topological protection, which is immune to the internal disorder perturbation of the structure. Not only do we apply the asymmetric edge state for directional WPT, but also may further actively control the directional WPT by using the external voltage. In addition, this work provides a flexible platform for designing new WPT devices, such as using the corner states in high-order topological structures or the skin effect in the non-Hermitian topological lattices.

physics.app-ph

Abnormal wave propagation of high-k modes in tilted linear-crossing metamaterials

In this work, we treat the rotation of the optical axis as a new degree of freedom and theoretically propose a tilted linear-crossing metamaterials (TLCMM). Specifically, the conical dispersions of the NLCMM and TLCMM have the same shapes as type-I and type-II Dirac cones, respectively, in condensed matter physics. Upon rotating the optical axis angle such that it is equal to the cone angle, we find that this special TLCMM has the shape of a type-III Dirac cone. This critical TLCMM can have many unique properties and is of a fundamentally different nature than neighboring phases. When EM waves with large wave vectors are incident to a metamaterial with an open IFC to free space, the incident EM wave is strongly reflected due to wave-vector mismatch. Here, we use boundary conditions and the causality law to reveal that TLCMM high-k modes can achieve abnormal refraction without reflection and filtering. Moreover, these phenomenon are observed experimentally in a planar circuit-based system. The circuit-based TLCMM not only provides a versatile platform for the study of robust negative refraction phenomena in metamaterials, but also has a planar structure that is easier to integrate. Our results regarding the manipulation of EM waves may enable their use in planar-integrated photonics including for directional propagation, cloaking, and switching.

physics.optics

Sensitivity of topological edge states in a non-Hermitian dimer chain

Photonic topological edge states in one-dimensional dimer chains have long been thought to be robust to structural perturbations by mapping the topological Su-Schrieffer-Heeger model of a solid-state system. However, the edge states at the two ends of a finite topological dimer chain will interact as a result of near-field coupling. This leads to deviation from topological protection by the chiral symmetry from the exact zero energy, weakening the robustness of the topological edge state. With the aid of non-Hermitian physics, the splitting frequencies of edge states can be degenerated again and topological protection recovered by altering the gain or loss strength of the structure. This point of coalescence is known as the exceptional point (EP). The intriguing physical properties of EPs in topological structures give rise to many fascinating and counterintuitive phenomena. In this work, based on a finite non-Hermitian dimer chain composed of ultra-subwavelength resonators, we propose theoretically and verify experimentally that the sensitivity of topological edge states is greatly affected when the system passes through the EP. Using the EP of a non-Hermitian dimer chain, we realize a new sensor that is sensitive to perturbation at the end of the structure and yet topologically protected from internal perturbation. Our demonstration of a non-Hermitian topological structure with an EP paves the way for the development of novel sensors that are not sensitive to internal manufacturing errors but are highly sensitive to changes in the external environment.

physics.app-ph

Experimental demonstration of an anomalous Floquet topological insulator based on negative-index media

Photonic and acoustic topological insulators exhibiting one-way transportation that is robust against defects and impurities are typically realized in coupled arrays of two-dimensional ring resonators. These systems have produced a series of applications, including optical isolators, delay lines, and lasers. However, the structures are complicated because an additional coupler ring between neighboring rings is needed to construct photonic pseudo-spin. In this work, a photonic analogue of the quantum spin Hall effect is proposed and experimentally demonstrated in an anomalous Floquet topological insulator in the microwave regime. This improved design takes advantage of the efficient and backward coupling of negative-index media. The results contribute to the understanding of topological structures in metamaterials and point toward a new direction for constructing useful topological photonic devices.

physics.app-ph