arXiv subjects

Fei Gao

Publications and source records attributed to Fei Gao.

At least 199 records · Page 11Linked to original sources

arXiv2024

Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Acoustic-Resolution Photoacoustic Microscopy (AR-PAM) is promising for subcutaneous vascular imaging, but its spatial resolution is constrained by the Point Spread Function (PSF). Traditional deconvolution methods like Richardson-Lucy and model-based deconvolution use the PSF to improve resolution. However, accurately measuring the PSF is difficult, leading to reliance on less accurate blind deconvolution techniques. Additionally, AR-PAM suffers from long scanning times, which can be reduced via down-sampling, but this necessitates effective image recovery from under-sampled data, a task where traditional interpolation methods fall short, particularly at high under-sampling rates. To address these challenges, we propose an approach based on Implicit Neural Representations (INR). This method learns a continuous mapping from spatial coordinates to initial acoustic pressure, overcoming the limitations of discrete imaging and enhancing AR-PAM's resolution. By treating the PSF as a learnable parameter within the INR framework, our technique mitigates inaccuracies associated with PSF estimation. We evaluated our method on simulated vascular data, showing significant improvements in Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) over conventional methods. Qualitative enhancements were also observed in leaf vein and in vivo mouse brain microvasculature images. When applied to a custom AR-PAM system, experiments with pencil lead demonstrated that our method delivers sharper, higher-resolution results, indicating its potential to advance photoacoustic microscopy.

cs.CV↗

arXiv2024

Learning to Plan Maneuverable and Agile Flight Trajectory with Optimization Embedded Networks

In recent times, an increasing number of researchers have been devoted to utilizing deep neural networks for end-to-end flight navigation. This approach has gained traction due to its ability to bridge the gap between perception and planning that exists in traditional methods, thereby eliminating delays between modules. However, the practice of replacing original modules with neural networks in a black-box manner diminishes the overall system's robustness and stability. It lacks principled explanations and often fails to consistently generate high-quality motion trajectories. Furthermore, such methods often struggle to rigorously account for the robot's kinematic constraints, resulting in the generation of trajectories that cannot be executed satisfactorily. In this work, we combine the advantages of traditional methods and neural networks by proposing an optimization-embedded neural network. This network can learn high-quality trajectories directly from visual inputs without the need of mapping, while ensuring dynamic feasibility. Here, the deep neural network is employed to directly extract environment safety regions from depth images. Subsequently, we employ a model-based approach to represent these regions as safety constraints in trajectory optimization. Leveraging the availability of highly efficient optimization algorithms, our method robustly converges to feasible and optimal solutions that satisfy various user-defined constraints. Moreover, we differentiate the optimization process, allowing it to be trained as a layer within the neural network. This approach facilitates the direct interaction between perception and planning, enabling the network to focus more on the spatial regions where optimal solutions exist. As a result, it further enhances the quality and stability of the generated trajectories.

cs.RO↗

arXiv2024

HGS-Planner: Hierarchical Planning Framework for Active Scene Reconstruction Using 3D Gaussian Splatting

In complex missions such as search and rescue,robots must make intelligent decisions in unknown environments, relying on their ability to perceive and understand their surroundings. High-quality and real-time reconstruction enhances situational awareness and is crucial for intelligent robotics. Traditional methods often struggle with poor scene representation or are too slow for real-time use. Inspired by the efficacy of 3D Gaussian Splatting (3DGS), we propose a hierarchical planning framework for fast and high-fidelity active reconstruction. Our method evaluates completion and quality gain to adaptively guide reconstruction, integrating global and local planning for efficiency. Experiments in simulated and real-world environments show our approach outperforms existing real-time methods.

cs.RO↗

arXiv2024

All-optical ultrafast arbitrary rotation of hole orbital qubits with direct phase control

Complete quantum control of a stationary quantum bit embedded in a quantum emitter is crucial for photonic quantum information technologies. Recently, the orbital degree of freedom in optically active quantum dots has emerged as a promising candidate. However, the essential ability to perform arbitrary rotations on orbital qubits remains elusive. Here, we demonstrate arbitrary rotation of a hole orbital qubit with direct phase control using picosecond optical pulses. This is achieved by successfully inducing stimulated Raman transitions within $Λ$ systems coupled via radiative Auger processes. The new capability enables direct control of polar and azimuth angles of the Bloch vector without requiring timed precession. Our results establish orbital states in solid-state quantum emitters as a viable resource for applications in high-speed quantum information processing.

quant-ph↗

arXiv2024

Strange-metal behavior without fine-tuning in PrV2Al20

Strange-metal behavior observed in the praseodymium-based heavy-fermion material PrV2Al20 has been tentatively interpreted in the framework of proximity to a quantum critical point (QCP) associated with quadrupolar ordering. Here, we demonstrate that an alternative, natural explanation exists without invoking a QCP, in terms of the unconventional nature of the quadrupolar Kondo effect taking place in non-Kramers ions. Using a combination of ab initio density-functional theory calculations and analytical arguments, we construct a periodic Anderson model with realistic parameters to describe PrV2Al20. We solve the model using dynamical mean-field theory preserving the model symmetries and demonstrate the non-Fermi liquid strange-metal behavior stemming from the two-channel nature of the quadrupolar Kondo effect. Our calculations provide an explanation for the puzzling temperature dependence in the magnetic susceptibility, and provide a basis for analyzing future photoemission experiments.

cond-mat.str-el↗

arXiv2024

Audio-Guided Fusion Techniques for Multimodal Emotion Analysis

In this paper, we propose a solution for the semi-supervised learning track (MER-SEMI) in MER2024. First, in order to enhance the performance of the feature extractor on sentiment classification tasks,we fine-tuned video and text feature extractors, specifically CLIP-vit-large and Baichuan-13B, using labeled data. This approach effectively preserves the original emotional information conveyed in the videos. Second, we propose an Audio-Guided Transformer (AGT) fusion mechanism, which leverages the robustness of Hubert-large, showing superior effectiveness in fusing both inter-channel and intra-channel information. Third, To enhance the accuracy of the model, we iteratively apply self-supervised learning by using high-confidence unlabeled data as pseudo-labels. Finally, through black-box probing, we discovered an imbalanced data distribution between the training and test sets. Therefore, We adopt a prior-knowledge-based voting mechanism. The results demonstrate the effectiveness of our strategy, ultimately earning us third place in the MER-SEMI track.

cs.SD↗

arXiv2024

Implicit Neural Representation for Sparse-view Photoacoustic Computed Tomography

High-quality imaging in photoacoustic computed tomography (PACT) usually requires a high-channel count system for dense spatial sampling around the object to avoid aliasing-related artefacts. To reduce system complexity, various image reconstruction approaches, such as model-based (MB) and deep learning based methods, have been explored to mitigate the artefacts associated with sparse-view acquisition. However, the explored methods formulated the reconstruction problem in a discrete framework, making it prone to measurement errors, discretization errors, and the extend of the ill-poseness of the problem scales with the discretization resolution. In this work, an implicit neural representation (INR) framework is proposed for image reconstruction in PACT with ring transducer arrays to address these issues. pecially, the initial heat distribution is represented as a continuous function of spatial coordinates using a multi-layer perceptron (MLP). The weights of the MLP are then determined by a training process in a self-supervised manner, by minimizing the errors between the measured and model predicted PA signals. After training, PA images can be mapped by feeding the coordinates to the network. Simulation and phantom experiments showed that the INR method performed best in preserving image fidelity and in artefacts suppression for the same acquisition condition, compared to universal back-projection and MB methods.

eess.IV↗

arXiv2024

Whole-Body Control Through Narrow Gaps From Pixels To Action

Flying through body-size narrow gaps in the environment is one of the most challenging moments for an underactuated multirotor. We explore a purely data-driven method to master this flight skill in simulation, where a neural network directly maps pixels and proprioception to continuous low-level control commands. This learned policy enables whole-body control through gaps with different geometries demanding sharp attitude changes (e.g., near-vertical roll angle). The policy is achieved by successive model-free reinforcement learning (RL) and online observation space distillation. The RL policy receives (virtual) point clouds of the gaps' edges for scalable simulation and is then distilled into the high-dimensional pixel space. However, this flight skill is fundamentally expensive to learn by exploring due to restricted feasible solution space. We propose to reset the agent as states on the trajectories by a model-based trajectory optimizer to alleviate this problem. The presented training pipeline is compared with baseline methods, and ablation studies are conducted to identify the key ingredients of our method. The immediate next step is to scale up the variation of gap sizes and geometries in anticipation of emergent policies and demonstrate the sim-to-real transformation.

cs.RO↗

arXiv2024

Channel Modeling Framework for Both Communications and Bistatic Sensing Under 3GPP Standard

Integrated sensing and communications (ISAC) is considered a promising technology in the B5G/6G networks. The channel model is essential for an ISAC system to evaluate the communication and sensing performance. Most existing channel modeling studies focus on the monostatic ISAC channel. In this paper, the channel modeling framework for bistatic ISAC is considered. The proposed channel modeling framework extends the current 3GPP channel modeling framework and ensures the compatibility with the communication channel model. To support the bistatic sensing function, several key features for sensing are added. First, more clusters with weaker power are generated and retained to characterize the potential sensing targets. Second, the target model can be either deterministic or statistical, based on different sensing scenarios. Furthermore, for the statistical case, different reflection models are employed in the generation of rays, taking into account spatial coherence. The effectiveness of the proposed bistatic ISAC channel model framework is validated by both ray tracing simulations and experiment studies. The compatibility with the 3GPP communication channel model and how to use this framework for sensing evaluation are also demonstrated.

eess.SP↗

arXiv2024

Lee-Yang edge singularities in QCD via the Dyson-Schwinger Equations

We take the Dyson-Schwinger Equation approach of QCD for the quark propagator at complex chemical potential to study the QCD phase transition. The phase transition line of the $(2+1)$-flavor QCD matter in the imaginary chemical potential region is computed via a simplified truncation scheme, whose curvature is found to be consistent with the one at real chemical potential. Moreover, the computation in the complex chemical potential plane allows us to determine the location of the Lee-Yang edge singularities. We show explicitly that the critical end point coincides with the Lee-Yang edge singularities on the real $μ_{B}^{}$ axis. We also investigate the scaling behavior of the singularities and discuss the possibility of extrapolating the CEP from a certain range of chemical potential.

hep-ph↗

arXiv2024

Bundle-specific Tractogram Distribution Estimation Using Higher-order Streamline Differential Equation

Tractography traces the peak directions extracted from fiber orientation distribution (FOD) suffering from ambiguous spatial correspondences between diffusion directions and fiber geometry, which is prone to producing erroneous tracks while missing true positive connections. The peaks-based tractography methods 'locally' reconstructed streamlines in 'single to single' manner, thus lacking of global information about the trend of the whole fiber bundle. In this work, we propose a novel tractography method based on a bundle-specific tractogram distribution function by using a higher-order streamline differential equation, which reconstructs the streamline bundles in 'cluster to cluster' manner. A unified framework for any higher-order streamline differential equation is presented to describe the fiber bundles with disjoint streamlines defined based on the diffusion tensor vector field. At the global level, the tractography process is simplified as the estimation of bundle-specific tractogram distribution (BTD) coefficients by minimizing the energy optimization model, and is used to characterize the relations between BTD and diffusion tensor vector under the prior guidance by introducing the tractogram bundle information to provide anatomic priors. Experiments are performed on simulated Hough, Sine, Circle data, ISMRM 2015 Tractography Challenge data, FiberCup data, and in vivo data from the Human Connectome Project (HCP) data for qualitative and quantitative evaluation. The results demonstrate that our approach can reconstruct the complex global fiber bundles directly. BTD reduces the error deviation and accumulation at the local level and shows better results in reconstructing long-range, twisting, and large fanning tracts.

cs.CV↗

arXiv2024

Hardware Architecture Design of Model-Based Image Reconstruction Towards Palm-size Photoacoustic Tomography

Photoacoustic (PA) imaging technology combines the advantages of optical imaging and ultrasound imaging, showing great potential in biomedical applications. Many preclinical studies and clinical applications urgently require fast, high-quality, low-cost and portable imaging system. Translating advanced image reconstruction algorithms into hardware implementations is highly desired. However, existing iterative PA image reconstructions, although exhibit higher accuracy than delay-and-sum algorithm, suffer from high computational cost. In this paper, we introduce a model-based hardware acceleration architecture based on superposed Wave (s-Wave) for palm-size PA tomography (palm-PAT), aiming at enhancing both the speed and performance of image reconstruction at a much lower system cost. To achieve this, we propose an innovative data reuse method that significantly reduces hardware storage resource consumption. We conducted experiments by FPGA implementation of the algorithm, using both phantoms and in vivo human finger data to verify the feasibility of the proposed method. The results demonstrate that our proposed architecture can substantially reduce system cost while maintaining high imaging performance. The hardware-accelerated implementation of the model-based algorithm achieves a speedup of up to approximately 270 times compared to the CPU, while the corresponding energy efficiency ratio is improved by more than 2700 times.

eess.IV↗

arXiv2024

LF-3PM: a LiDAR-based Framework for Perception-aware Planning with Perturbation-induced Metric

Just as humans can become disoriented in featureless deserts or thick fogs, not all environments are conducive to the Localization Accuracy and Stability (LAS) of autonomous robots. This paper introduces an efficient framework designed to enhance LiDAR-based LAS through strategic trajectory generation, known as Perception-aware Planning. Unlike vision-based frameworks, the LiDAR-based requires different considerations due to unique sensor attributes. Our approach focuses on two main aspects: firstly, assessing the impact of LiDAR observations on LAS. We introduce a perturbation-induced metric to provide a comprehensive and reliable evaluation of LiDAR observations. Secondly, we aim to improve motion planning efficiency. By creating a Static Observation Loss Map (SOLM) as an intermediary, we logically separate the time-intensive evaluation and motion planning phases, significantly boosting the planning process. In the experimental section, we demonstrate the effectiveness of the proposed metrics across various scenes and the feature of trajectories guided by different metrics. Ultimately, our framework is tested in a real-world scenario, enabling the robot to actively choose topologies and orientations preferable for localization. The source code is accessible at https://github.com/ZJU-FAST-Lab/LF-3PM.

cs.RO↗

arXiv2024

Intention-Aware Planner for Robust and Safe Aerial Tracking

Autonomous target tracking with quadrotors has wide applications in many scenarios, such as cinematographic follow-up shooting or suspect chasing. Target motion prediction is necessary when designing the tracking planner. However, the widely used constant velocity or constant rotation assumption can not fully capture the dynamics of the target. The tracker may fail when the target happens to move aggressively, such as sudden turn or deceleration. In this paper, we propose an intention-aware planner by additionally considering the intention of the target to enhance safety and robustness in aerial tracking applications. Firstly, a designated intention prediction method is proposed, which combines a user-defined potential assessment function and a state observation function. A reachable region is generated to specifically evaluate the turning intentions. Then we design an intention-driven hybrid A* method to predict the future possible positions for the target. Finally, an intention-aware optimization approach is designed to generate a spatial-temporal optimal trajectory, allowing the tracker to perceive unexpected situations from the target. Benchmark comparisons and real-world experiments are conducted to validate the performance of our method.

cs.RO↗

arXiv2024

WING: Wheel-Inertial Neural Odometry with Ground Manifold Constraints

In this paper, we propose an interoceptive-only odometry system for ground robots with neural network processing and soft constraints based on the assumption of a globally continuous ground manifold. Exteroceptive sensors such as cameras, GPS and LiDAR may encounter difficulties in scenarios with poor illumination, indoor environments, dusty areas and straight tunnels. Therefore, improving the pose estimation accuracy only using interoceptive sensors is important to enhance the reliability of navigation system even in degrading scenarios mentioned above. However, interoceptive sensors like IMU and wheel encoders suffer from large drift due to noisy measurements. To overcome these challenges, the proposed system trains deep neural networks to correct the measurements from IMU and wheel encoders, while considering their uncertainty. Moreover, because ground robots can only travel on the ground, we model the ground surface as a globally continuous manifold using a dual cubic B-spline manifold to further improve the estimation accuracy by this soft constraint. A novel space-based sliding-window filtering framework is proposed to fully exploit the $C^2$ continuity of ground manifold soft constraints and fuse all the information from raw measurements and neural networks in a yaw-independent attitude convention. Extensive experiments demonstrate that our proposed approach can outperform state-of-the-art learning-based interoceptive-only odometry methods.

cs.RO↗

arXiv2024

Contact interaction study of proton parton distributions

Using a symmetry-preserving formulation of a vector$\,\times\,$vector contact interaction (SCI) and treating the proton as a quark + interacting-diquark bound state, whose structure is obtained by solving a Poincaré-covariant Faddeev equation, we provide a comprehensive, coherent set of predictions for unpolarised and polarised proton parton distribution functions (DFs): valence, glue, and four-flavour separated sea. The results enable many themes to be addressed, including: the asymmetry of antimatter in the proton; the neutron:proton structure function ratio; helicity retention in hard scattering processes; the charm quark momentum fraction; the sign and size of the polarised gluon DF; and the origin of the proton spin. In all cases where sound analyses of data are available, SCI predictions are semiquantitatively in agreement with the results. Those mismatches which exist are typically attributable to the momentum-independence of the underlying interaction. Judiciously interpreted, the SCI delivers a sound and insightful explanation of proton structure as expressed in DFs.

hep-ph↗

arXiv2024

Statistical Localization of Electromagnetic Signals in Disordered Time-Varying Cavity

In this letter, we investigate the statistical properties of electromagnetic signals after different times of duration within one-dimensional local-disordered time-varying cavities, where both spatial and temporal disorders are added. Our findings reveal that, in the vast majority of cases, adequate temporal disorder in local space can make the electromagnetic field statistically localized, obeying a normal distribution at a specific point in time of arbitrary location within the cavity. We employ the concept of disordered space-time crystals and leverage Lindeberg's and Lyapunov's theorems to theoretically prove the normal distribution of the field values. Furthermore, we find that with the increase of energy provided by time variation, the probability of extreme fields will significantly increase and the field intensity eventually is de-normalized, that is, deviating from the normal distribution. This study not only sheds light on the statistical properties of transient signals in local-disordered time-varying systems but also paves the way for further exploration in wave dynamics of analogous systems.

cond-mat.dis-nn↗

arXiv2024

Learning Speed Adaptation for Flight in Clutter

Animals learn to adapt speed of their movements to their capabilities and the environment they observe. Mobile robots should also demonstrate this ability to trade-off aggressiveness and safety for efficiently accomplishing tasks. The aim of this work is to endow flight vehicles with the ability of speed adaptation in prior unknown and partially observable cluttered environments. We propose a hierarchical learning and planning framework where we utilize both well-established methods of model-based trajectory generation and trial-and-error that comprehensively learns a policy to dynamically configure the speed constraint. Technically, we use online reinforcement learning to obtain the deployable policy. The statistical results in simulation demonstrate the advantages of our method over the constant speed constraint baselines and an alternative method in terms of flight efficiency and safety. In particular, the policy behaves perception awareness, which distinguish it from alternative approaches. By deploying the policy to hardware, we verify that these advantages can be brought to the real world.

cs.RO↗