arXiv subjects

Fang Xu

Publications and source records attributed to Fang Xu.

52 records · Page 3Linked to original sources

arXiv2024

NeuroFly: A framework for whole-brain single neuron reconstruction

Neurons, with their elongated, tree-like dendritic and axonal structures, enable efficient signal integration and long-range communication across brain regions. By reconstructing individual neurons' morphology, we can gain valuable insights into brain connectivity, revealing the structure basis of cognition, movement, and perception. Despite the accumulation of extensive 3D microscopic imaging data, progress has been considerably hindered by the absence of automated tools to streamline this process. Here we introduce NeuroFly, a validated framework for large-scale automatic single neuron reconstruction. This framework breaks down the process into three distinct stages: segmentation, connection, and proofreading. In the segmentation stage, we perform automatic segmentation followed by skeletonization to generate over-segmented neuronal fragments without branches. During the connection stage, we use a 3D image-based path following approach to extend each fragment and connect it with other fragments of the same neuron. Finally, human annotators are required only to proofread the few unresolved positions. The first two stages of our process are clearly defined computer vision problems, and we have trained robust baseline models to solve them. We validated NeuroFly's efficiency using in-house datasets that include a variety of challenging scenarios, such as dense arborizations, weak axons, images with contamination. We will release the datasets along with a suite of visualization and annotation tools for better reproducibility. Our goal is to foster collaboration among researchers to address the neuron reconstruction challenge, ultimately accelerating advancements in neuroscience research. The dataset and code are available at https://github.com/beanli161514/neurofly

cs.CV↗

arXiv2024

Multi-Modal and Multi-Resolution Data Fusion for High-Resolution Cloud Removal: A Novel Baseline and Benchmark

Cloud removal is a significant and challenging problem in remote sensing, and in recent years, there have been notable advancements in this area. However, two major issues remain hindering the development of cloud removal: the unavailability of high-resolution imagery for existing datasets and the absence of evaluation regarding the semantic meaningfulness of the generated structures. In this paper, we introduce M3R-CR, a benchmark dataset for high-resolution Cloud Removal with Multi-Modal and Multi-Resolution data fusion. With this dataset, we consider the problem of cloud removal in high-resolution optical remote sensing imagery by integrating multi-modal and multi-resolution information. In this context, we have to take into account the alignment errors caused by the multi-resolution nature, along with the more pronounced misalignment issues in high-resolution images due to inherent imaging mechanism differences and other factors. Existing multi-modal data fusion based methods, which assume the image pairs are aligned accurately at pixel-level, are thus not appropriate for this problem. To this end, we design a new baseline named Align-CR to perform the low-resolution SAR image guided high-resolution optical image cloud removal. It gradually warps and fuses the features of the multi-modal and multi-resolution data during the reconstruction process, effectively mitigating concerns associated with misalignment. In the experiments, we evaluate the performance of cloud removal by analyzing the quality of visually pleasing textures using image reconstruction metrics and further analyze the generation of semantically meaningful structures using a well-established semantic segmentation task. The proposed Align-CR method is superior to other baseline methods in both areas.

cs.CV↗

arXiv2023

Rethinking Scale Imbalance in Semi-supervised Object Detection for Aerial Images

This paper focuses on the scale imbalance problem of semi-supervised object detection(SSOD) in aerial images. Compared to natural images, objects in aerial images show smaller sizes and larger quantities per image, increasing the difficulty of manual annotation. Meanwhile, the advanced SSOD technique can train superior detectors by leveraging limited labeled data and massive unlabeled data, saving annotation costs. However, as an understudied task in aerial images, SSOD suffers from a drastic performance drop when facing a large proportion of small objects. By analyzing the predictions between small and large objects, we identify three imbalance issues caused by the scale bias, i.e., pseudo-label imbalance, label assignment imbalance, and negative learning imbalance. To tackle these issues, we propose a novel Scale-discriminative Semi-Supervised Object Detection (S^3OD) learning pipeline for aerial images. In our S^3OD, three key components, Size-aware Adaptive Thresholding (SAT), Size-rebalanced Label Assignment (SLA), and Teacher-guided Negative Learning (TNL), are proposed to warrant scale unbiased learning. Specifically, SAT adaptively selects appropriate thresholds to filter pseudo-labels for objects at different scales. SLA balances positive samples of objects at different scales through resampling and reweighting. TNL alleviates the imbalance in negative samples by leveraging information generated by a teacher model. Extensive experiments conducted on the DOTA-v1.5 benchmark demonstrate the superiority of our proposed methods over state-of-the-art competitors. Codes will be released soon.

cs.CV↗

arXiv2023

Neutral and Doubly-Charged Scalars at Future Lepton Colliders

Many new physics scenarios beyond the Standard Model (BSM) necessitate the existence of new neutral and/or charged scalar fields, which might couple to the SM charged leptons (but not hadrons), and thus, can give rise to BSM signals while evading strong constraints mostly coming from the hadronic sector. I show that future lepton colliders provide a clean environment to probe these leptophilic new scalars via multi-lepton final states, including some interesting lepton flavor violating (LFV) channels. I also study the kinematic distributions of the final state leptons to distinguish the BSM contributions from neutral and doubly-charged scalars giving rise to the same final state, as well as from the irreducible SM background.

hep-ph↗

arXiv2023

Augmented Reality for Maintenance Tasks with ChatGPT for Automated Text-to-Action

Advancements in sensor technology, artificial intelligence (AI), and augmented reality (AR) have unlocked opportunities across various domains. AR and large language models like GPT have witnessed substantial progress and are increasingly being employed in diverse fields. One such promising application is in operations and maintenance (O&M). O&M tasks often involve complex procedures and sequences that can be challenging to memorize and execute correctly, particularly for novices or under high-stress situations. By marrying the advantages of superimposing virtual objects onto the physical world, and generating human-like text using GPT, we can revolutionize O&M operations. This study introduces a system that combines AR, Optical Character Recognition (OCR), and the GPT language model to optimize user performance while offering trustworthy interactions and alleviating workload in O&M tasks. This system provides an interactive virtual environment controlled by the Unity game engine, facilitating a seamless interaction between virtual and physical realities. A case study (N=15) is conducted to illustrate the findings and answer the research questions. The results indicate that users can complete similarly challenging tasks in less time using our proposed AR and AI system. Moreover, the collected data also suggests a reduction in cognitive load and an increase in trust when executing the same operations using the AR and AI system.

cs.HC↗

arXiv2023

Probing the muon (g-2) anomaly at the LHC in final states with two muons and two taus

The longstanding muon $(g-2)$ anomaly, as well as the persistent hints of lepton flavor universality violation in $B$-meson decays, could be signaling new physics beyond the Standard Model (SM). A minimal $R$-parity-violating supersymmetric framework with light third-generation sfermions (dubbed as 'RPV3') provides a compelling solution to these flavor anomalies, while simultaneously addressing other pressing issues of the SM. We propose a new RPV3 scenario for the solution of the muon $(g-2)$ anomaly, which leads to an interesting LHC signal of $μ^+μ^-τ^+τ^-$ final state. We analyze the Run-2 LHC multilepton data to derive stringent constraints on the sneutrino mass and the relevant RPV coupling in this scenario. We then propose dedicated selection strategies to improve the bound even with the existing dataset. We also show that the high-luminosity LHC will completely cover the remaining muon $(g-2)$-preferred parameter space, thus providing a robust, independent test of the muon $(g-2)$ anomaly.

hep-ph↗

arXiv2022

GLF-CR: SAR-Enhanced Cloud Removal with Global-Local Fusion

The challenge of the cloud removal task can be alleviated with the aid of Synthetic Aperture Radar (SAR) images that can penetrate cloud cover. However, the large domain gap between optical and SAR images as well as the severe speckle noise of SAR images may cause significant interference in SAR-based cloud removal, resulting in performance degeneration. In this paper, we propose a novel global-local fusion based cloud removal (GLF-CR) algorithm to leverage the complementary information embedded in SAR images. Exploiting the power of SAR information to promote cloud removal entails two aspects. The first, global fusion, guides the relationship among all local optical windows to maintain the structure of the recovered region consistent with the remaining cloud-free regions. The second, local fusion, transfers complementary information embedded in the SAR image that corresponds to cloudy areas to generate reliable texture details of the missing regions, and uses dynamic filtering to alleviate the performance degradation caused by speckle noise. Extensive evaluation demonstrates that the proposed algorithm can yield high quality cloud-free images and outperform state-of-the-art cloud removal algorithms with a gain about 1.7dB in terms of PSNR on SEN12MS-CR dataset.

cs.CV↗

arXiv2022

Hints of Natural Supersymmetry in Flavor Anomalies?

The recent results from the Fermilab muon $g-2$ experiment, as well as the persisting hints of lepton flavor universality violation in $B$-meson decays, present a very strong case for flavor-nonuniversal new physics beyond the Standard Model. We assert that a minimal $R$-parity violating supersymmetric scenario with relatively light third-generation sfermions (dubbed as 'RPV3') provides a natural, well-motivated framework for the simultaneous explanation of all flavor anomalies, while being consistent with a multitude of low-energy flavor constraints, as well as with limits from high-energy collider searches. We further propose complementary tests and distinct signatures of this scenario in the high-$p_T$ searches at current and future colliders. Specifically, we find that an sbottom in the mass range of 2-12 TeV accounts for $R_{D^{(*)}}$ and $R_{K^{(*)}}$ flavor anomalies and it only plays a minor role in the $(g-2)_μ$ anomaly, whereas a sneutrino with mass between 0.7-1 TeV is the dominant player for $(g-2)_μ$. In this context, we propose specific collider signatures of sbottom via its decays to $ \overline{ t}(t) μ^+ μ^-$, and of sneutrino pairs with their decays leading to a highly distinctive and spectacular four-muon final state, which can be used to completely probe the RPV3 parameter space of interest.

hep-ph↗

arXiv2022

Photo-Induced Ultrafast Symmetry Switch in SnSe

Layered tin selenide (SnSe) has recently emerged as a high-performance thermoelectric material with the current record for the figure of merit (ZT) observed in the high-temperature Cmcm phase. So far, access of the Cmcm phase has been mainly obtained via thermal equilibrium methods based on sample heating or application of external pressure, thus restricting the current understanding only to ground-state conditions. Here, we investigate the ultrafast carrier and phononic dynamics in SnSe. Our results demonstrate that optical excitations can transiently switch the point-group symmetry of the crystal from Pnma to Cmcm at room temperature in a few hundreds of femtoseconds with an ultralow threshold for the excitation carrier density. This non-equilibrium Cmcm phase is found to be driven by the displacive excitation of coherent Ag phonons and, given the absence of low-energy thermal phonons, exists in SnSe with the status of 'cold lattice with hot carriers'. Our findings provide important insight for understanding non-equilibrium thermoelectric properties of SnSe.

cond-mat.mtrl-sci↗

arXiv2021

Motion Deblurring with Real Events

In this paper, we propose an end-to-end learning framework for event-based motion deblurring in a self-supervised manner, where real-world events are exploited to alleviate the performance degradation caused by data inconsistency. To achieve this end, optical flows are predicted from events, with which the blurry consistency and photometric consistency are exploited to enable self-supervision on the deblurring network with real-world data. Furthermore, a piece-wise linear motion model is proposed to take into account motion non-linearities and thus leads to an accurate model for the physical formation of motion blurs in the real-world scenario. Extensive evaluation on both synthetic and real motion blur datasets demonstrates that the proposed algorithm bridges the gap between simulated and real-world motion blurs and shows remarkable performance for event-based motion deblurring in real-world scenarios.

cs.CV↗

arXiv2020

Matching Neuromorphic Events and Color Images via Adversarial Learning

The event camera has appealing properties: high dynamic range, low latency, low power consumption and low memory usage, and thus provides complementariness to conventional frame-based cameras. It only captures the dynamics of a scene and is able to capture almost "continuous" motion. However, different from frame-based camera that reflects the whole appearance as scenes are, the event camera casts away the detailed characteristics of objects, such as texture and color. To take advantages of both modalities, the event camera and frame-based camera are combined together for various machine vision tasks. Then the cross-modal matching between neuromorphic events and color images plays a vital and essential role. In this paper, we propose the Event-Based Image Retrieval (EBIR) problem to exploit the cross-modal matching task. Given an event stream depicting a particular object as query, the aim is to retrieve color images containing the same object. This problem is challenging because there exists a large modality gap between neuromorphic events and color images. We address the EBIR problem by proposing neuromorphic Events-Color image Feature Learning (ECFL). Particularly, the adversarial learning is employed to jointly model neuromorphic events and color images into a common embedding space. We also contribute to the community N-UKbench and EC180 dataset to promote the development of EBIR problem. Extensive experiments on our datasets show that the proposed method is superior in learning effective modality-invariant representation to link two different modalities.

cs.CV↗

arXiv2019

Continuous Dropout

Dropout has been proven to be an effective algorithm for training robust deep networks because of its ability to prevent overfitting by avoiding the co-adaptation of feature detectors. Current explanations of dropout include bagging, naive Bayes, regularization, and sex in evolution. According to the activation patterns of neurons in the human brain, when faced with different situations, the firing rates of neurons are random and continuous, not binary as current dropout does. Inspired by this phenomenon, we extend the traditional binary dropout to continuous dropout. On the one hand, continuous dropout is considerably closer to the activation characteristics of neurons in the human brain than traditional binary dropout. On the other hand, we demonstrate that continuous dropout has the property of avoiding the co-adaptation of feature detectors, which suggests that we can extract more independent feature detectors for model averaging in the test stage. We introduce the proposed continuous dropout to a feedforward neural network and comprehensively compare it with binary dropout, adaptive dropout, and DropConnect on MNIST, CIFAR-10, SVHN, NORB, and ILSVRC-12. Thorough experiments demonstrate that our method performs better in preventing the co-adaptation of feature detectors and improves test performance. The code is available at: https://github.com/jasonustc/caffe-multigpu/tree/dropout.

cs.CV↗

arXiv2019

Sputtered Spontaneously Nano-porous VO2-based Films via PTFE Self-Template: Localized Surface Plasmon Resonance Induced Robust Optical Performance for Solar Glazing Application

The PTFE (Teflon) has been selected as the self-template structural material in preparation of VO2 films using reactive magnetron sputtering systems and post annealing progress. Spontaneous random nano-porous structures of VO2 films growing on quartz glasses have been deliberately established via bottom-up processing through this novel and facile approach. The nano-porous VO2 films exhibit an excellent optical performance based on localized surface plasmon resonance (LSPR), with ultrahigh luminous transmittance (Tlum) up to 78.0% and the promoted solar modulation ability (ΔTsol) of 14.1%. Meanwhile, the ingenious microstructure of film provides an antireflection function from multiple perspectives in visible light, with the potential of the windshield on vehicles for smart solar modulation. The nano-porous films expand the practical application of thermochromic VO2 to a fire-new field, breaking the optical performance envelope of single-layer dense VO2 film away, and offering a universal method to prepare homogeneous nano-porous structures for thin films.

physics.app-ph↗

arXiv2011

Gamma-Dirichlet Structure and Two Classes of Measure-valued Processes

The Gamma-Dirichlet structure corresponds to the decomposition of the gamma process into the independent product of a gamma random variable and a Dirichlet process. This structure allows us to study the properties of the Dirichlet process through the gamma process and vice versa. In this article, we begin with a brief review of existing results concerning the Gamma-Dirichlet structure. New results are obtained for the large deviations of the jump sizes of the gamma process and the quasi-invariance of the two-parameter Poisson-Dirichlet distribution. The laws of the gamma process and the Dirichlet process are the respective reversible measures of the measure-valued branching diffusion with immigration and the Fleming-Viot process with parent independent mutation. We view the relation between these two classes of measure-valued processes as the dynamical Gamma-Dirichlet structure. Other results of this article include the derivation of the transition function of the Fleming-Viot process with parent independent mutation from the transition function of the measure-valued branching diffusion with immigration, and the establishment of the reversibility of the latter. One of these is related to an open problem by Ethier and Griffiths and the other leads to an alternative proof of the reversibility of the Fleming-Viot process.

math.PR↗

arXiv2005

Design of Block Transceivers with Decision Feedback Detection

This paper presents a method for jointly designing the transmitter-receiver pair in a block-by-block communication system that employs (intra-block) decision feedback detection. We provide closed-form expressions for transmitter-receiver pairs that simultaneously minimize the arithmetic mean squared error (MSE) at the decision point (assuming perfect feedback), the geometric MSE, and the bit error rate of a uniformly bit-loaded system at moderate-to-high signal-to-noise ratios. Separate expressions apply for the ``zero-forcing'' and ``minimum MSE'' (MMSE) decision feedback structures. In the MMSE case, the proposed design also maximizes the Gaussian mutual information and suggests that one can approach the capacity of the block transmission system using (independent instances of) the same (Gaussian) code for each element of the block. Our simulation studies indicate that the proposed transceivers perform significantly better than standard transceivers, and that they retain their performance advantages in the presence of error propagation.

cs.IT↗

arXiv2005

Surface Shape of Two-Dimensional Granular Piles

We study the surface shape of two-dimensional piles using experiments and a continuum theory for surface flows of granular materials (the BCRE equations). We first obtain an analytical solution to the BCRE equations with a simple transformation and show that the surface shapes thereby predicted are in good agreement with the experimental results. By means of such an analytical solution, we find that the formation of the curved tails at the bottom of such piles depends not only on the properties of the granular materials but also on the drift velocity of the grains within the rolling layer.

cond-mat.soft↗