Searcharxiv⌕ Search

arXiv subjects

Feng Yang

Publications and source records attributed to Feng Yang.

At least 91 records · Page 5Linked to original sources
arXiv2024

van Hove Singularity-Driven Emergence of Multiple Flat Bands in Kagome Superconductors

The newly discovered Kagome superconductors AV$_3$Sb$_5$ (A=K, Rb and Cs) continue to bring surprises in generating unusual phenomena and physical properties, including anomalous Hall effect, unconventional charge density wave, electronic nematicity and time-reversal symmetry breaking. Here we report an unexpected emergence of multiple flat bands in the AV$_3$Sb$_5$ superconductors. By performing high-resolution angle-resolved photoemission (ARPES) measurements, we observed four branches of flat bands that span over the entire momentum space. The appearance of the flat bands is not anticipated from the band structure calculations and cannot be accounted for by the known mechanisms of flat band generation. It is intimately related to the evolution of van Hove singularities. It is for the first time to observe such emergence of multiple flat bands in solid materials. Our findings provide new insights in revealing the underlying mechanism that governs the unusual behaviors in the Kagome superconductors. They also provide a new pathway in producing flat bands and set a platform to study the flat bands related physics.

cond-mat.mtrl-sci↗
arXiv2024

Unveiling the early stage evolution of local atomic structures in the crystallization process of a metallic glass

The early stage evolution of local atomic structures in a multicomponent metallic glass during its crystallization process has been investigated via molecular dynamics simulation. It is found that the initial thermal stability and earliest stage evolution of the local atomic clusters show no strong correlation with their initial short-range orders, and this leads to an observation of a novel symmetry convergence phenomenon, which can be understood as an atomic structure manifestation of the ergodicity. Furthermore, in our system we have quantitatively proved that the crucial factor for the thermal stability against crystallization exhibited by the metallic glass, is not the total amount of icosahedral clusters, but the degree of global connectivity among them.

cond-mat.mtrl-sci↗
arXiv2024

MLE-based Device Activity Detection under Rician Fading for Massive Grant-free Access with Perfect and Imperfect Synchronization

Most existing studies on massive grant-free access, proposed to support massive machine-type communications (mMTC) for the Internet of things (IoT), assume Rayleigh fading and perfect synchronization for simplicity. However, in practice, line-of-sight (LoS) components generally exist, and time and frequency synchronization are usually imperfect. This paper systematically investigates maximum likelihood estimation (MLE)-based device activity detection under Rician fading for massive grant-free access with perfect and imperfect synchronization. We assume that the large-scale fading powers, Rician factors, and normalized LoS components can be estimated offline. We formulate device activity detection in the synchronous case and joint device activity and offset detection in three asynchronous cases (i.e., time, frequency, and time and frequency asynchronous cases) as MLE problems. In the synchronous case, we propose an iterative algorithm to obtain a stationary point of the MLE problem. In each asynchronous case, we propose two iterative algorithms with identical detection performance but different computational complexities. In particular, one is computationally efficient for small ranges of offsets, whereas the other one, relying on fast Fourier transform (FFT) and inverse FFT, is computationally efficient for large ranges of offsets. The proposed algorithms generalize the existing MLE-based methods for Rayleigh fading and perfect synchronization. Numerical results show that the proposed algorithm for the synchronous case can reduce the detection error probability by up to 50.4% at a 78.6% computation time increase, compared to the MLEbased state-of-the-art, and the proposed algorithms for the three asynchronous cases can reduce the detection error probabilities and computation times by up to 65.8% and 92.0%, respectively, compared to the MLE-based state-of-the-arts.

cs.IT↗
arXiv2023

Intrinsic Electronic Structure and Nodeless Superconducting Gap of $\mathrm{YBa_{2} Cu_{3} O_{7-δ} }$ Observed by Spatially-Resolved Laser-Based Angle Resolved Photoemission Spectroscopy

The spatially-resolved laser-based high resolution ARPES measurements have been performed on the optimally-doped $\mathrm{YBa_{2} Cu_{3} O_{7-δ} }$ (Y123) superconductor. For the first time, we found the region from the cleaved surface that reveals clear bulk electronic properties. The intrinsic Fermi surface and band structures of Y123 are observed. The Fermi surface-dependent and momentum-dependent superconducting gap is determined which is nodeless and consistent with the d+is gap form.

cond-mat.supr-con↗
arXiv2023

A Surrogate-Assisted Extended Generative Adversarial Network for Parameter Optimization in Free-Form Metasurface Design

Metasurfaces have widespread applications in fifth-generation (5G) microwave communication. Among the metasurface family, free-form metasurfaces excel in achieving intricate spectral responses compared to regular-shape counterparts. However, conventional numerical methods for free-form metasurfaces are time-consuming and demand specialized expertise. Alternatively, recent studies demonstrate that deep learning has great potential to accelerate and refine metasurface designs. Here, we present XGAN, an extended generative adversarial network (GAN) with a surrogate for high-quality free-form metasurface designs. The proposed surrogate provides a physical constraint to XGAN so that XGAN can accurately generate metasurfaces monolithically from input spectral responses. In comparative experiments involving 20000 free-form metasurface designs, XGAN achieves 0.9734 average accuracy and is 500 times faster than the conventional methodology. This method facilitates the metasurface library building for specific spectral responses and can be extended to various inverse design problems, including optical metamaterials, nanophotonic devices, and drug discovery.

cs.LG↗
arXiv2023

Uncovering the effects of model initialization on deep model generalization: A study with adult and pediatric Chest X-ray images

Model initialization techniques are vital for improving the performance and reliability of deep learning models in medical computer vision applications. While much literature exists on non-medical images, the impacts on medical images, particularly chest X-rays (CXRs) are less understood. Addressing this gap, our study explores three deep model initialization techniques: Cold-start, Warm-start, and Shrink and Perturb start, focusing on adult and pediatric populations. We specifically focus on scenarios with periodically arriving data for training, thereby embracing the real-world scenarios of ongoing data influx and the need for model updates. We evaluate these models for generalizability against external adult and pediatric CXR datasets. We also propose novel ensemble methods: F-score-weighted Sequential Least-Squares Quadratic Programming (F-SLSQP) and Attention-Guided Ensembles with Learnable Fuzzy Softmax to aggregate weight parameters from multiple models to capitalize on their collective knowledge and complementary representations. We perform statistical significance tests with 95% confidence intervals and p-values to analyze model performance. Our evaluations indicate models initialized with ImageNet-pre-trained weights demonstrate superior generalizability over randomly initialized counterparts, contradicting some findings for non-medical images. Notably, ImageNet-pretrained models exhibit consistent performance during internal and external testing across different training scenarios. Weight-level ensembles of these models show significantly higher recall (p<0.05) during testing compared to individual models. Thus, our study accentuates the benefits of ImageNet-pretrained weight initialization, especially when used with weight-level ensembles, for creating robust and generalizable deep learning solutions.

cs.CV↗
arXiv2023

Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection

Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets. Despite the challenges posed by the numerous interaction combinations, they also offer opportunities for multimodal learning of visual texts. In this paper, we present a systematic and unified framework (RmLR) that enhances HOI detection by incorporating structured text knowledge. Firstly, we qualitatively and quantitatively analyze the loss of interaction information in the two-stage HOI detector and propose a re-mining strategy to generate more comprehensive visual representation.Secondly, we design more fine-grained sentence- and word-level alignment and knowledge transfer strategies to effectively address the many-to-many matching problem between multiple interactions and multiple texts.These strategies alleviate the matching confusion problem that arises when multiple interactions occur simultaneously, thereby improving the effectiveness of the alignment process. Finally, HOI reasoning by visual features augmented with textual knowledge substantially improves the understanding of interactions. Experimental results illustrate the effectiveness of our approach, where state-of-the-art performance is achieved on public benchmarks. We further analyze the effects of different components of our approach to provide insights into its efficacy.

cs.CV↗
arXiv2023

Semantically Redundant Training Data Removal and Deep Model Classification Performance: A Study with Chest X-rays

Deep learning (DL) has demonstrated its innate capacity to independently learn hierarchical features from complex and multi-dimensional data. A common understanding is that its performance scales up with the amount of training data. Another data attribute is the inherent variety. It follows, therefore, that semantic redundancy, which is the presence of similar or repetitive information, would tend to lower performance and limit generalizability to unseen data. In medical imaging data, semantic redundancy can occur due to the presence of multiple images that have highly similar presentations for the disease of interest. Further, the common use of augmentation methods to generate variety in DL training may be limiting performance when applied to semantically redundant data. We propose an entropy-based sample scoring approach to identify and remove semantically redundant training data. We demonstrate using the publicly available NIH chest X-ray dataset that the model trained on the resulting informative subset of training data significantly outperforms the model trained on the full training set, during both internal (recall: 0.7164 vs 0.6597, p<0.05) and external testing (recall: 0.3185 vs 0.2589, p<0.05). Our findings emphasize the importance of information-oriented training sample selection as opposed to the conventional practice of using all available training data.

cs.CV↗
arXiv2023

Forward-Forward Training of an Optical Neural Network

Neural networks (NN) have demonstrated remarkable capabilities in various tasks, but their computation-intensive nature demands faster and more energy-efficient hardware implementations. Optics-based platforms, using technologies such as silicon photonics and spatial light modulators, offer promising avenues for achieving this goal. However, training multiple trainable layers in tandem with these physical systems poses challenges, as they are difficult to fully characterize and describe with differentiable functions, hindering the use of error backpropagation algorithm. The recently introduced Forward-Forward Algorithm (FFA) eliminates the need for perfect characterization of the learning system and shows promise for efficient training with large numbers of programmable parameters. The FFA does not require backpropagating an error signal to update the weights, rather the weights are updated by only sending information in one direction. The local loss function for each set of trainable weights enables low-power analog hardware implementations without resorting to metaheuristic algorithms or reinforcement learning. In this paper, we present an experiment utilizing multimode nonlinear wave propagation in an optical fiber demonstrating the feasibility of the FFA approach using an optical system. The results show that incorporating optical transforms in multilayer NN architectures trained with the FFA, can lead to performance improvements, even with a relatively small number of trainable weights. The proposed method offers a new path to the challenge of training optical NNs and provides insights into leveraging physical transformations for enhancing NN performance.

cs.LG↗
arXiv2023

ARPES Detection of Superconducting Gap Sign in Unconventional Superconductors

Superconductivity is realized by opening a gap in the superconducting state. The gap symmetry is crucial in understanding the underlying superconductivity mechanism. The magnitude and the phase are essential in fully characterizing the superconducting gap. Angle-resolved photoemission spectroscopy (ARPES) has played a key role in determining the gap symmetry in unconventional superconductors. However, it has been considered so far that ARPES can only measure the magnitude of the superconducting gap but not its phase; the phase has to be detected by other phase-sensitive techniques. Here we propose a new method to directly detect the superconducting gap sign by using ARPES. This method is successfully validated in a cuprate superconductor with a well-known $d$-wave gap symmetry. When two bands are nearby in momentum space and have a strong interband interaction, the resulted electronic structures in the superconducting state are sensitive to the relative gap sign between the two bands which can be captured by ARPES measurements. Our present work provides a new way to detect the gap sign and can be applied to various superconductors, particularly those with multiple orbitals like the iron-based superconductors. It also makes ARPES more powerful to determine both the gap magnitude and the phase that are significant in understanding the superconductivity mechanism of unconventional superconductors.

cond-mat.supr-con↗
arXiv2023

SVDiff: Compact Parameter Space for Diffusion Fine-Tuning

Diffusion models have achieved remarkable success in text-to-image generation, enabling the creation of high-quality images from text prompts or other modalities. However, existing methods for customizing these models are limited by handling multiple personalized subjects and the risk of overfitting. Moreover, their large number of parameters is inefficient for model storage. In this paper, we propose a novel approach to address these limitations in existing text-to-image diffusion models for personalization. Our method involves fine-tuning the singular values of the weight matrices, leading to a compact and efficient parameter space that reduces the risk of overfitting and language drifting. We also propose a Cut-Mix-Unmix data-augmentation technique to enhance the quality of multi-subject image generation and a simple text-based image editing framework. Our proposed SVDiff method has a significantly smaller model size compared to existing methods (approximately 2,200 times fewer parameters compared with vanilla DreamBooth), making it more practical for real-world applications.

cs.CV↗
arXiv2023

VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining

Assessing the aesthetics of an image is challenging, as it is influenced by multiple factors including composition, color, style, and high-level semantics. Existing image aesthetic assessment (IAA) methods primarily rely on human-labeled rating scores, which oversimplify the visual aesthetic information that humans perceive. Conversely, user comments offer more comprehensive information and are a more natural way to express human opinions and preferences regarding image aesthetics. In light of this, we propose learning image aesthetics from user comments, and exploring vision-language pretraining methods to learn multimodal aesthetic representations. Specifically, we pretrain an image-text encoder-decoder model with image-comment pairs, using contrastive and generative objectives to learn rich and generic aesthetic semantics without human labels. To efficiently adapt the pretrained model for downstream IAA tasks, we further propose a lightweight rank-based adapter that employs text as an anchor to learn the aesthetic ranking concept. Our results show that our pretrained aesthetic vision-language model outperforms prior works on image aesthetic captioning over the AVA-Captions dataset, and it has powerful zero-shot capability for aesthetic tasks such as zero-shot style classification and zero-shot IAA, surpassing many supervised baselines. With only minimal finetuning parameters using the proposed adapter module, our model achieves state-of-the-art IAA performance over the AVA dataset.

cs.CV↗
arXiv2023

Generalizability of Deep Adult Lung Segmentation Models to the Pediatric Population: A Retrospective Study

Lung segmentation in chest X-rays (CXRs) is an important prerequisite for improving the specificity of diagnoses of cardiopulmonary diseases in a clinical decision support system. Current deep learning models for lung segmentation are trained and evaluated on CXR datasets in which the radiographic projections are captured predominantly from the adult population. However, the shape of the lungs is reported to be significantly different across the developmental stages from infancy to adulthood. This might result in age-related data domain shifts that would adversely impact lung segmentation performance when the models trained on the adult population are deployed for pediatric lung segmentation. In this work, our goal is to (i) analyze the generalizability of deep adult lung segmentation models to the pediatric population and (ii) improve performance through a stage-wise, systematic approach consisting of CXR modality-specific weight initializations, stacked ensembles, and an ensemble of stacked ensembles. To evaluate segmentation performance and generalizability, novel evaluation metrics consisting of mean lung contour distance (MLCD) and average hash score (AHS) are proposed in addition to the multi-scale structural similarity index measure (MS-SSIM), the intersection of union (IoU), Dice score, 95% Hausdorff distance (HD95), and average symmetric surface distance (ASSD). Our results showed a significant improvement (p < 0.05) in cross-domain generalization through our approach. This study could serve as a paradigm to analyze the cross-domain generalizability of deep segmentation models for other medical imaging modalities and applications.

eess.IV↗
arXiv2023

Segmentation of Aortic Vessel Tree in CT Scans with Deep Fully Convolutional Networks

Automatic and accurate segmentation of aortic vessel tree (AVT) in computed tomography (CT) scans is crucial for early detection, diagnosis and prognosis of aortic diseases, such as aneurysms, dissections and stenosis. However, this task remains challenges, due to the complexity of aortic vessel tree and amount of CT angiography data. In this technical report, we use two-stage fully convolutional networks (FCNs) to automatically segment AVT in CTA scans from multiple centers. Specifically, we firstly adopt a 3D FCN with U-shape network architecture to segment AVT in order to produce topology attention and accelerate medical image analysis pipeline. And then another one 3D FCN is trained to segment branches of AVT along the pseudo-centerline of AVT. In the 2023 MICCAI Segmentation of the Aorta (SEG.A.) Challenge , the reported method was evaluated on the public dataset of 56 cases. The resulting Dice Similarity Coefficient (DSC) is 0.920, Jaccard Similarity Coefficient (JSC) is 0.861, Recall is 0.922, and Precision is 0.926 on a 5-fold random split of training and validation set.

eess.IV↗
arXiv2023

Large upper critical fields and dimensionality crossover of superconductivity in infinite-layer nickelate La$_{0.8}$Sr$_{0.2}$NiO$_{2}$

The recently emerging superconductivity in infinite-layer nickelates, with isostructure and isoelectron of cuprates, provides a new platform to explore the pairing mechanism of high-temperature superconductors. In this work, we studied the upper critical field ($H_{\rm{c2}}$) of a high-quality La$_{0.8}$Sr$_{0.2}$NiO$_{2}$ thin film with superconducting transition temperature, $T_{\rm{c}}$ = 18.8 K, using high magnetic field up to 56 T. A very large $H_{\rm{c2}}$, $\sim$ 40 T for $H$ $\Arrowvert$ $c$ and $\sim$ 52 T for $H$ $\Arrowvert$ $ab$, was confirmed, which suggests that infinite-layer nickelates also have great application potential. The anisotropy of $H_{\rm{c2}}$ monotonically decreases from $\sim$ 10 near $T_{\rm{c}}$ to $\sim$ 1.5 at 2 K. Angle dependence of $H_{\rm{c2}}$ confirms the crossover of superconductivity from two-dimensional (2D) to three-dimensional (3D) as the temperature decreases. We discussed that the interstitial orbital effect causes the weakening of anisotropy. The observed abnormal upturning of $H_{\rm{c2}}$ at low temperatures is found to be a universal behavior independent of film quality and rare earth elements. Therefore, it should not be the Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) state due to the fact that it is in the dirty limit and insensitive to disorder.

cond-mat.supr-con↗
arXiv2023

Soundini: Sound-Guided Diffusion for Natural Video Editing

We propose a method for adding sound-guided visual effects to specific regions of videos with a zero-shot setting. Animating the appearance of the visual effect is challenging because each frame of the edited video should have visual changes while maintaining temporal consistency. Moreover, existing video editing solutions focus on temporal consistency across frames, ignoring the visual style variations over time, e.g., thunderstorm, wave, fire crackling. To overcome this limitation, we utilize temporal sound features for the dynamic style. Specifically, we guide denoising diffusion probabilistic models with an audio latent representation in the audio-visual latent space. To the best of our knowledge, our work is the first to explore sound-guided natural video editing from various sound sources with sound-specialized properties, such as intensity, timbre, and volume. Additionally, we design optical flow-based guidance to generate temporally consistent video frames, capturing the pixel-wise relationship between adjacent frames. Experimental results show that our method outperforms existing video editing techniques, producing more realistic visual effects that reflect the properties of sound. Please visit our page: https://kuai-lab.github.io/soundini-gallery/.

cs.CV↗
arXiv2023

Description of the newly observed $Ω^{*}_c$ states as molecular states

In this work, we study the strong decays of the newly observed $Ω^{*}_c(3185)$ and $Ω^{*}_c(3327)$ assuming that $Ω^{*}_c(3185)$ and $Ω^{*}_c(3327)$ as $S$-wave $DΞ$ and $D^{*}Ξ$ molecular state, respectively. Since the $Ω_c^{*}$ was observed in the $Ξ_c^{+}K^{-}$ invariant mass distributions, the partial decay width of $Ω^{*}_c(3185)$ and $Ω^{*}_c(3327)$ into $Ξ_c^{+}K^{-}$ through hadronic loops are evaluated with the help of the effective Lagrangians. Moreover, the decay channel of $Ξ_c^{'}\bar{K}$ is also included. The decay process is described by the $t$-channel $Λ$, $Σ$ baryons and $D_s$, $D_s^{*}$ mesons exchanges, respectively. By comparison with the LHCb observation, the current results support the $Ω^{*}_c(3327)$ with$J^P=3/2^{-}$ as pure $D^{*}Ξ$ molecule while the $Ω^{*}_c(3327)$ with $J^P=1/2^{-}$ can not be well reproduced in the molecular state picture. In addition, the spin-parity $J^P=1/2^{-}$ $DΞ$ molecular assumptions for the $Ω^{*}_c(3185)$ can't be conclusively determined. It may be a meson-baryon molecule with a big $DΞ$ component. Although the decay width of the $Ω_c^{*}\to{}\bar{K}Ξ_c^{'}$ is of the order several MeV, it can be well employed to test the molecule interpretations of $Ω^{*}_c(3185)$ and $Ω^{*}_c(3327)$.

hep-ph↗
arXiv2023

MRET: Multi-resolution Transformer for Video Quality Assessment

No-reference video quality assessment (NR-VQA) for user generated content (UGC) is crucial for understanding and improving visual experience. Unlike video recognition tasks, VQA tasks are sensitive to changes in input resolution. Since large amounts of UGC videos nowadays are 720p or above, the fixed and relatively small input used in conventional NR-VQA methods results in missing high-frequency details for many videos. In this paper, we propose a novel Transformer-based NR-VQA framework that preserves the high-resolution quality information. With the multi-resolution input representation and a novel multi-resolution patch sampling mechanism, our method enables a comprehensive view of both the global video composition and local high-resolution details. The proposed approach can effectively aggregate quality information across different granularities in spatial and temporal dimensions, making the model robust to input resolution variations. Our method achieves state-of-the-art performance on large-scale UGC VQA datasets LSVQ and LSVQ-1080p, and on KoNViD-1k and LIVE-VQC without fine-tuning.

cs.CV↗