arXiv subjects

Biao Yang

Publications and source records attributed to Biao Yang.

At least 55 records · Page 3Linked to original sources

arXiv2023

Looking and Listening: Audio Guided Text Recognition

Text recognition in the wild is a long-standing problem in computer vision. Driven by end-to-end deep learning, recent studies suggest vision and language processing are effective for scene text recognition. Yet, solving edit errors such as add, delete, or replace is still the main challenge for existing approaches. In fact, the content of the text and its audio are naturally corresponding to each other, i.e., a single character error may result in a clear different pronunciation. In this paper, we propose the AudioOCR, a simple yet effective probabilistic audio decoder for mel spectrogram sequence prediction to guide the scene text recognition, which only participates in the training phase and brings no extra cost during the inference stage. The underlying principle of AudioOCR can be easily applied to the existing approaches. Experiments using 7 previous scene text recognition methods on 12 existing regular, irregular, and occluded benchmarks demonstrate our proposed method can bring consistent improvement. More importantly, through our experimentation, we show that AudioOCR possesses a generalizability that extends to more challenging scenarios, including recognizing non-English text, out-of-vocabulary words, and text with various accents. Code will be available at https://github.com/wenwenyu/AudioOCR.

cs.CV↗

arXiv2023

Non-Abelian physics in light and sound

There has been a recent surge of interest in using light and sound as platforms for studying non-Abelian physics. Through a kaleidoscope of physical effects, light and sound provide diverse ways to manipulate their degrees of freedom to constitute the Hilbert space for demonstrating non-Abelian phenomena. The review aims to provide a timely and comprehensive account of this emerging topic. Starting from the foundation of matrix-valued geometric phases, we cover non-Abelian topological charges, non-Abelian gauge fields, non-Abelian braiding, non-Hermitian non-Abelian phenomena, and their realizations with photonics and acoustics. This topic is fast evolving at the intersection of atomic, molecular, optical physics, condensed matter physics, and mathematical physics, with fascinating prospects ahead.

physics.optics↗

arXiv2022

Experimental demonstration of non-adjacent band topology connecting multiple nodal links

Nodal links are special configurations of band degeneracies in the momentum space, where nodal line branches encircle each other. In PT symmetric systems, nodal lines can be topologically characterized using the eigenvector frame rotations along an encircling loop and the linking structure can be described with non-Abelian frame charges interacting among adjacent bands. In this paper, we present a photonic multiple nodal links system, where non-adjacent band topology is proposed to characterize the hidden relation between nodal lines from non-adjacent band pairs. Through an orthogonal nodal chain, the nodal line from the lower two bands predicts the existence of nodal lines formed between the higher bands. We designed and fabricated a metamaterial, with which the multiple nodal links and non-adjacent band topology are experimentally demonstrated.

physics.optics↗

arXiv2022

Edge and corner states in 2D non-Abelian topological insulators from an eigenvector frame rotation perspective

We propose the concept of 2D non-Abelian topological insulator which can explain the energy distributions of the edge states and corner states in systems with parity-time symmetry. From the viewpoint of non-Abelian band topology, we establish the constraints on the 2D Zak phase and polarization. We demonstrate that the corner states in some 2D systems can be explained as the boundary mode of the 1D edge states arising from the multi-band non-Abelian topology of the system. We also propose the use of off-diagonal Berry phase as complementary information to assist the prediction of edge states in non-Abelian topological insulators. Our work provides an alternative approach to study edge and corner modes and this idea can be extended to 3D systems.

cond-mat.mes-hall↗

arXiv2022

Searching Intrinsic Dimensions of Vision Transformers

It has been shown by many researchers that transformers perform as well as convolutional neural networks in many computer vision tasks. Meanwhile, the large computational costs of its attention module hinder further studies and applications on edge devices. Some pruning methods have been developed to construct efficient vision transformers, but most of them have considered image classification tasks only. Inspired by these results, we propose SiDT, a method for pruning vision transformer backbones on more complicated vision tasks like object detection, based on the search of transformer dimensions. Experiments on CIFAR-100 and COCO datasets show that the backbones with 20\% or 40\% dimensions/parameters pruned can have similar or even better performance than the unpruned models. Moreover, we have also provided the complexity analysis and comparisons with the previous pruning methods.

cs.CV↗

arXiv2021

TPPO: A Novel Trajectory Predictor with Pseudo Oracle

Forecasting pedestrian trajectories in dynamic scenes remains a critical problem in various applications, such as autonomous driving and socially aware robots. Such forecasting is challenging due to human-human and human-object interactions and future uncertainties caused by human randomness. Generative model-based methods handle future uncertainties by sampling a latent variable. However, few studies explored the generation of the latent variable. In this work, we propose the Trajectory Predictor with Pseudo Oracle (TPPO), which is a generative model-based trajectory predictor. The first pseudo oracle is pedestrians' moving directions, and the second one is the latent variable estimated from ground truth trajectories. A social attention module is used to aggregate neighbors' interactions based on the correlation between pedestrians' moving directions and future trajectories. This correlation is inspired by the fact that pedestrians' future trajectories are often influenced by pedestrians in front. A latent variable predictor is proposed to estimate latent variable distributions from observed and ground-truth trajectories. Moreover, the gap between these two distributions is minimized during training. Therefore, the latent variable predictor can estimate the latent variable from observed trajectories to approximate that estimated from ground-truth trajectories. We compare the performance of TPPO with related methods on several public datasets. Results demonstrate that TPPO outperforms state-of-the-art methods with low average and final displacement errors. The ablation study shows that the prediction performance will not dramatically decrease as sampling times decline during tests.

cs.CV↗

arXiv2021

Four-band non-Abelian topological insulator and its experimental realization

Very recently, increasing attention has been focused on non-Abelian topological charges, e.g. the quaternion group Q8. Different from Abelian topological band insulators, these systems involve multiple tangled bulk bandgaps and support non-trivial edge states that manifest the non-Abelian topological features. Furthermore, a system with even or odd number of bands will exhibit significant difference in non-Abelian topological classifications. Up to now, there is scant research investigating the even-band non-Abelian topological insulators. Here, we both theoretically explored and experimentally realized a four-band PT (inversion and time-reversal) symmetric system, where two new classes of topological charges as well as edge states are comprehensively studied. We illustrate their difference from four-dimensional rotation senses on the stereographically projected Clifford tori. We show the evolution of bulk topology by extending the 1D Hamiltonian onto a 2D plane and provide the accompanying edge state distributions following an analytical method. Our work presents an exhaustive study of four-band non-Abelian topological insulators and paves the way to other even band systems.

cond-mat.mes-hall↗

arXiv2021

A Novel Graph based Trajectory Predictor with Pseudo Oracle

Pedestrian trajectory prediction in dynamic scenes remains a challenging and critical problem in numerous applications, such as self-driving cars and socially aware robots. Challenges concentrate on capturing pedestrians' motion patterns and social interactions, as well as handling the future uncertainties. Recent studies focus on modeling pedestrians' motion patterns with recurrent neural networks, capturing social interactions with pooling-based or graph-based methods, and handling future uncertainties by using random Gaussian noise as the latent variable. However, they do not integrate specific obstacle avoidance experience (OAE) that may improve prediction performance. For example, pedestrians' future trajectories are always influenced by others in front. Here we propose GTPPO (Graph-based Trajectory Predictor with Pseudo Oracle), an encoder-decoder-based method conditioned on pedestrians' future behaviors. Pedestrians' motion patterns are encoded with a long short-term memory unit, which introduces the temporal attention to highlight specific time steps. Their interactions are captured by a graph-based attention mechanism, which draws OAE into the data-driven learning process of graph attention. Future uncertainties are handled by generating multi-modal outputs with an informative latent variable. Such a variable is generated by a novel pseudo oracle predictor, which minimizes the knowledge gap between historical and ground-truth trajectories. Finally, the GTPPO is evaluated on ETH, UCY and Stanford Drone datasets, and the results demonstrate state-of-the-art performance. Besides, the qualitative evaluations show successful cases of handling sudden motion changes in the future. Such findings indicate that GTPPO can peek into the future.

cs.CV↗

arXiv2021

Experimental observation of non-Abelian earring nodal links in phononic crystals

Nodal lines are symmetry-protected one-dimensional band degeneracies in momentum space, which can appear in numerous topological configurations such as nodal rings, chains, links, and knots. Very recently, non-Abelian topological physics has been proposed in space-time inversion (PT) symmetric systems, and attract widespread attention. One of the most special configurations in non-Abelian system is the earring nodal link, composing of a nodal chain linking with an isolated nodal line, is signature of non-Abelian topology and cannot be elucidated using Abelian topological classifications. However, the earring nodal links have not been yet observed in real system. Here we design the phononic crystals with earring nodal links, and verify its non-Abelian topologicial charge in full-wave simulations. Moreover, we experimentally observed two different kinds of earring nodal links by measuring the band structures for two phononic crystals. Specifically, we found that the order of the nodal chain and line can switch after band inversion but their link cannot be severed. Our work provides experimental evidence for phenomena unique to non-Abelian band topology and our simple acoustic system provides a convenient platform for studying non-Abelian charges.

cond-mat.mes-hall↗

arXiv2021

Photonic nodal lines with quadrupole Berry curvature distribution

In periodic systems, nodal lines are loops in the three-dimensional momentum space where two bands are degenerate with each other. Nodal lines exhibit rich topological features as they can take various configurations such as rings, links, chains and knots. These line nodes are usually protected by mirror or PT symmetry. Here we propose and demonstrate a novel type of photonic straight nodal lines in a D2d meta-crystal which are protected by roto-inversion time (roto-PT) symmetry. The nodal lines are located at the central axis and hinges of the Brillouin zone. They appear as quadrupole sources of Berry curvature flux and allow for the precise control of the quadrupole strength. Interestingly, there exist topological surface states at all three cutting surfaces, as guaranteed by the pi-quantized Zak phases along all three directions. As frequency changes, the surface state equi-frequency contours evolve from closed to open contours, and become straight lines at a critical transition frequency, at which diffraction-less surface wave propagation are demonstrated, paving way towards development of super-imaging photonic devices.

cond-mat.mes-hall↗

arXiv2020

Experimental observation of non-Abelian topological charges and bulk-edge correspondence

In the past decades, topological concepts have emerged to classify matter states beyond the Ginzburg-Landau symmetry breaking paradigm. The underlying global invariants are usually characterized by integers, such as Chern or winding numbers. Very recently, band topology characterized by non-Abelian topological charges has been proposed, which possess non-commutative and fruitful braiding structures with multiple (>1) bandgaps entangled together. Despite many potential exquisite applications including quantum computations, no experimental observation of non-Abelian topological charges has been reported. Here, we experimentally observe the non-Abelian topological charges in a PT (parity and time-reversal) symmetric system. More importantly, we propose non-Abelian bulk-edge correspondence, where edge states are found to be described by non-Abelian charges. Our work opens the door towards non-Abelian topological phase characterization and manipulation.

cond-mat.mes-hall↗

arXiv2020

NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Results

This paper reviews the NTIRE 2020 challenge on real world super-resolution. It focuses on the participating methods and final results. The challenge addresses the real world setting, where paired true high and low-resolution images are unavailable. For training, only one set of source input images is therefore provided along with a set of unpaired high-quality target images. In Track 1: Image Processing artifacts, the aim is to super-resolve images with synthetically generated image processing artifacts. This allows for quantitative benchmarking of the approaches \wrt a ground-truth image. In Track 2: Smartphone Images, real low-quality smart phone images have to be super-resolved. In both tracks, the ultimate goal is to achieve the best perceptual quality, evaluated using a human study. This is the second challenge on the subject, following AIM 2019, targeting to advance the state-of-the-art in super-resolution. To measure the performance we use the benchmark protocol from AIM 2019. In total 22 teams competed in the final testing phase, demonstrating new and innovative solutions to the problem.

eess.IV↗

arXiv2020

Observation of non-Abelian nodal links in photonics

In crystals, two bands may cross each other and form degeneracies along a closed loop in the three-dimensional momentum space, which is called nodal line. Nodal line degeneracy can be designed to exhibit various configurations such as nodal rings, chains, links and knots. Very recently, non-Abelian band topology was proposed in nodal link systems, where the nodal lines formed by consecutive pairs of bands exhibit interesting braiding structures and the underlying topological charges are described by quaternions. Here, we experimentally demonstrate non-Abelian nodal links in a biaxial hyperbolic metamaterial. The linked nodal lines threading through each other are formed by the crossings between three adjacent bands. Based on the non-Abelian charges, we further analyze various admissible nodal link configurations for the three-band system. On the interface between the metamaterial and air, surface bound states in the continuum (BICs) are observed, which serves as the symmetry-enforced derivative of drumhead surface states from the linked nodal lines. Our work serves as a direct observation of the global topological structures of nodal links, and provides a platform for studying non-Abelian topological charge in the momentum space.

physics.optics↗

arXiv2019

Highly degenerate photonic flat bands arising from complete graph configurations

Inspired by complete graph theory, we demonstrate that a metallic claw "meta-atom" structure can carry a high number of nearly degenerate resonant modes. A photonic meta-crystal composing of a lattice of such meta-atoms exhibits a large number of flat bands that are squeezed into a narrow frequency window, and these flat bands can be designed to locate in a wide complete 3D bandgap. The degeneracy dimension (Nf) of the flat bands is determined by the number of branches (Nb) of the metallic claw with Nf=Nb-3, which is geometrically related to the complete graph theory. Different from those flat bands emerging from special lattice arrangements (e.g., Kagome lattice), the isolated flat bands here are insensitive to lattice perturbations. The proposed mechanism offers a new platform for realizing various dispersion-less phenomena and a new paradigm to realize high density of states and spectra compressing.

physics.class-ph↗

arXiv2019

Spin determination from the in-plane angular correlation analysis for various coordinate systems

In a reaction to excite the resonant state followed by the sequential cluster-decay, the in-plane angular correlation method is usually applied to determine the spin of the mother nucleus. However, the correlation pattern exhibited in a two-dimensional angular-correlation spectrum depends on the selected coordinate system. Particularly the parity-symmetric and the axial-symmetric processes should be presented in a way to enhance the correlation pattern whereas the non-symmetric process should be plotted elsewhere in order to reduce the correlation background. In this article, three possible coordinate systems, which were previously adopted in the literature, are described and compared to each other. The consistency of these systems is evaluated based on the real experimental data analysis for the 10.29-MeV state in $^{18}$O. A spin-parity of 4$^+$ is obtained for all three coordinate systems.

physics.data-an↗

arXiv2018

Observation of Three-dimensional Photonic Dirac points and Spin-polarized Surface Arcs

Topological phases arise from the elegant mathematical structures imposed by the interplay between symmetry and topology1-5. From gapped topological insulators to gapless semimetals, topological materials in both quantum and classical systems, have grown rapidly in the last decade. Among them, three-dimensional Dirac semimetal lies at the topological phase transition point between various topological phases. It shares multiple exotic topological features with other topological materials, such as Fermi arcs and chiral anomaly with Weyl semimetals30, spin-dependent surface states with topological insulators29. In spite of the important role it plays in topological physics, no experimental observation of three-dimension Dirac points has been reported in classical systems so far. Here, we experimentally demonstrate three-dimension photonic Dirac points in an elaborately designed photonic metamaterial, in which two symmetrically placed Dirac points are stabilized by electromagnetic duality symmetry31. Spin-polarized surface arcs (counterparts of Fermi arcs in electronic systems) are demonstrated, which paves the way towards spin-multiplexed topological surface wave propagation. Closely linked to other exotic states through topological phase transitions, our system offers an effective medium platform for topological photonics.

physics.optics↗

arXiv2018

Large Chiroptical Effects in Planar Chiral Metamaterials

Chiroptical effects, characterized by different optical responses for left- (LCP) and right- handed circularly polarized light (RCP), are powerful and valuable tools in optics with wide applications in polarization resolved imaging and sensing. Previously observed strong chiroptical effects are limited to metamaterials with complex three-dimensional chiral structures at the sub-wavelength scale. Although asymmetrical transmission of LCP and RCP have been investigated in planar chiral metasurfaces, the observed weak chiroptical effects result from anisotropic Ohmic dissipation of the metal constituents. Here, we demonstrate by theory and proof-of-concept experiments that large difference in transmittances of LCP and RCP can be attained in a single-layer planar chiral metamaterial with a sub-wavelength thickness. Without violating the reciprocity and mirror symmetry, the strong chiroptical effect, independent of dielectric loss, arise from a novel mechanism of multimode interference. The described effect may lead to new gateway towards chiral manipulations of light and chiral optical devices.

physics.optics↗

arXiv2018

Investigation of the near-threshold cluster resonance in $^{14}\rm{C}$

An experiment for $p(^{14}\rm{C}$,$^{14}\rm{C}^{*}\rightarrow^{10}\rm{Be}+α)\mathit{p}$ inelastic excitation and decay was performed in inverse kinematics at a beam energy of 25.3 MeV/u. A series of $^{14}\rm{C}$ excited states, including a new one at 18.3(1) MeV, were observed which decay to various states of the final nucleus of $^{10}\rm{Be}$. A specially designed telescope-system, installed around the zero degree, played an essential role in detecting the resonant states near the $α$-separation threshold. A state at 14.1(1) MeV is clearly identified, being consistent with the predicted band-head of the molecular rotational band characterized by the $π$-bond linear-chain-configuration. Further clarification of the properties of this exotic state is suggested by using appropriate reaction tools.

nucl-ex↗