arXiv subjects

Shuai Li

Publications and source records attributed to Shuai Li.

At least 325 records · Page 18Linked to original sources

arXiv2021

Conservative Contextual Combinatorial Cascading Bandit

Conservative mechanism is a desirable property in decision-making problems which balance the tradeoff between the exploration and exploitation. We propose the novel \emph{conservative contextual combinatorial cascading bandit ($C^4$-bandit)}, a cascading online learning game which incorporates the conservative mechanism. At each time step, the learning agent is given some contexts and has to recommend a list of items but not worse than the base strategy and then observes the reward by some stopping rules. We design the $C^4$-UCB algorithm to solve the problem and prove its n-step upper regret bound for two situations: known baseline reward and unknown baseline reward. The regret in both situations can be decomposed into two terms: (a) the upper bound for the general contextual combinatorial cascading bandit; and (b) a constant term for the regret from the conservative mechanism. We also improve the bound of the conservative contextual combinatorial bandit as a by-product. Experiments on synthetic data demonstrate its advantages and validate our theoretical analysis.

cs.LG↗

arXiv2021

A toolbox for elementary fermions with a dipolar Fermi gas in a 3D optical lattice

There has been growing interest in investigating properties of elementary particles predicted by the standard model. Examples of such studies include exploring their low-energy analogs in condensed matter system, where they arise as collective states or quasiparticles. Here we show that a toolbox for systematically engineering the emergent elementary fermions, i.e., Dirac, Weyl and Majorana fermions, can be built in a single atomic system composed of a spinless magnetic dipolar Fermi gas in a 3D optical lattice. The designed direction-dependent dipole-dipole interaction leads to both the basic building block, i.e, in-plane p+ip superfluid pairing instability and the manipulating tool, i.e, out-of-plane Peierls instability. It is shown that the Peierls instability provides a natural way of tuning the topological nature of p+ip superfluids and thus transform the fermion's nature between distinct emergent particles. Our scheme should open up a new thrust towards searching for elementary particles through manipulating the topology.

cond-mat.quant-gas↗

arXiv2021

Removing Diffraction Image Artifacts in Under-Display Camera via Dynamic Skip Connection Network

Recent development of Under-Display Camera (UDC) systems provides a true bezel-less and notch-free viewing experience on smartphones (and TV, laptops, tablets), while allowing images to be captured from the selfie camera embedded underneath. In a typical UDC system, the microstructure of the semi-transparent organic light-emitting diode (OLED) pixel array attenuates and diffracts the incident light on the camera, resulting in significant image quality degradation. Oftentimes, noise, flare, haze, and blur can be observed in UDC images. In this work, we aim to analyze and tackle the aforementioned degradation problems. We define a physics-based image formation model to better understand the degradation. In addition, we utilize one of the world's first commodity UDC smartphone prototypes to measure the real-world Point Spread Function (PSF) of the UDC system, and provide a model-based data synthesis pipeline to generate realistically degraded images. We specially design a new domain knowledge-enabled Dynamic Skip Connection Network (DISCNet) to restore the UDC images. We demonstrate the effectiveness of our method through extensive experiments on both synthetic and real UDC data. Our physics-based image formation model and proposed DISCNet can provide foundations for further exploration in UDC image restoration, and even for general diffraction artifact removal in a broader sense.

cs.CV↗

arXiv2021

An Adversarial Imitation Click Model for Information Retrieval

Modern information retrieval systems, including web search, ads placement, and recommender systems, typically rely on learning from user feedback. Click models, which study how users interact with a ranked list of items, provide a useful understanding of user feedback for learning ranking models. Constructing "right" dependencies is the key of any successful click model. However, probabilistic graphical models (PGMs) have to rely on manually assigned dependencies, and oversimplify user behaviors. Existing neural network based methods promote PGMs by enhancing the expressive ability and allowing flexible dependencies, but still suffer from exposure bias and inferior estimation. In this paper, we propose a novel framework, Adversarial Imitation Click Model (AICM), based on imitation learning. Firstly, we explicitly learn the reward function that recovers users' intrinsic utility and underlying intentions. Secondly, we model user interactions with a ranked list as a dynamic system instead of one-step click prediction, alleviating the exposure bias problem. Finally, we minimize the JS divergence through adversarial training and learn a stable distribution of click sequences, which makes AICM generalize well across different distributions of ranked lists. A theoretical analysis has indicated that AICM reduces the exposure bias from $O(T^2)$ to $O(T)$. Our studies on a public web search dataset show that AICM not only outperforms state-of-the-art models in traditional click metrics but also achieves superior performance in addressing the exposure bias and recovering the underlying patterns of click sequences.

cs.IR↗

arXiv2021

Doubled Moiré Flat Bands in Double-twisted Few Layer Graphite

We study the electronic structure of a double-twisted few layer graphite (DTFLG), which consists of three few layer graphite (FLG), i.e. ABA-stacked graphene multilayer, stacked with two twist angles. We consider two categories of DTFLG, alternately twisted case and chirally twisted one, according to the rotation direction of the two twist angles. We show that, once the middle FLG of DTFLG is not thinner than trilayer, both kinds of DTFLG can remarkably host two pairs of degenerate moiré flat bands (MFBs) at $E_f$, twice that of the magic angle twisted bilayer graphene (TBG). The doubled MFBs of DTFLG lead to doubled DOS at $E_f$, which implies much stronger correlation effects than the TBG. The degeneracy of MFBs can be lifted by a perpendicular electric field, and the isolated MFBs have nonzero valley Chern number. We also reveal the peculiar wave function patterns of the MFBs in the DTFLG. Our results establish a new family of moiré systems that have the much larger DOS at $E_f$, and thus possible much stronger correlation effects.

cond-mat.mes-hall↗

arXiv2021

Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentation

Modern one-stage video instance segmentation networks suffer from two limitations. First, convolutional features are neither aligned with anchor boxes nor with ground-truth bounding boxes, reducing the mask sensitivity to spatial location. Second, a video is directly divided into individual frames for frame-level instance segmentation, ignoring the temporal correlation between adjacent frames. To address these issues, we propose a simple yet effective one-stage video instance segmentation framework by spatial calibration and temporal fusion, namely STMask. To ensure spatial feature calibration with ground-truth bounding boxes, we first predict regressed bounding boxes around ground-truth bounding boxes, and extract features from them for frame-level instance segmentation. To further explore temporal correlation among video frames, we aggregate a temporal fusion module to infer instance masks from each frame to its adjacent frames, which helps our framework to handle challenging videos such as motion blur, partial occlusion and unusual object-to-camera poses. Experiments on the YouTube-VIS valid set show that the proposed STMask with ResNet-50/-101 backbone obtains 33.5 % / 36.8 % mask AP, while achieving 28.6 / 23.4 FPS on video instance segmentation. The code is released online https://github.com/MinghanLi/STMask.

cs.CV↗

arXiv2021

Decentralized Circle Formation Control for Fish-like Robots in the Real-world via Reinforcement Learning

In this paper, the circle formation control problem is addressed for a group of cooperative underactuated fish-like robots involving unknown nonlinear dynamics and disturbances. Based on the reinforcement learning and cognitive consistency theory, we propose a decentralized controller without the knowledge of the dynamics of the fish-like robots. The proposed controller can be transferred from simulation to reality. It is only trained in our established simulation environment, and the trained controller can be deployed to real robots without any manual tuning. Simulation results confirm that the proposed model-free robust formation control method is scalable with respect to the group size of the robots and outperforms other representative RL algorithms. Several experiments in the real world verify the effectiveness of our RL-based approach for circle formation control.

cs.RO↗

arXiv2021

Phase-Field Modeling of Selective Laser Brazing of Diamond Grits

Diamond grit is widely used in cutting, grinding, and polishing tools for its superior mechanical properties and performance in machining hard materials. Selective laser brazing (SLB) of diamond grits is a new additive manufacturing technique that has great potential to fabricate the next generation of high-performance diamond tools. However, fundamental understanding and quantitative analysis for the design and tuning of the SLB process and the resulting bonding efficiency are not yet established as the process is complicated by heating, fusion, wetting, solidification, grit migration, bonding, reaction, and the interplay between these effects. We present a thermodynamically consistent phase-field theoretical model for the prediction of melting and wetting of SLB on diamond grits using a powder-based additive manufacturing technique. The melting dynamics is driven by laser heating in a chamber filled with argon gas and is coupled with the motion of multiple three-phase contact lines. The relevant wetting dynamics, interfacial morphology, and temperature distribution are computationally resolved in a simplified 2D configuration.

physics.flu-dyn↗

arXiv2021

EqSpike: Spike-driven Equilibrium Propagation for Neuromorphic Implementations

Finding spike-based learning algorithms that can be implemented within the local constraints of neuromorphic systems, while achieving high accuracy, remains a formidable challenge. Equilibrium Propagation is a promising alternative to backpropagation as it only involves local computations, but hardware-oriented studies have so far focused on rate-based networks. In this work, we develop a spiking neural network algorithm called EqSpike, compatible with neuromorphic systems, which learns by Equilibrium Propagation. Through simulations, we obtain a test recognition accuracy of 97.6% on MNIST, similar to rate-based Equilibrium Propagation, and comparing favourably to alternative learning techniques for spiking neural networks. We show that EqSpike implemented in silicon neuromorphic technology could reduce the energy consumption of inference and training respectively by three orders and two orders of magnitude compared to GPUs. Finally, we also show that during learning, EqSpike weight updates exhibit a form of Spike Timing Dependent Plasticity, highlighting a possible connection with biology.

cs.NE↗

arXiv2021

PSA: A novel optimization algorithm based on survival rules of porcellio scaber

Bio-inspired algorithms such as neural network algorithms and genetic algorithms have received a significant amount of attention in both academic and engineering societies. In this paper, based on the observation of two major survival rules of a species of woodlice, i.e., porcellio scaber, we present an algorithm called the porcellio scaber algorithm (PSA) for solving general unconstrained optimization problems, including differentiable and non-differential ones as well as the case with local optima. Numerical results based on benchmark problems are presented to validate the efficacy of PSA.

cs.NE↗

arXiv2021

A Two-stream Neural Network for Pose-based Hand Gesture Recognition

Pose based hand gesture recognition has been widely studied in the recent years. Compared with full body action recognition, hand gesture involves joints that are more spatially closely distributed with stronger collaboration. This nature requires a different approach from action recognition to capturing the complex spatial features. Many gesture categories, such as "Grab" and "Pinch", have very similar motion or temporal patterns posing a challenge on temporal processing. To address these challenges, this paper proposes a two-stream neural network with one stream being a self-attention based graph convolutional network (SAGCN) extracting the short-term temporal information and hierarchical spatial information, and the other being a residual-connection enhanced bidirectional Independently Recurrent Neural Network (RBi-IndRNN) for extracting long-term temporal information. The self-attention based graph convolutional network has a dynamic self-attention mechanism to adaptively exploit the relationships of all hand joints in addition to the fixed topology and local feature extraction in the GCN. On the other hand, the residual-connection enhanced Bi-IndRNN extends an IndRNN with the capability of bidirectional processing for temporal modelling. The two streams are fused together for recognition. The Dynamic Hand Gesture dataset and First-Person Hand Action dataset are used to validate its effectiveness, and our method achieves state-of-the-art performance.

cs.CV↗

arXiv2021

Topological semimetal and superfluid of s-wave interacting fermionic atoms in an orbital optical lattice

Recent advanced experimental implementations of optical lattices with highly tunable geometry open up new regimes for quantum many-body states of matter that previously had not been accessible. Here we introduce a symmetry-based method of utilizing the geometry of optical lattice to systematically control topologically non-trivial orbital hybridization. Such an orbital mixing leads to an unexpected and yet robust topological semimetal at single-particle level for a gas of fermionic atoms. When considering s-wave attractive interaction between atoms as for instance tuned by Feshbach resonance, topological superfluid state with high Chern number is unveiled in the presence of on-site rotation. This state supports chiral edge excitations, manifesting its topological nature. An experimental realization scheme is designed, which introduces a systematic way of achieving a new universality class (such as Chern number of 2) of orbital-hybridized topological phases beyond geometrically standard optical lattices.

cond-mat.quant-gas↗

arXiv2020

Water entry of spheres into a rotating liquid

The transient cavity dynamics during water entry of a heavy, non-rotating sphere impacting a rotating pool of liquid is studied experimentally, numerically, and theoretically. We show that the pool rotation advances the transition of the cavity type - from deep seal to surface seal - marked by a reduction in the transitional Froude number. The role of the dimensionless rotational number $\mathcal{S} \equiv ωR_0/U_0$ on the transient cavity dynamics is unveiled, where $R_0$ is the sphere radius, $ω$ the angular speed of the liquid, and $U_0$ the impact velocity. The rotating background liquid has two discernible effects on the cavity evolution. Firstly, an increase in the underwater pressure field due to centripetal effects, and secondly a reduction in the pressure of airflow in the cavity neck near the water surface. The non-dimensional pinch-off time of the deep seal shows a robust 1/2 power-law dependence on the Froude number, but with a reducing prefactor for increasing $ω$. Our findings reveal that the effects of a rotating background liquid on the water entry can be traced back to the subtle differences in the initial stage splash and the near-surface cavity dynamics.

physics.flu-dyn↗

arXiv2020

Deep Independently Recurrent Neural Network (IndRNN)

Recurrent neural networks (RNNs) are known to be difficult to train due to the gradient vanishing and exploding problems and thus difficult to learn long-term patterns and construct deep networks. To address these problems, this paper proposes a new type of RNNs with the recurrent connection formulated as Hadamard product, referred to as independently recurrent neural network (IndRNN), where neurons in the same layer are independent of each other and connected across layers. Due to the better behaved gradient backpropagation, IndRNN with regulated recurrent weights effectively addresses the gradient vanishing and exploding problems and thus long-term dependencies can be learned. Moreover, an IndRNN can work with non-saturated activation functions such as ReLU (rectified linear unit) and be still trained robustly. Different deeper IndRNN architectures, including the basic stacked IndRNN, residual IndRNN and densely connected IndRNN, have been investigated, all of which can be much deeper than the existing RNNs. Furthermore, IndRNN reduces the computation at each time step and can be over 10 times faster than the commonly used Long short-term memory (LSTM). Experimental results have shown that the proposed IndRNN is able to process very long sequences and construct very deep networks. Better performance has been achieved on various tasks with IndRNNs compared with the traditional RNN, LSTM and the popular Transformer.

cs.CV↗

arXiv2020

Lunar Volatiles and Solar System Science

Understanding the origin and evolution of the lunar volatile system is not only compelling lunar science, but also fundamental Solar System science. This white paper (submitted to the US National Academies' Decadal Survey in Planetary Science and Astrobiology 2023-2032) summarizes recent advances in our understanding of lunar volatiles, identifies outstanding questions for the next decade, and discusses key steps required to address these questions.

astro-ph.IM↗

arXiv2020

Towards Understanding the Regularization of Adversarial Robustness on Neural Networks

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $ε$-adversarially robust} (AR); that is, to require the model not to change predicted labels when any given input examples are perturbed within a certain range. However, it is observed that such methods would lead to standard performance degradation, i.e., the degradation on natural examples. In this work, we study the degradation through the regularization perspective. We identify quantities from generalization analysis of NNs; with the identified quantities we empirically find that AR is achieved by regularizing/biasing NNs towards less confident solutions by making the changes in the feature space (induced by changes in the instance space) of most layers smoother uniformly in all directions; so to a certain extent, it prevents sudden change in prediction w.r.t. perturbations. However, the end result of such smoothing concentrates samples around decision boundaries, resulting in less confident solutions, and leads to worse standard performance. Our studies suggest that one might consider ways that build AR into NNs in a gentler way to avoid the problematic regularization.

cs.LG↗

arXiv2020

Theory for the Charge-Density-Wave Mechanism of 3D Quantum Hall Effect

The charge-density-wave (CDW) mechanism of the 3D quantum Hall effect has been observed recently in ZrTe$_5$ [Tang et al., Nature 569, 537 (2019)]. Different from previous cases, the CDW forms on a one-dimensional (1D) band of Landau levels, which strongly depends on the magnetic field. However, its theory is still lacking. We develop a theory for the CDW mechanism of 3D quantum Hall effect. The theory can capture the main features in the experiments. We find a magnetic field induced second-order phase transition to the CDW phase. We find that electron-phonon interactions, rather than electron-electron interactions, dominate the order parameter. We extract the electron-phonon coupling constant from the non-Ohmic I-V relation. We point out a commensurate-incommensurate CDW crossover in the experiment. More importantly, our theory explores a rare case, in which a magnetic field can induce an order-parameter phase transition in one direction but a topological phase transition in other two directions, both depend on one magnetic field.

cond-mat.mes-hall↗

arXiv2020

A Framework of Combining Short-Term Spatial/Frequency Feature Extraction and Long-Term IndRNN for Activity Recognition

Smartphone sensors based human activity recognition is attracting increasing interests nowadays with the popularization of smartphones. With the high sampling rates of smartphone sensors, it is a highly long-range temporal recognition problem, especially with the large intra-class distances such as the smartphones carried at different locations such as in the bag or on the body, and the small inter-class distances such as taking train or subway. To address this problem, we propose a new framework of combining short-term spatial/frequency feature extraction and a long-term Independently Recurrent Neural Network (IndRNN) for activity recognition. Considering the periodic characteristics of the sensor data, short-term temporal features are first extracted in the spatial and frequency domains. Then the IndRNN, which is able to capture long-term patterns, is used to further obtain the long-term features for classification. In view of the large differences when the smartphone is carried at different locations, a group based location recognition is first developed to pinpoint the location of the smartphone. The Sussex-Huawei Locomotion (SHL) dataset from the SHL Challenge is used for evaluation. An earlier version of the proposed method has won the second place award in the SHL Challenge 2020 (the first place if not considering multiple models fusion approach). The proposed method is further improved in this paper and achieves 80.72$\%$ accuracy, better than the existing methods using a single model.

cs.CV↗