arXiv subjects

Shuai Yang

Publications and source records attributed to Shuai Yang.

At least 181 records · Page 10Linked to original sources

arXiv2022

VToonify: Controllable High-Resolution Portrait Video Style Transfer

Generating high-quality artistic portrait videos is an important and desirable task in computer graphics and vision. Although a series of successful portrait image toonification models built upon the powerful StyleGAN have been proposed, these image-oriented methods have obvious limitations when applied to videos, such as the fixed frame size, the requirement of face alignment, missing non-facial details and temporal inconsistency. In this work, we investigate the challenging controllable high-resolution portrait video style transfer by introducing a novel VToonify framework. Specifically, VToonify leverages the mid- and high-resolution layers of StyleGAN to render high-quality artistic portraits based on the multi-scale content features extracted by an encoder to better preserve the frame details. The resulting fully convolutional architecture accepts non-aligned faces in videos of variable size as input, contributing to complete face regions with natural motions in the output. Our framework is compatible with existing StyleGAN-based image toonification models to extend them to video toonification, and inherits appealing features of these models for flexible style control on color and intensity. This work presents two instantiations of VToonify built upon Toonify and DualStyleGAN for collection-based and exemplar-based portrait video style transfer, respectively. Extensive experimental results demonstrate the effectiveness of our proposed VToonify framework over existing methods in generating high-quality and temporally-coherent artistic portrait videos with flexible style controls.

cs.CV↗

arXiv2022

Determine the quantum numbers of $X(6900)$ from photon-photon fusion in ultra-peripheral heavy ion collisions

We study the production of the $X(6900)$ through the $J/ψJ/ψ$ decay channel in the ultra-peripheral heavy ion collisions at the LHC energy region. The potential quantum numbers of $X(6900)$ would be $0^{\pm +}$ and $2^{\pm+}$. We find that the transverse momentum and the polar angle distributions of $X(6900)$ can be used to distinguish these four potential quantum numbers. These typical distributions stem from the linearly polarized photon from the fast-moving nuclei and can be measured with the LHC experiments in further.

hep-ph↗

arXiv2022

Semantic Communication-Empowered Physical-layer Network Coding

In a two-way relay channel (TWRC), physical-layer network coding (PNC) doubles the system throughput by turning superimposed signals transmitted simultaneously by different end nodes into useful network-coded information (known as PNC decoding). Prior works indicated that the PNC decoding performance is affected by the relative phase offset between the received signals from different nodes. In particular, some "bad" relative phase offsets could lead to huge performance degradation. Previous solutions to mitigate the relative phase offset effect were limited to the conventional bit-oriented communication paradigm, aiming at delivering a given information stream as quickly and reliably as possible. In contrast, this paper puts forth the first semantic communication-empowered PNC-enabled TWRC to address the relative phase offset issue, referred to as SC-PNC. Despite the bad relative phase offsets, SC-PNC directly extracts the semantic meaning of transmitted messages rather than ensuring accurate bit stream transmission. We jointly design deep neural network (DNN)-based transceivers at the end nodes and propose a semantic PNC decoder at the relay. Taking image delivery as an example, experimental results show that the SC-PNC TWRC achieves high and stable reconstruction quality for images under different channel conditions and relative phase offsets, compared with the conventional bit-oriented counterparts.

cs.NI↗

arXiv2022

Efficient quantum circuit synthesis for SAT-oracle with limited ancillary qubit

How to implement quantum oracle with limited resources raises concerns these days. We design two ancilla-adjustable and efficient algorithms to synthesize SAT-oracle, the key component in solving SAT problems. The previous work takes 2m-1 ancillary qubits and O(m) elementary gates to synthesize an m clauses oracle. The first algorithm reduces the number of ancillary qubits to 2\sqrt{m}, with at most an eightfold increase in circuit size. The number of ancillary qubits can be further reduced to 3 with a quadratic increase in circuit size. The second algorithm aims to reduce the circuit depth. By leveraging of the second algorithm, the circuit depth can be reduced to O(log m) with m ancillary qubits.

quant-ph↗

arXiv2022

Text2Human: Text-Driven Controllable Human Image Generation

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the generation process is even desired to be intuitively controllable for layman users. In this work, we present a text-driven controllable framework, Text2Human, for a high-quality and diverse human generation. We synthesize full-body human images starting from a given human pose with two dedicated steps. 1) With some texts describing the shapes of clothes, the given human pose is first translated to a human parsing map. 2) The final human image is then generated by providing the system with more attributes about the textures of clothes. Specifically, to model the diversity of clothing textures, we build a hierarchical texture-aware codebook that stores multi-scale neural representations for each type of texture. The codebook at the coarse level includes the structural representations of textures, while the codebook at the fine level focuses on the details of textures. To make use of the learned hierarchical codebook to synthesize desired images, a diffusion-based transformer sampler with mixture of experts is firstly employed to sample indices from the coarsest level of the codebook, which then is used to predict the indices of the codebook at finer levels. The predicted indices at different levels are translated to human images by the decoder learned accompanied with hierarchical codebooks. The use of mixture-of-experts allows for the generated image conditioned on the fine-grained text input. The prediction for finer level indices refines the quality of clothing textures. Extensive quantitative and qualitative evaluations demonstrate that our proposed framework can generate more diverse and realistic human images compared to state-of-the-art methods.

cs.CV↗

arXiv2022

Select and Calibrate the Low-confidence: Dual-Channel Consistency based Graph Convolutional Networks

The Graph Convolutional Networks (GCNs) have achieved excellent results in node classification tasks, but the model's performance at low label rates is still unsatisfactory. Previous studies in Semi-Supervised Learning (SSL) for graph have focused on using network predictions to generate soft pseudo-labels or instructing message propagation, which inevitably contains the incorrect prediction due to the over-confident in the predictions. Our proposed Dual-Channel Consistency based Graph Convolutional Networks (DCC-GCN) uses dual-channel to extract embeddings from node features and topological structures, and then achieves reliable low-confidence and high-confidence samples selection based on dual-channel consistency. We further confirmed that the low-confidence samples obtained based on dual-channel consistency were low in accuracy, constraining the model's performance. Unlike previous studies ignoring low-confidence samples, we calibrate the feature embeddings of the low-confidence samples by using the neighborhood's high-confidence samples. Our experiments have shown that the DCC-GCN can more accurately distinguish between low-confidence and high-confidence samples, and can also significantly improve the accuracy of low-confidence samples. We conducted extensive experiments on the benchmark datasets and demonstrated that DCC-GCN is significantly better than state-of-the-art baselines at different label rates.

cs.LG↗

arXiv2022

Boosting-GNN: Boosting Algorithm for Graph Networks on Imbalanced Node Classification

The Graph Neural Network (GNN) has been widely used for graph data representation. However, the existing researches only consider the ideal balanced dataset, and the imbalanced dataset is rarely considered. Traditional methods such as resampling, reweighting, and synthetic samples that deal with imbalanced datasets are no longer applicable in GNN. This paper proposes an ensemble model called Boosting-GNN, which uses GNNs as the base classifiers during boosting. In Boosting-GNN, higher weights are set for the training samples that are not correctly classified by the previous classifier, thus achieving higher classification accuracy and better reliability. Besides, transfer learning is used to reduce computational cost and increase fitting ability. Experimental results indicate that the proposed Boosting-GNN model achieves better performance than GCN, GraphSAGE, GAT, SGC, N-GCN, and most advanced reweighting and resampling methods on synthetic imbalanced datasets, with an average performance improvement of 4.5%

cs.LG↗

arXiv2022

Dimensionality-controlled evolution of charge-transfer energy in digital nickelates superlattices

Fundamental understanding and control of the electronic structure evolution in rare-earth nickelates is a fascinating and meaningful issue, as well as being helpful to understand the mechanism of recently discovered superconductivity. Here we systematically study the dimensionality effect on the ground electronic state in high-quality (NdNiO3)m/(SrTiO3)1 superlattices through transport and soft x-ray absorption spectroscopy. The metal-to-insulator transition temperature decreases with the thickness of the NdNiO3 slab decreasing from bulk to 7 unit cells, then increases gradually as m further reduces to 1 unit cell. Spectral evidence demonstrates that the stabilization of insulating phase can be attributed to the increase of the charge-transfer energy between O 2p and Ni 3d bands. The prominent multiplet feature on the Ni L3 edge develops with the decrease of NdNiO3 slab thickness, suggesting the strengthening of the charge disproportionate state under the dimensional confinement. Our work provides convincing evidence that dimensionality is an effective knob to modulate the charge-transfer energy and thus the collective ground state in nickelates.

cond-mat.mtrl-sci↗

arXiv2022

Unsupervised Image-to-Image Translation with Generative Prior

Unsupervised image-to-image translation aims to learn the translation between two visual domains without paired data. Despite the recent progress in image translation models, it remains challenging to build mappings between complex domains with drastic visual discrepancies. In this work, we present a novel framework, Generative Prior-guided UNsupervised Image-to-image Translation (GP-UNIT), to improve the overall quality and applicability of the translation algorithm. Our key insight is to leverage the generative prior from pre-trained class-conditional GANs (e.g., BigGAN) to learn rich content correspondences across various domains. We propose a novel coarse-to-fine scheme: we first distill the generative prior to capture a robust coarse-level content representation that can link objects at an abstract semantic level, based on which fine-level content features are adaptively learned for more accurate multi-level content correspondences. Extensive experiments demonstrate the superiority of our versatile framework over state-of-the-art methods in robust, high-quality and diversified translations, even for challenging and distant domains.

cs.CV↗

arXiv2022

Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer

Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data. In this paper, we explore more challenging exemplar-based high-resolution portrait style transfer by introducing a novel DualStyleGAN with flexible control of dual styles of the original face domain and the extended artistic portrait domain. Different from StyleGAN, DualStyleGAN provides a natural way of style transfer by characterizing the content and style of a portrait with an intrinsic style path and a new extrinsic style path, respectively. The delicately designed extrinsic style path enables our model to modulate both the color and complex structural styles hierarchically to precisely pastiche the style example. Furthermore, a novel progressive fine-tuning scheme is introduced to smoothly transform the generative space of the model to the target domain, even with the above modifications on the network architecture. Experiments demonstrate the superiority of DualStyleGAN over state-of-the-art methods in high-quality portrait style transfer and flexible style control.

cs.CV↗

arXiv2021

Observation of Aharonov-Bohm effect in PbTe nanowire networks

We report phase coherent electron transport in PbTe nanowire networks with a loop geometry. Magneto-conductance shows Aharonov-Bohm (AB) oscillations with periods of $h/e$ and $h/2e$ in flux. The amplitude of $h/2e$ oscillations is enhanced near zero magnetic field, possibly due to interference between time-reversal paths. Temperature dependence of the AB amplitudes suggests a phase coherence length $\sim$ 8 - 12 $μ$m at 50 mK. This length scale is larger than the typical geometry of PbTe-based hybrid semiconductor-superconductor nanowire devices.

cond-mat.mes-hall↗

arXiv2021

Probing the magnetic polaron state in the ferromagnetic semiconductor HgCr$_2$Se$_4$ with resistance fluctuation and muon-spin spectroscopy measurements

Combined resistance noise and muon-spin relaxation ($μ$SR) measurements of the ferromagnetic semiconductor HgCr$_2$Se$_4$ suggest a degree of magnetoelectric coupling and provide evidence for the existence of isolated magnetic polarons. These form at elevated temperatures and undergo a percolation transition with a drastic enhancement of the low-frequency 1/$f$-type charge fluctuations at the insulator-to-metal transition at $\sim 95 - 98$ K in the vicinity of the magnetic ordering temperature $T_C \sim 105 - 107$ K. Upon approaching the percolation threshold from above, the strikingly unusual dynamics of a distinct two-level fluctuator superimposed on the $1/f$ noise can be described by a slowing down of the dynamics of a nanoscale magnetic cluster, a magnetic polaron, when taking into account an effective radius of the polaron depending on the spin correlation length. Coinciding temperature scales found in $μ$SR and noise measurements suggest changes in the magnetic dynamics over a wide range of frequencies and are consistent with the existence of large polarized and domain-wall-like regions at low temperatures, that result from the freezing of spin dynamics at the magnetic polaron percolation transition.

cond-mat.str-el↗

arXiv2021

Selective area epitaxy of PbTe-Pb hybrid nanowires on a lattice-matched substrate

Topological quantum computing is based on braiding of Majorana zero modes encoding topological qubits. A promising candidate platform for Majorana zero modes is semiconductor-superconductor hybrid nanowires. The realization of topological qubits and braiding operations requires scalable and disorder-free nanowire networks. Selective area growth of in-plane InAs and InSb nanowires, together with shadow-wall growth of superconductor structures, have demonstrated this scalability by achieving various network structures. However, the noticeable lattice mismatch at the nanowire-substrate interface, acting as a disorder source, imposes a serious obstacle along with this roadmap. Here, combining selective area and shadow-wall growth, we demonstrate the fabrication of PbTe-Pb hybrid nanowires - another potentially promising Majorana system - on a nearly perfectly lattice-matched substrate CdTe, all done in one molecular beam epitaxy chamber. Transmission electron microscopy shows the single-crystal nature of the PbTe nanowire and its atomically sharp and clean interfaces to the CdTe substrate and the Pb overlayer, without noticeable inter-diffusion or strain. The nearly ideal interface condition, together with the strong screening of charge impurities due to the large dielectric constant of PbTe, hold promise towards a clean nanowire system to study Majorana zero modes and topological quantum computing.

cond-mat.mes-hall↗

arXiv2021

ShapeEditer: a StyleGAN Encoder for Face Swapping

In this paper, we propose a novel encoder, called ShapeEditor, for high-resolution, realistic and high-fidelity face exchange. First of all, in order to ensure sufficient clarity and authenticity, our key idea is to use an advanced pretrained high-quality random face image generator, i.e. StyleGAN, as backbone. Secondly, we design ShapeEditor, a two-step encoder, to make the swapped face integrate the identity and attribute of the input faces. In the first step, we extract the identity vector of the source image and the attribute vector of the target image respectively; in the second step, we map the concatenation of identity vector and attribute vector into the $\mathcal{W+}$ potential space. In addition, for learning to map into the latent space of StyleGAN, we propose a set of self-supervised loss functions with which the training data do not need to be labeled manually. Extensive experiments on the test dataset show that the results of our method not only have a great advantage in clarity and authenticity than other state-of-the-art methods, but also reflect the sufficient integration of identity and attribute.

cs.CV↗

arXiv2021

Towards Efficient Local Causal Structure Learning

Local causal structure learning aims to discover and distinguish direct causes (parents) and direct effects (children) of a variable of interest from data. While emerging successes have been made, existing methods need to search a large space to distinguish direct causes from direct effects of a target variable T. To tackle this issue, we propose a novel Efficient Local Causal Structure learning algorithm, named ELCS. Specifically, we first propose the concept of N-structures, then design an efficient Markov Blanket (MB) discovery subroutine to integrate MB learning with N-structures to learn the MB of T and simultaneously distinguish direct causes from direct effects of T. With the proposed MB subroutine, ELCS starts from the target variable, sequentially finds MBs of variables connected to the target variable and simultaneously constructs local causal structures over MBs until the direct causes and direct effects of the target variable have been distinguished. Using eight Bayesian networks the extensive experiments have validated that ELCS achieves better accuracy and efficiency than the state-of-the-art algorithms.

cs.LG↗

arXiv2021

Towards Efficient Local Causal Structure Learning

Local causal structure learning aims to discover and distinguish direct causes (parents) and direct effects (children) of a variable of interest from data. While emerging successes have been made, existing methods need to search a large space to distinguish direct causes from direct effects of a target variable \emph{T}. To tackle this issue, we propose a novel Efficient Local Causal Structure learning algorithm, named ELCS. Specifically, we first propose the concept of N-structures, then design an efficient Markov Blanket (MB) discovery subroutine to integrate MB learning with N-structures to learn the MB of \emph{T} and simultaneously distinguish direct causes from direct effects of \emph{T}. With the proposed MB subroutine, ELCS starts from the target variable, sequentially finds MBs of variables connected to the target variable and simultaneously constructs local causal structures over MBs until the direct causes and direct effects of the target variable have been distinguished. Using eight Bayesian networks the extensive experiments have validated that ELCS achieves better accuracy and efficiency than the state-of-the-art algorithms.

cs.AI↗

arXiv2020

In Situ Epitaxy of Pure Phase Ultra-Thin InAs-Al Nanowires for Quantum Devices

Hybrid semiconductor-superconductor InAs-Al nanowires with uniform and defect-free crystal interfaces are one of the most promising candidates used in the quest for Majorana zero modes (MZMs). However, InAs nanowires often exhibit a high density of randomly distributed twin defects and stacking faults, which result in an uncontrolled and non-uniform InAs-Al interface. Furthermore, this type of disorder can create potential inhomogeneity in the wire, destroy the topological gap, and form trivial sub-gap states mimicking MZM in transport experiments. Further study shows that reducing the InAs nanowire diameter from growth can significantly suppress the formation of these defects and stacking faults. Here, we demonstrate the in situ growth of ultra-thin InAs nanowires with epitaxial Al film by molecular-beam epitaxy. Our InAs diameter (~ 30 nm) is only one-third of the diameters (~ 100 nm) commonly used in literatures. The ultra-thin InAs nanowires are pure phase crystals for various different growth directions, suggesting a low level of disorder. Transmission electron microscopy confirms an atomically sharp and uniform interface between the Al shell and the InAs wire. Quantum transport study on these devices resolves a hard induced superconducting gap and $2e^-$ periodic Coulomb blockade at zero magnetic field, a necessary step for future MZM experiments. A large zero bias conductance peak with a peak height reaching 80% of $2e^2/h$ is observed.

cond-mat.mtrl-sci↗

arXiv2020

Learning causal representations for robust domain adaptation

Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily require large amounts of unlabeled target domain data for learning domain invariant representations to achieve good generalizability on the target domain. In fact, in many real-world applications, target domain data may not always be available. In this paper, we study the cases where at the training phase the target domain data is unavailable and only well-labeled source domain data is available, called robust domain adaptation. To tackle this problem, under the assumption that causal relationships between features and the class variable are robust across domains, we propose a novel Causal AutoEncoder (CAE), which integrates deep autoencoder and causal structure learning into a unified model to learn causal representations only using data from a single source domain. Specifically, a deep autoencoder model is adopted to learn low-dimensional representations, and a causal structure learning model is designed to separate the low-dimensional representations into two groups: causal representations and task-irrelevant representations. Using three real-world datasets the extensive experiments have validated the effectiveness of CAE compared to eleven state-of-the-art methods.

cs.LG↗