arXiv subjects

Xuan Cheng

Publications and source records attributed to Xuan Cheng.

23 records · Page 2Linked to original sources

arXiv2021

Self-supervised Feature Enhancement: Applying Internal Pretext Task to Supervised Learning

Traditional self-supervised learning requires CNNs using external pretext tasks (i.e., image- or video-based tasks) to encode high-level semantic visual representations. In this paper, we show that feature transformations within CNNs can also be regarded as supervisory signals to construct the self-supervised task, called \emph{internal pretext task}. And such a task can be applied for the enhancement of supervised learning. Specifically, we first transform the internal feature maps by discarding different channels, and then define an additional internal pretext task to identify the discarded channels. CNNs are trained to predict the joint labels generated by the combination of self-supervised labels and original labels. By doing so, we let CNNs know which channels are missing while classifying in the hope to mine richer feature information. Extensive experiments show that our approach is effective on various models and datasets. And it's worth noting that we only incur negligible computational overhead. Furthermore, our approach can also be compatible with other methods to get better results.

cs.CV↗

arXiv2021

Self-supervision of Feature Transformation for Further Improving Supervised Learning

Self-supervised learning, which benefits from automatically constructing labels through pre-designed pretext task, has recently been applied for strengthen supervised learning. Since previous self-supervised pretext tasks are based on input, they may incur huge additional training overhead. In this paper we find that features in CNNs can be also used for self-supervision. Thus we creatively design the \emph{feature-based pretext task} which requires only a small amount of additional training overhead. In our task we discard different particular regions of features, and then train the model to distinguish these different features. In order to fully apply our feature-based pretext task in supervised learning, we also propose a novel learning framework containing multi-classifiers for further improvement. Original labels will be expanded to joint labels via self-supervision of feature transformations. With more semantic information provided by our self-supervised tasks, this approach can train CNNs more effectively. Extensive experiments on various supervised learning tasks demonstrate the accuracy improvement and wide applicability of our method.

cs.CV↗

arXiv2021

FocusedDropout for Convolutional Neural Network

In convolutional neural network (CNN), dropout cannot work well because dropped information is not entirely obscured in convolutional layers where features are correlated spatially. Except randomly discarding regions or channels, many approaches try to overcome this defect by dropping influential units. In this paper, we propose a non-random dropout method named FocusedDropout, aiming to make the network focus more on the target. In FocusedDropout, we use a simple but effective way to search for the target-related features, retain these features and discard others, which is contrary to the existing methods. We found that this novel method can improve network performance by making the network more target-focused. Besides, increasing the weight decay while using FocusedDropout can avoid the overfitting and increase accuracy. Experimental results show that even a slight cost, 10\% of batches employing FocusedDropout, can produce a nice performance boost over the baselines on multiple datasets of classification, including CIFAR10, CIFAR100, Tiny Imagenet, and has a good versatility for different CNN models.

cs.CV↗

arXiv2021

Predicting nanocrystal morphology governed by interfacial strain

The shape dependence for the technologically important nickel oxide (NiO) nanocrystals on (001) strontium titanate substrates is investigated under the generalized Wulff-Kaichew (GWK) theorem framework. It is found that the shape of the NiO nanocrystals is primarily governed by the existence (or absence) of interfacial strain. Nanocrystals that have a fully pseudomorphic interface with the substrate (i.e. the epitaxial strain is not relaxed) form an embedded smooth ball-crown morphology with {001}, {011}, {111} and high-index {113} exposed facets with a negative Wulff point. On the other hand, when the interfacial strain is relaxed by misfit dislocations, the nanocrystals take on a truncated pyramidal shape, bounded by {111} faces and a {001} flat top, with a positive Wulff point. Our quantitative model is able to predict both experimentally observed shapes and sizes with good accuracy. Given the increasing demand for hetero-epitaxial nanocrystals in various physio-chemical and electro-chemical functional devices, these results lay the important groundwork in exploiting the GWK theorem as a general analytical approach to explain hetero-epitaxial nanocrystal growth on oxide substrates governed by interface strain.

cond-mat.mtrl-sci↗

arXiv2021

Super-R BiFeO$_3$: Epitaxial stabilization of a low-symmetry phase with giant electromechanical response

Piezoelectrics interconvert mechanical energy and electric charge and are widely used in actuators and sensors. The best performing materials are ferroelectrics at a morphotropic phase boundary (MPB), where several phases can intimately coexist. Switching between these phases by electric field produces a large electromechanical response. In the ferroelectric BiFeO$_3$, strain can be used to create an MPB-like phase mixture and thus to generate large electric field dependent strains. However, this enhanced response occurs at localized, randomly positioned regions of the film, which potentially complicates nanodevice design. Here, we use epitaxial strain and orientation engineering in tandem - anisotropic epitaxy - to craft a hitherto unavailable low-symmetry phase of BiFeO$_3$ which acts as a structural bridge between the rhombohedral-like and tetragonal-like polymorphs. Interferometric displacement sensor measurements and first-principle calculations reveal that under external electric bias, this phase undergoes a transition to the tetragonal-like polymorph, generating a piezoelectric response enhanced by over 200%, and associated giant field-induced reversible strain. These results offer a new route to engineer giant electromechanical properties in thin films, with broader perspectives for other functional oxide systems.

cond-mat.mtrl-sci↗