arXiv subjects

Wenrui Zhang

Publications and source records attributed to Wenrui Zhang.

25 records · Page 2Linked to original sources

arXiv2020

Unusual Electrical Conductivity Driven by Localized Stoichiometry Modification at Vertical Epitaxial Interfaces

Precise control of lattice mismatch accommodation and cation interdiffusion across the interface is critical to modulate correlated functionalities in epitaxial heterostructures, particularly when the interface composition is positioned near a compositional phase transition boundary. Here we select La1-xSrxMnO3 (LSMO) as a prototypical phase transition material and establish vertical epitaxial interfaces with NiO to explore the strong interplay between strain accommodation, stoichiometry modification, and localized electron transport across the interface. It is found that localized stoichiometry modification overcomes the plaguing dead layer problem in LSMO and leads to strongly directional conductivity, as manifested by more than three orders of magnitude difference between out-of-plane to in-plane conductivity. Comprehensive structural characterization and transport measurements reveal that this emerging behavior is related to a compositional change produced by directional cation diffusion that pushes the LSMO phase transition from insulating into metallic within an ultrathin interface region. This study explores the nature of unusual electric conductivity at vertical epitaxial interfaces and establishes an effective route for engineering nanoscale electron transport for oxide electronics.

cond-mat.mtrl-sci↗

arXiv2020

Applying configurational complexity to the 2D Ruddlesden-Popper crystal structure

The 2D layered Ruddlesden-Popper crystal structure can host a broad range of functionally important behaviors. Here we establish extraordinary configurational disorder in a two dimensional layered Ruddlesden-Popper (RP) structure using entropy stabilization assisted synthesis. A protype A2CuO4 RP cuprate oxide with five components (La, Pr, Nd, Sm, Eu) on the A-site sublattice is designed and fabricated into epitaxial single crystal films using pulsed laser deposition. By comparing (La0.2Pr0.2Nd0.2Sm0.2Eu0.2)2CuO4 crystals grown under identical conditions but different substrates, it is found that heteroepitaxial strain plays an important role in crystal phase formation. When grown on a near lattice matched substrate, the high entropy oxide film features a T'-type RP structure with uniform A-site cation mixing and square-planar CuO4 units, however, growing under strong compressive strain results in a single crystal non-RP cubic phase consistent with a CuX2O4 spinel structure. These observations are made with a range of combined characterizations using X-ray diffraction, atomic-resolution scanning transmission electron microscopy, energy-dispersive X-ray spectroscopy, and X-ray absorption spectroscopy measurements. Designing configurational complexity and moving between 2D layered RP and 3D cubic crystal structures in this class of cuprate materials opens many opportunities for new design strategies related to magnetoresistance, unconventional superconductivity, ferroelectricity, catalysis, and ion transport.

cond-mat.mtrl-sci↗

arXiv2019

Spike-Train Level Backpropagation for Training Deep Recurrent Spiking Neural Networks

Spiking neural networks (SNNs) well support spatiotemporal learning and energy-efficient event-driven hardware neuromorphic processors. As an important class of SNNs, recurrent spiking neural networks (RSNNs) possess great computational power. However, the practical application of RSNNs is severely limited by challenges in training. Biologically-inspired unsupervised learning has limited capability in boosting the performance of RSNNs. On the other hand, existing backpropagation (BP) methods suffer from high complexity of unrolling in time, vanishing and exploding gradients, and approximate differentiation of discontinuous spiking activities when applied to RSNNs. To enable supervised training of RSNNs under a well-defined loss function, we present a novel Spike-Train level RSNNs Backpropagation (ST-RSBP) algorithm for training deep RSNNs. The proposed ST-RSBP directly computes the gradient of a rated-coded loss function defined at the output layer of the network w.r.t tunable parameters. The scalability of ST-RSBP is achieved by the proposed spike-train level computation during which temporal effects of the SNN is captured in both the forward and backward pass of BP. Our ST-RSBP algorithm can be broadly applied to RSNNs with a single recurrent layer or deep RSNNs with multiple feed-forward and recurrent layers. Based upon challenging speech and image datasets including TI46, N-TIDIGITS, Fashion-MNIST and MNIST, ST-RSBP is able to train RSNNs with an accuracy surpassing that of the current state-of-art SNN BP algorithms and conventional non-spiking deep learning models.

cs.NE↗

arXiv2019

Boosting Throughput and Efficiency of Hardware Spiking Neural Accelerators using Time Compression Supporting Multiple Spike Codes

Spiking neural networks (SNNs) are the third generation of neural networks and can explore both rate and temporal coding for energy-efficient event-driven computation. However, the decision accuracy of existing SNN designs is contingent upon processing a large number of spikes over a long period. Nevertheless, the switching power of SNN hardware accelerators is proportional to the number of spikes processed while the length of spike trains limits throughput and static power efficiency. This paper presents the first study on developing temporal compression to significantly boost throughput and reduce energy dissipation of digital hardware SNN accelerators while being applicable to multiple spike codes. The proposed compression architectures consist of low-cost input spike compression units, novel input-and-output-weighted spiking neurons, and reconfigurable time constant scaling to support large and flexible time compression ratios. Our compression architectures can be transparently applied to any given pre-designed SNNs employing either rate or temporal codes while incurring minimal modification of the neural models, learning algorithms, and hardware design. Using spiking speech and image recognition datasets, we demonstrate the feasibility of supporting large time compression ratios of up to 16x, delivering up to 15.93x, 13.88x, and 86.21x improvements in throughput, energy dissipation, the tradeoffs between hardware area, runtime, energy, and classification accuracy, respectively based on different spike codes on a Xilinx Zynq-7000 FPGA. These results are achieved while incurring little extra hardware overhead.

cs.NE↗

arXiv2019

Multiple Linear Regression Haze-removal Model Based on Dark Channel Prior

Dark Channel Prior (DCP) is a widely recognized traditional dehazing algorithm. However, it may fail in bright region and the brightness of the restored image is darker than hazy image. In this paper, we propose an effective method to optimize DCP. We build a multiple linear regression haze-removal model based on DCP atmospheric scattering model and train this model with RESIDE dataset, which aims to reduce the unexpected errors caused by the rough estimations of transmission map t(x) and atmospheric light A. The RESIDE dataset provides enough synthetic hazy images and their corresponding groundtruth images to train and test. We compare the performances of different dehazing algorithms in terms of two important full-reference metrics, the peak-signal-to-noise ratio (PSNR) as well as the structural similarity index measure (SSIM). The experiment results show that our model gets highest SSIM value and its PSNR value is also higher than most of state-of-the-art dehazing algorithms. Our results also overcome the weakness of DCP on real-world hazy images

cs.CV↗

arXiv2019

Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural Networks

Spiking neural networks (SNNs) are positioned to enable spatio-temporal information processing and ultra-low power event-driven neuromorphic hardware. However, SNNs are yet to reach the same performances of conventional deep artificial neural networks (ANNs), a long-standing challenge due to complex dynamics and non-differentiable spike events encountered in training. The existing SNN error backpropagation (BP) methods are limited in terms of scalability, lack of proper handling of spiking discontinuities, and/or mismatch between the rate-coded loss function and computed gradient. We present a hybrid macro/micro level backpropagation (HM2-BP) algorithm for training multi-layer SNNs. The temporal effects are precisely captured by the proposed spike-train level post-synaptic potential (S-PSP) at the microscopic level. The rate-coded errors are defined at the macroscopic level, computed and back-propagated across both macroscopic and microscopic levels. Different from existing BP methods, HM2-BP directly computes the gradient of the rate-coded loss function w.r.t tunable parameters. We evaluate the proposed HM2-BP algorithm by training deep fully connected and convolutional SNNs based on the static MNIST [14] and dynamic neuromorphic N-MNIST [26]. HM2-BP achieves an accuracy level of 99.49% and 98.88% for MNIST and N-MNIST, respectively, outperforming the best reported performances obtained from the existing SNN BP algorithms. Furthermore, the HM2-BP produces the highest accuracies based on SNNs for the EMNIST [3] dataset, and leads to high recognition accuracy for the 16-speaker spoken English letters of TI46 Corpus [16], a challenging patio-temporal speech recognition benchmark for which no prior success based on SNNs was reported. It also achieves competitive performances surpassing those of conventional deep learning models when dealing with asynchronous spiking streams.

cs.NE↗

arXiv2017

Manipulating Multiple Order Parameters via Oxygen Vacancies: The case of Eu0.5Ba0.5TiO3-δ

Controlling functionalities, such as magnetism or ferroelectricity, by means of oxygen vacancies (VO) is a key issue for the future development of transition metal oxides. Progress in this field is currently addressed through VO variations and their impact on mainly one order parameter. Here we reveal a new mechanism for tuning both magnetism and ferroelectricity simultaneously by using VO. Combined experimental and density-functional theory studies of Eu0.5Ba0.5TiO3-δ, we demonstrate that oxygen vacancies create Ti3+ 3d1 defect states, mediating the ferromagnetic coupling between the localized Eu 4f7 spins, and increase an off-center displacement of Ti ions, enhancing the ferroelectric Curie temperature. The dual function of Ti sites also promises a magnetoelectric coupling in the Eu0.5Ba0.5TiO3-δ.

cond-mat.mtrl-sci↗