Searcharxiv⌕ Search

arXiv subjects

Weijie Zhao

Publications and source records attributed to Weijie Zhao.

53 records · Page 3Linked to original sources

F2GAN: Fusing-and-Filling GAN for Few-shot Image Generation

In order to generate images for a given category, existing deep generative models generally rely on abundant training images. However, extensive data acquisition is expensive and fast learning ability from limited data is necessarily required in real-world applications. Also, these existing methods are not well-suited for fast adaptation to a new category. Few-shot image generation, aiming to generate images from only a few images for a new category, has attracted some research interest. In this paper, we propose a Fusing-and-Filling Generative Adversarial Network (F2GAN) to generate realistic and diverse images for a new category with only a few images. In our F2GAN, a fusion generator is designed to fuse the high-level features of conditional images with random interpolation coefficients, and then fills in attended low-level details with non-local attention module to produce a new image. Moreover, our discriminator can ensure the diversity of generated images by a mode seeking loss and an interpolation regression loss. Extensive experiments on five datasets demonstrate the effectiveness of our proposed method for few-shot image generation.

cs.CV↗

Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems

Neural networks of ads systems usually take input from multiple resources, e.g., query-ad relevance, ad features and user portraits. These inputs are encoded into one-hot or multi-hot binary features, with typically only a tiny fraction of nonzero feature values per example. Deep learning models in online advertising industries can have terabyte-scale parameters that do not fit in the GPU memory nor the CPU main memory on a computing node. For example, a sponsored online advertising system can contain more than $10^{11}$ sparse features, making the neural network a massive model with around 10 TB parameters. In this paper, we introduce a distributed GPU hierarchical parameter server for massive scale deep learning ads systems. We propose a hierarchical workflow that utilizes GPU High-Bandwidth Memory, CPU main memory and SSD as 3-layer hierarchical storage. All the neural network training computations are contained in GPUs. Extensive experiments on real-world data confirm the effectiveness and the scalability of the proposed system. A 4-node hierarchical GPU parameter server can train a model more than 2X faster than a 150-node in-memory distributed parameter server in an MPI cluster. In addition, the price-performance ratio of our proposed system is 4-9 times better than an MPI-cluster solution.

cs.DC↗

Image Cropping with Composition and Saliency Aware Aesthetic Score Map

Aesthetic image cropping is a practical but challenging task which aims at finding the best crops with the highest aesthetic quality in an image. Recently, many deep learning methods have been proposed to address this problem, but they did not reveal the intrinsic mechanism of aesthetic evaluation. In this paper, we propose an interpretable image cropping model to unveil the mystery. For each image, we use a fully convolutional network to produce an aesthetic score map, which is shared among all candidate crops during crop-level aesthetic evaluation. Then, we require the aesthetic score map to be both composition-aware and saliency-aware. In particular, the same region is assigned with different aesthetic scores based on its relative positions in different crops. Moreover, a visually salient region is supposed to have more sensitive aesthetic scores so that our network can learn to place salient objects at more proper positions. Such an aesthetic score map can be used to localize aesthetically important regions in an image, which sheds light on the composition rules learned by our model. We show the competitive performance of our model in the image cropping task on several benchmark datasets, and also demonstrate its generality in real-world applications.

cs.CV↗

Inductive Guided Filter: Real-time Deep Image Matting with Weakly Annotated Masks on Mobile Devices

Recently, significant progress has been achieved in deep image matting. Most of the classical image matting methods are time-consuming and require an ideal trimap which is difficult to attain in practice. A high efficient image matting method based on a weakly annotated mask is in demand for mobile applications. In this paper, we propose a novel method based on Deep Learning and Guided Filter, called Inductive Guided Filter, which can tackle the real-time general image matting task on mobile devices. We design a lightweight hourglass network to parameterize the original Guided Filter method that takes an image and a weakly annotated mask as input. Further, the use of Gabor loss is proposed for training networks for complicated textures in image matting. Moreover, we create an image matting dataset MAT-2793 with a variety of foreground objects. Experimental results demonstrate that our proposed method massively reduces running time with robust accuracy.

cs.CV↗

Distributed Caching for Complex Querying of Raw Arrays

As applications continue to generate multi-dimensional data at exponentially increasing rates, fast analytics to extract meaningful results is becoming extremely important. The database community has developed array databases that alleviate this problem through a series of techniques. In-situ mechanisms provide direct access to raw data in the original format---without loading and partitioning. Parallel processing scales to the largest datasets. In-memory caching reduces latency when the same data are accessed across a workload of queries. However, we are not aware of any work on distributed caching of multi-dimensional raw arrays. In this paper, we introduce a distributed framework for cost-based caching of multi-dimensional arrays in native format. Given a set of files that contain portions of an array and an online query workload, the framework computes an effective caching plan in two stages. First, the plan identifies the cells to be cached locally from each of the input files by continuously refining an evolving R-tree index. In the second stage, an optimal assignment of cells to nodes that collocates dependent cells in order to minimize the overall data transfer is determined. We design cache eviction and placement heuristic algorithms that consider the historical query workload. A thorough experimental evaluation over two real datasets in three file formats confirms the superiority -- by as much as two orders of magnitude -- of the proposed framework over existing techniques in terms of cache overhead and workload execution time.

cs.DB↗

Vapor-Liquid-Solid Growth of Monolayer MoS2 Nanoribbons

Chemical vapor deposition (CVD) of two-dimensional (2D) materials such as monolayer MoS2 typically involves the conversion of vapor-phase precursors to a solid product in a process that may be described as a vapor-solid-solid (VSS) mode. Here, we report the first demonstration of vapor-liquid-solid (VLS) growth of monolayer MoS2 yielding highly crystalline ribbon-shaped structures with a width of a few tens of nanometers to a few micrometers. The VLS growth mode is triggered by the reaction between molybdenum oxide and sodium chloride, which results in the formation of molten Na-Mo-O droplets. These droplets mediate the growth of MoS2 ribbons in the "crawling mode" when saturated with sulfur on a crystalline substrate. Our growth yields straight and kinked ribbons with a locally well-defined orientation, reflecting the regular horizontal motion of the liquid droplets during growth. Using atomic-resolution scanning transmission electron microscopy (STEM) and second harmonic generation (SHG) microscopy, we show that the ribbons are homoepitaxially on monolayer MoS2 surface with predominantly 2H- or 3R-type stacking. These findings pave the way to novel devices with structures of mixed dimensionalities.

cond-mat.mtrl-sci↗

OLA-RAW: Scalable Exploration over Raw Data

In-situ processing has been proposed as a novel data exploration solution in many domains generating massive amounts of raw data, e.g., astronomy, since it provides immediate SQL querying over raw files. The performance of in-situ processing across a query workload is, however, limited by the speed of full scan, tokenizing, and parsing of the entire data. Online aggregation (OLA) has been introduced as an efficient method for data exploration that identifies uninteresting patterns faster by continuously estimating the result of a computation during the actual processing---the computation can be stopped as early as the estimate is accurate enough to be deemed uninteresting. However, existing OLA solutions have a high upfront cost of randomly shuffling and/or sampling the data. In this paper, we present OLA-RAW, a bi-level sampling scheme for parallel online aggregation over raw data. Sampling in OLA-RAW is query-driven and performed exclusively in-situ during the runtime query execution, without data reorganization. This is realized by a novel resource-aware bi-level sampling algorithm that processes data in random chunks concurrently and determines adaptively the number of sampled tuples inside a chunk. In order to avoid the cost of repetitive conversion from raw data, OLA-RAW builds and maintains a memory-resident bi-level sample synopsis incrementally. We implement OLA-RAW inside a modern in-situ data processing system and evaluate its performance across several real and synthetic datasets and file formats. Our results show that OLA-RAW chooses the sampling plan that minimizes the execution time and guarantees the required accuracy for each query in a given workload. The end result is a focused data exploration process that avoids unnecessary work and discards uninteresting data.

cs.DB↗

Engineering bandgaps of monolayer MoS2 and WS2 on fluoropolymer substrates by electrostatically tuned many-body effects

Intrinsic electrical and excitonic properties of monolayer transition metal dichalcogenides are studied on CYTOP fluoropolymer substrates with greatly suppressed unintentional doping and dielectric screening. Ambipolar transport behavior is observed in monolayer WS2 by applying solid states backdates. The excitonic properties of monolayer MoS2 and WS2 are determined by intricate interplays between the bandage renormalization, Pauli blocking and carrier screening against carrier doping.

cond-mat.mtrl-sci↗

Halide-Assisted Atmospheric Pressure Growth of Large WSe2 and WS2 Monolayer Crystals

Chemical vapor deposition (CVD) of two-dimensional (2D) tungsten dichalcogenide crystals requires steady flow of tungsten source in the vapor phase. This often requires high temperature and low pressure due to the high sublimation point of tungsten oxide precursors. We demonstrate atmospheric pressure CVD of WSe2 and WS2 monolayers at moderate temperatures (700 ~ 850 oC) using alkali metal halides (MX where M= Na or K and X=Cl, Br or I) as the growth promoters. We attribute the facilitated growth to the formation of volatile tungsten oxyhalide species during growth, which leads to efficient delivery of the precursor to the growth substrates. The monolayer crystals were found to be free of unintentional doping with alkali metal and halogen atoms. Good field-effect transistor (FET) performances with high current on/off ratio ~10 7, hole and electron mobilities up to 102 and 26 cm2 V 1 s-1 for WSe2 and electron mobility of ~14 cm2 V-1 s-1 for WS2 devices were achieved.

cond-mat.mtrl-sci↗

Workload-Driven Vertical Partitioning for Effective Query Processing over Raw Data

Traditional databases are not equipped with the adequate functionality to handle the volume and variety of "Big Data". Strict schema definition and data loading are prerequisites even for the most primitive query session. Raw data processing has been proposed as a schema-on-demand alternative that provides instant access to the data. When loading is an option, it is driven exclusively by the current-running query, resulting in sub-optimal performance across a query workload. In this paper, we investigate the problem of workload-driven raw data processing with partial loading. We model loading as fully-replicated binary vertical partitioning. We provide a linear mixed integer programming optimization formulation that we prove to be NP-hard. We design a two-stage heuristic that comes within close range of the optimal solution in a fraction of the time. We extend the optimization formulation and the heuristic to pipelined raw data processing, scenario in which data access and extraction are executed concurrently. We provide three case-studies over real data formats that confirm the accuracy of the model when implemented in a state-of-the-art pipelined operator for raw data processing.

cs.DB↗

Nonlinear Photoluminescence in Atomically Thin Layered WSe2 Arising from Diffusion-Assisted Exciton-Exciton Annihilation

We studied multi-exciton dynamics in monolayer WSe2 using nonlinear photoluminescence (PL) spectroscopy and Monte Carlo simulations. We observed strong nonlinear saturation behavior of exciton PL with increasing excitation power density, and long-distance exciton diffusion reaching several micrometers. We demonstrated that the diffusion-assisted exciton-exciton annihilation model accounts for the observed nonlinear PL behavior. The long-distance exciton diffusion and subsequent efficient exciton-exciton annihilation process determined the unusual multi-exciton dynamics in atomically thin layered transition metal dichalcogenides.

cond-mat.mes-hall↗

Photocarrier relaxation in two-dimensional semiconductors

Two-dimensional (2D) crystals of semiconducting transition metal dichalcogenides (TMD) absorb a large fraction of incident photons in the visible frequencies despite being atomically thin. It has been suggested that the strong absorption is due to the parallel band or "band nesting" effect and corresponding divergence in the joint density of states. Here, we show using photoluminescence excitation spectroscopy that the band nesting in mono- and bilayer MX$_2$ (M = Mo, W and X = S, Se) results in excitation-dependent characteristic relaxation pathways of the photoexcited carriers. Our experimental and simulation results reveal that photoexcited electron-hole pairs in the nesting region spontaneously separate in the $k$-space, relaxing towards immediate band extrema with opposite momentum. These effects imply that the loss of photocarriers due to direct exciton recombination is temporarily suppressed for excitation in resonance with band nesting. Our findings highlight the potential for efficient hot carrier collection using these materials as the absorbers in optoelectronic devices.

cond-mat.mtrl-sci↗

Transport properties of monolayer MoS$_2$ grown by chemical vapour deposition

Recent success in the growth of monolayer MoS$_2$ via chemical vapor deposition (CVD) has opened up prospects for the implementation of these materials into thin film electronic and optoelectronic devices. Here, we investigate the electronic transport properties of individual crystallites of high quality CVD-grown monolayer MoS$_2$. The devices show low temperature mobilities up to 500 cm$^2$V$^{-1}$s$^{-1}$ and a clear signature of metallic conduction at high doping densities. These characteristics are comparable to the electronic properties of the best mechanically exfoliated monolayers in literature, verifying the high electronic quality of the CVD-grown materials. We analyze the different scattering mechanisms and show, that the short-range scattering plays a dominant role in the highly conducting regime at low temperatures. Additionally, the influence of phonons as a limiting factor of these devices is discussed.

cond-mat.mes-hall↗

Lattice dynamics in mono- and few-layer sheets of WS2 and WSe2

Thickness is one of the fundamental parameters that define the electronic, optical, and thermal properties of two-dimensional (2D) crystals. Phonons in molybdenum disulfide (MoS2) were recently found to exhibit unique thickness dependence due to interplay between short and long range interactions. Here we report Raman spectra of atomically thin sheets of WS2 and WSe2 in the mono- to few-layer thickness regime. We show that, similar to the case of MoS2, the characteristic and modes exhibit stiffening and softening with increasing number of layers, respectively, with a small shift of less than 3 cm-1 due to large mass of the atoms. Thickness dependence is also observed in a series of multiphonon bands arising from overtone, combination, and zone edge phonons, whose intensity exhibit significant enhancement in excitonic resonance conditions. Some of these multiphonon peaks are found to be absent only in monolayers. These features provide a unique fingerprint and rapid identification for monolayer flakes.

cond-mat.mtrl-sci↗

Origin of indirect optical transitions in few-layer MoS2, WS2 and WSe2

It has been well established that single layer MX2 (M=Mo,W and X=S,Se) are direct gap semiconductors with band edges coinciding at the K point in contrast to their indirect gap multilayer counterparts. In few-layer MX2, there are two valleys along the Γ-K line with similar energy. There is little understanding on which of the two valleys forms the conduction band minimum (CBM) in this thickness regime. We investigate the conduction band valley structure in few-layer MX2 by examining the temperature-dependent shift of indirect exciton PL. Hihgly anisotropic thermal expansion of the lattice and corresponding evolution of the band structure result in distinct peak shift for indirect transitions involving the K and Λ (midpoint along Γ-K) valleys. We identify the origin of the indirect emission and concurrently determine the relative energy of these valleys. Our results show that the two valleys compete in energy in few-layer WSe2.

cond-mat.mtrl-sci↗

An innovative way of etching MoS2: Characterization and mechanistic investigation

We report a systematic study of the etching of MoS2 crystals by using XeF2 as a gaseous reactant. By controlling the etching process, monolayer MoS2 with uniform morphology can be obtained. The Raman and photoluminescence spectra of the resulting material were similar to those of exfoliated MoS2. Utilizing this strategy, different patterns such as a Hall bar structure and a hexagonal array can be realized. Furthermore, the etching mechanism was studied by introducing graphene as an etching mask. We believe our technique opens an easy and controllable way of etching MoS2, which can be used to fabricate complex nanostructures, such as nanoribbons, quantum dots and transistor structures. This etching process using XeF2 can also be extended to other interesting two-dimensional crystals.

cond-mat.mes-hall↗

Evolution of Electronic Structure in Atomically Thin Sheets of WS2 and WSe2

Geometrical confinement effect in exfoliated sheets of layered materials leads to significant evolution of energy dispersion with decreasing layer thickness. Molybdenum disulphide (MoS2) was recently found to exhibit indirect to direct gap transition when the thickness is reduced to a single monolayer. This leads to remarkable enhancement in the photoluminescence efficiency, which opens up new opportunities for the optoelectronic applications of the material. Here we report differential reflectance and photoluminescence (PL) spectra of mono- to few-layer WS2 and WSe2 that indicate that the band structure of these materials undergoes similar indirect to direct transition when thinned to a single monolayer. Strong enhancement in PL quantum yield is observed for monoayer WS2 and WSe2 due to exciton recombination at the direct band edge. In contrast to natural MoS2 crystals extensively used in recent studies, few-layer WS2 and WSe2 show comparatively strong indirect gap emission along with distinct direct gap hot electron emission, suggesting high quality of synthetic crystals prepared by chemical vapor transport method. Fine absorption and emission features and their thickness dependence suggest strong effect of Se p-orbitals on the d electron band structure as well as interlayer coupling in WSe2.

cond-mat.mtrl-sci↗