arXiv subjects

Shang Wang

Publications and source records attributed to Shang Wang.

42 records · Page 3Linked to original sources

arXiv2021

Strong-field response time and its implications on attosecond measurement

To measure and control the electron motion in atoms and molecules by the strong laser field on the attosecond time scale is one of the research frontiers of atomic and molecular photophysics. It involves many new phenomena and processes and raises a series of questions of concepts, theories and methods. Recent studies show that the Coulomb potential can cause the ionization time lag (about 100 attoseconds) between instants of the field maximum and the ionization-rate maximum. This lag can be understood as the response time of the electronic wave function to the strong-field-induced ionization event. It has a profound influence on the subsequent ultrafast dynamics of the ionized electron and can significantly change the time-frequency properties of electron trajectory (an important theoretical tool for attosecond measurement). Here, the research progress of response time and its implications on attosecond measurement are briefly introduced.

physics.atom-ph↗

arXiv2021

Horizontally Fused Training Array: An Effective Hardware Utilization Squeezer for Training Novel Deep Learning Models

Driven by the tremendous effort in researching novel deep learning (DL) algorithms, the training cost of developing new models increases staggeringly in recent years. We analyze GPU cluster usage statistics from a top research institute for more insights into the hardware efficiency achieved by typical DL training jobs. Our study reveals that single-accelerator training jobs can dominate the cluster-wide resource consumption when launched repetitively (e.g., for hyper-parameter tuning) while severely under-utilizing the hardware. Fortunately, we observe that such workloads have the following unique characteristics: (i) the models among jobs often have the same types of operators with the same shapes, and (ii) the inter-model horizontal fusion of such operators is mathematically equivalent to other already well-optimized operators. Thus, to help DL researchers and practitioners effectively improve the hardware utilization of their novel DL training workloads, we propose Horizontally Fused Training Array (HFTA). HFTA is a new DL framework extension library that horizontally fuses the models from different repetitive jobs deeply down to operators and then trains them simultaneously on a shared accelerator. To show the generality of our solution, we apply HFTA to six DL models training on state-of-the-art accelerators (GPUs and TPUs). Our results indicate that HFTA is highly effective in improving hardware utilization and achieves up to $15.1 \times$ higher training throughput vs. the standard practice of running each job on a separate accelerator.

cs.LG↗

arXiv2021

Characterizing Sub-Cycle Electron Dynamics of Polar Molecules by Asymmetry in Photoelectron Momentum Distributions

Strong-field ionization of polar molecules contains rich dynamical processes such as tunneling, excitation, and Stark shift. These processes occur on a sub-cycle time scale and are difficult to distinguish in ultrafast measurements. Here, with a developed strong-field model considering effects of both Coulomb and permanent dipole, we show that photoelectron momentum distributions (PMDs) in orthogonal two-color laser fields can be utilized to resolve these processes with attosecond-scale resolution. A feature quantity related to the asymmetry in PMDs is obtained, with which the complex electron dynamics of polar molecules in each half laser cycle is characterized and the subtle time difference when electrons escaping from different sides of the polar molecule is identified.

physics.atom-ph↗

arXiv2020

Learned Variable-Rate Multi-Frequency Image Compression using Modulated Generalized Octave Convolution

In this proposal, we design a learned multi-frequency image compression approach that uses generalized octave convolutions to factorize the latent representations into high-frequency (HF) and low-frequency (LF) components, and the LF components have lower resolution than HF components, which can improve the rate-distortion performance, similar to wavelet transform. Moreover, compared to the original octave convolution, the proposed generalized octave convolution (GoConv) and octave transposed-convolution (GoTConv) with internal activation layers preserve more spatial structure of the information, and enable more effective filtering between the HF and LF components, which further improve the performance. In addition, we develop a variable-rate scheme using the Lagrangian parameter to modulate all the internal feature maps in the auto-encoder, which allows the scheme to achieve the large bitrate range of the JPEG AI with only three models. Experiments show that the proposed scheme achieves much better Y MS-SSIM than VVC. In terms of YUV PSNR, our scheme is very similar to HEVC.

eess.IV↗

arXiv2020

BPPSA: Scaling Back-propagation by Parallel Scan Algorithm

In an era when the performance of a single compute device plateaus, software must be designed to scale on massively parallel systems for better runtime performance. However, in the context of training deep learning models, the popular back-propagation (BP) algorithm imposes a strong sequential dependency in the process of gradient computation. Under model parallelism, BP takes $Θ(n)$ steps to complete which hinders its scalability on parallel systems ($n$ represents the number of compute devices into which a model is partitioned). In this work, in order to improve the scalability of BP, we reformulate BP into a scan operation which is a primitive that performs an in-order aggregation on a sequence of values and returns the partial result at each step. We can then scale such reformulation of BP on parallel systems by our modified version of the Blelloch scan algorithm which theoretically takes $Θ(\log n)$ steps. We evaluate our approach on a vanilla Recurrent Neural Network (RNN) training with synthetic datasets and a RNN with Gated Recurrent Units (GRU) training with the IRMAS dataset, and demonstrate up to $2.75\times$ speedup on the overall training time and $108\times$ speedup on the backward pass. We also demonstrate that the retraining of pruned networks can be a practical use case of our method.

cs.LG↗

arXiv2019

Prema: A Tool for Precise Requirements Editing, Modeling and Analysis

We present Prema, a tool for Precise Requirement Editing, Modeling and Analysis. It can be used in various fields for describing precise requirements using formal notations and performing rigorous analysis. By parsing the requirements written in formal modeling language, Prema is able to get a model which aptly depicts the requirements. It also provides different rigorous verification and validation techniques to check whether the requirements meet users' expectation and find potential errors. We show that our tool can provide a unified environment for writing and verifying requirements without using tools that are not well inter-related. For experimental demonstration, we use the requirements of the automatic train protection (ATP) system of CASCO signal co. LTD., the largest railway signal control system manufacturer of China. The code of the tool cannot be released here because the project is commercially confidential. However, a demonstration video of the tool is available at https://youtu.be/BX0yv8pRMWs.

cs.FL↗