arXiv subjects

Hao Zhang

Publications and source records attributed to Hao Zhang.

At least 937 records · Page 52Linked to original sources

arXiv2022

Connection-oriented and Connectionless Quantum Internet Considering Quantum Repeaters

With the rapid development of quantum information and technology in recent years, the construction of quantum internet for interconnecting all kinds of quantum devices, such as quantum processors and sensors, will be the next trend for practical quantum applications. In this paper, we propose the protocols for construction of connection-oriented and connectionless quantum networks by considering the concrete quantum repeater (QR) nodes. Four classes of QRs networks are considered first and designed with two types of protocols in link layer, i.e. simultaneous and one-by-one link. Based on those two link models, the connection-oriented protocol is presented for all classes of QRs networks and the connectionless protocol is proposed for the first, second and third classes QRs networks by only one-by-one link. Furthermore, we introduce a new hybrid connection model of quantum networks combined with connection-oriented and connectionless for practical uses. Our work is a new attempt to study the model of the network layer for different kinds of QR networks and paves the way for developing the protocol stack of universal large-scale quantum internet.

quant-ph↗

arXiv2022

MAVIS: performance estimation of the adaptive optics module

The MCAO Assisted Visible Imager and Spectrograph (MAVIS) is a new visible instrument for ESO Very Large Telescope (VLT). Its Adaptive Optics Module (AOM) must provide extreme adaptive optics correction level at low galactic latitude and high sky coverage at the galactic pole on the FoV of 30arcsec of its 4k x 4k optical imager and on its monolithic Integral Field Unit, thanks to 3 deformable mirrors (DM), 8 Laser Guide Stars (LGS), up to 3 Natural Guide Stars (NGS) and 11 Wave Front Sensors (WFS). A careful performance estimation is required to drive the design of this module and to assess the fulfillment of the system and subsystems requirements. Here we present the work done on this topic during the last year: we updated the system parameters to account for the phase B design and for more realistic conditions, and we produced a set of results from analytical and end-to-end simulations that should give a as complete as possible view on the performance of the system.

astro-ph.IM↗

arXiv2022

Dynamical encircling exceptional point in largely detuned multimode optomechanical system

Dynamical encircling exceptional point(EP) shows a number of intriguing physical phenomena and its potential applications. To enrich the manipulations of optical systems in experiment, here, we study the dynamical encircling EP, i.e. state transfer process, in largely detuned multimode optomechanical system. The process of state transfer has been investigated with different factors about the location of start point, the orientation and the initial state of the trajectories around the EP in parameter space. Results show that the nonreciprocal and the chiral topological energy transfer between two optical modes are performed successfully by tuning the effective optomechanical coupling in the multimode system with large detuning. Moreover, the factor of evolution speed about system parameters is also discussed. Our work demonstrates the fundamental physics around EP in large detuning domain of multimode optomechanical system and provides an alternative for manipulating of optical modes in non-hermitian system.

physics.optics↗

arXiv2022

NAUTS: Negotiation for Adaptation to Unstructured Terrain Surfaces

When robots operate in real-world off-road environments with unstructured terrains, the ability to adapt their navigational policy is critical for effective and safe navigation. However, off-road terrains introduce several challenges to robot navigation, including dynamic obstacles and terrain uncertainty, leading to inefficient traversal or navigation failures. To address these challenges, we introduce a novel approach for adaptation by negotiation that enables a ground robot to adjust its navigational behaviors through a negotiation process. Our approach first learns prediction models for various navigational policies to function as a terrain-aware joint local controller and planner. Then, through a new negotiation process, our approach learns from various policies' interactions with the environment to agree on the optimal combination of policies in an online fashion to adapt robot navigation to unstructured off-road terrains on the fly. Additionally, we implement a new optimization algorithm that offers the optimal solution for robot negotiation in real-time during execution. Experimental results have validated that our method for adaptation by negotiation outperforms previous methods for robot navigation, especially over unseen and uncertain dynamic terrains.

cs.RO↗

arXiv2022

A Riemannian Stochastic Representation for Quantifying Model Uncertainties in Molecular Dynamics Simulations

A Riemannian stochastic representation of model uncertainties in molecular dynamics is proposed. The approach relies on a reduced-order model, the projection basis of which is randomized on a subset of the Stiefel manifold characterized by a set of linear constraints defining, e.g., Dirichlet boundary conditions in the physical space. We first show that these constraints are, indeed, preserved through Riemannian pushforward and pullback actions to, and from, the tangent space to the manifold at any admissible point. This fundamental property is subsequently exploited to derive a probabilistic model that leverages the multimodel nature of the atomistic setting. The proposed formulation offers several advantages, including a simple and interpretable low-dimensional parameterization, the ability to constraint the Fréchet mean on the manifold, and ease of implementation and propagation. The relevance of the proposed modeling framework is finally demonstrated on various applications including multiscale simulations on graphene-based systems.

physics.comp-ph↗

arXiv2022

Top quark mass measurements at the $t\bar{t}$ threshold with CEPC

We present a study of top quark mass measurements at the $t\bar{t}$ threshold based on CEPC. A centre-of-mass energy scan near two times of the top mass is performed and the measurement precision of top quark mass, width and $α_S$ are evaluated using the $t\bar{t}$ production rates. Realistic scan strategies at the threshold are discussed to maximise the sensitivity to the measurement of the top quark properties individually and simultaneously in the CEPC scenarios assuming a limited total luminosity of 100 fb$^{-1}$. With the optimal scan for individual property measurements, the top quark mass precision is expected to be 9 MeV, the top quark width precision is expected to be 26 MeV, and $α_S$ can be measured at a precision of 0.00039. Taking into account the uncertainties from theory, background subtraction, beam energy and luminosity spectrum, the top quark mass can be measured at a precision of 14 MeV optimistically and 34 MeV conservatively at CEPC.

hep-ex↗

arXiv2022

Long-term Leap Attention, Short-term Periodic Shift for Video Classification

Video transformer naturally incurs a heavier computation burden than a static vision transformer, as the former processes $T$ times longer sequence than the latter under the current attention of quadratic complexity $(T^2N^2)$. The existing works treat the temporal axis as a simple extension of spatial axes, focusing on shortening the spatio-temporal sequence by either generic pooling or local windowing without utilizing temporal redundancy. However, videos naturally contain redundant information between neighboring frames; thereby, we could potentially suppress attention on visually similar frames in a dilated manner. Based on this hypothesis, we propose the LAPS, a long-term ``\textbf{\textit{Leap Attention}}'' (LA), short-term ``\textbf{\textit{Periodic Shift}}'' (\textit{P}-Shift) module for video transformers, with $(2TN^2)$ complexity. Specifically, the ``LA'' groups long-term frames into pairs, then refactors each discrete pair via attention. The ``\textit{P}-Shift'' exchanges features between temporal neighbors to confront the loss of short-term dynamics. By replacing a vanilla 2D attention with the LAPS, we could adapt a static transformer into a video one, with zero extra parameters and neglectable computation overhead ($\sim$2.6\%). Experiments on the standard Kinetics-400 benchmark demonstrate that our LAPS transformer could achieve competitive performances in terms of accuracy, FLOPs, and Params among CNN and transformer SOTAs. We open-source our project in \sloppy \href{https://github.com/VideoNetworks/LAPS-transformer}{\textit{\color{magenta}{https://github.com/VideoNetworks/LAPS-transformer}}} .

cs.CV↗

arXiv2022

Geometric integration of classical spin dynamics via a mean-field Schrödinger equation

The Landau-Lifshitz equation describes the time-evolution of magnetic dipoles, and can be derived by taking the classical limit of a quantum mechanical spin Hamiltonian. To take this limit, one constrains the many-body quantum state to a tensor product of coherent states, thereby neglecting entanglement between sites. Expectation values of the quantum spin operators produce the usual classical spin dipoles. One may also consider expectation values of polynomials of the spin operators, leading to quadrupole and higher-order spin moments, which satisfy a dynamical equation of motion that generalizes the Landau-Lifshitz dynamics [Zhang and Batista, Phys. Rev. B 104, 104409 (2021)]. Here, we reformulate the dynamics of these $N^2-1$ generalized spin components as a mean-field Schrödinger equation on the $N$-dimensional coherent state. This viewpoint suggests efficient integration methods that respect the local symplectic structure of the classical spin dynamics.

cond-mat.str-el↗

arXiv2022

On Learning the Right Attention Point for Feature Enhancement

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e.g., classification and segmentation. Unlike prior works, which were trained to optimize the weights of a pre-selected set of attention points, our approach learns to locate the best attention points to maximize the performance of a specific task, e.g., point cloud classification. Importantly, we advocate the use of single attention point to facilitate semantic understanding in point feature learning. Specifically, we formulate a new and simple convolution, which combines convolutional features from an input point and its corresponding learned attention point, or LAP, for short. Our attention mechanism can be easily incorporated into state-of-the-art point cloud classification and segmentation networks. Extensive experiments on common benchmarks such as ModelNet40, ShapeNetPart, and S3DIS all demonstrate that our LAP-enabled networks consistently outperform the respective original networks, as well as other competitive alternatives, which employ multiple attention points, either pre-selected or learned under our LAP framework.

cs.CV↗

arXiv2022

DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection

We present DINO (\textbf{D}ETR with \textbf{I}mproved de\textbf{N}oising anch\textbf{O}r boxes), a state-of-the-art end-to-end object detector. % in this paper. DINO improves over previous DETR-like models in performance and efficiency by using a contrastive way for denoising training, a mixed query selection method for anchor initialization, and a look forward twice scheme for box prediction. DINO achieves $49.4$AP in $12$ epochs and $51.3$AP in $24$ epochs on COCO with a ResNet-50 backbone and multi-scale features, yielding a significant improvement of $\textbf{+6.0}$\textbf{AP} and $\textbf{+2.7}$\textbf{AP}, respectively, compared to DN-DETR, the previous best DETR-like model. DINO scales well in both model size and data size. Without bells and whistles, after pre-training on the Objects365 dataset with a SwinL backbone, DINO obtains the best results on both COCO \texttt{val2017} ($\textbf{63.2}$\textbf{AP}) and \texttt{test-dev} (\textbf{$\textbf{63.3}$AP}). Compared to other models on the leaderboard, DINO significantly reduces its model size and pre-training data size while achieving better results. Our code will be available at \url{https://github.com/IDEACVR/DINO}.

cs.CV↗

arXiv2022

Data-and-Knowledge Dual-Driven Automatic Modulation Recognition for Wireless Communication Networks

Automatic modulation classification is of crucial importance in wireless communication networks. Deep learning based automatic modulation classification schemes have attracted extensive attention due to the superior accuracy. However, the data-driven method relies on a large amount of training samples and the classification accuracy is poor in the low signal-to-noise radio (SNR). In order to tackle these problems, a novel data-and-knowledge dual-driven automatic modulation classification scheme based on radio frequency machine learning is proposed by exploiting the attribute features of different modulations. The visual model is utilized to extract visual features. The attribute learning model is used to learn the attribute semantic representations. The transformation model is proposed to convert the attribute representation into the visual space. Extensive simulation results demonstrate that our proposed automatic modulation classification scheme can achieve better performance than the benchmark schemes in terms of the classification accuracy, especially in the low SNR. Moreover, the confusion among high-order modulations is reduced by using our proposed scheme compared with other traditional schemes.

eess.SP↗

arXiv2022

Coupling Perovskite Quantum Dot Pairs in Solution using Nanoplasmonic Assembly

Perovskite quantum dots (PQDs) provide a robust solution-based approach to efficient solar cells, bright light-emitting devices, and quantum sources of light. Quantifying heterogeneity and understanding coupling between dots is critical for these applications. We use double-nanohole optical trapping to size individual dots and correlate to emission energy shifts from quantum confinement. We were able to assemble a second dot in the trap, which allows us to observe the coupling between dots. We observe a systematic red-shift of 1.1 $\pm$ 0.6 meV in the emission wavelength. Theoretical analysis shows that the observed shift is consistent with resonant energy transfer and is unusually large due to moderate-to-large quantum confinement in PQDs. This demonstrates the promise of PQDs for entanglement in quantum information applications. This work enables future in situ control of PQD growth as well as studies of the coupling between small PQD assemblies with quantum information applications in mind.

cond-mat.mes-hall↗

arXiv2022

Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning

Alpa automates model-parallel training of large deep learning (DL) models by generating execution plans that unify data, operator, and pipeline parallelism. Existing model-parallel training systems either require users to manually create a parallelization plan or automatically generate one from a limited space of model parallelism configurations. They do not suffice to scale out complex DL models on distributed compute devices. Alpa distributes the training of large DL models by viewing parallelisms as two hierarchical levels: inter-operator and intra-operator parallelisms. Based on it, Alpa constructs a new hierarchical space for massive model-parallel execution plans. Alpa designs a number of compilation passes to automatically derive efficient parallel execution plans at each parallelism level. Alpa implements an efficient runtime to orchestrate the two-level parallel execution on distributed compute devices. Our evaluation shows Alpa generates parallelization plans that match or outperform hand-tuned model-parallel training systems even on models they are designed for. Unlike specialized systems, Alpa also generalizes to models with heterogeneous architectures and models without manually-designed plans. Alpa's source code is publicly available at https://github.com/alpa-projects/alpa

cs.LG↗

arXiv2022

Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning

How to train deep neural networks (DNNs) to generalize well is a central concern in deep learning, especially for severely overparameterized networks nowadays. In this paper, we propose an effective method to improve the model generalization by additionally penalizing the gradient norm of loss function during optimization. We demonstrate that confining the gradient norm of loss function could help lead the optimizers towards finding flat minima. We leverage the first-order approximation to efficiently implement the corresponding gradient to fit well in the gradient descent framework. In our experiments, we confirm that when using our methods, generalization performance of various models could be improved on different datasets. Also, we show that the recent sharpness-aware minimization method (Foret et al., 2021) is a special, but not the best, case of our method, where the best case of our method could give new state-of-art performance on these tasks. Code is available at {https://github.com/zhaoyang-0204/gnp}.

cs.LG↗

arXiv2022

Quantification and Analysis of Layer-wise and Pixel-wise Information Discarding

This paper presents a method to explain how the information of each input variable is gradually discarded during the forward propagation in a deep neural network (DNN), which provides new perspectives to explain DNNs. We define two types of entropy-based metrics, i.e. (1) the discarding of pixel-wise information used in the forward propagation, and (2) the uncertainty of the input reconstruction, to measure input information contained by a specific layer from two perspectives. Unlike previous attribution metrics, the proposed metrics ensure the fairness of comparisons between different layers of different DNNs. We can use these metrics to analyze the efficiency of information processing in DNNs, which exhibits strong connections to the performance of DNNs. We analyze information discarding in a pixel-wise manner, which is different from the information bottleneck theory measuring feature information w.r.t. the sample distribution. Experiments have shown the effectiveness of our metrics in analyzing classic DNNs and explaining existing deep-learning techniques.

cs.LG↗

arXiv2022

Wavelet Regularization Benefits Adversarial Training

Adversarial training methods are state-of-the-art (SOTA) empirical defense methods against adversarial examples. Many regularization methods have been proven to be effective with the combination of adversarial training. Nevertheless, such regularization methods are implemented in the time domain. Since adversarial vulnerability can be regarded as a high-frequency phenomenon, it is essential to regulate the adversarially-trained neural network models in the frequency domain. Faced with these challenges, we make a theoretical analysis on the regularization property of wavelets which can enhance adversarial training. We propose a wavelet regularization method based on the Haar wavelet decomposition which is named Wavelet Average Pooling. This wavelet regularization module is integrated into the wide residual neural network so that a new WideWaveletResNet model is formed. On the datasets of CIFAR-10 and CIFAR-100, our proposed Adversarial Wavelet Training method realizes considerable robustness under different types of attacks. It verifies the assumption that our wavelet regularization method can enhance adversarial robustness especially in the deep wide neural networks. The visualization experiments of the Frequency Principle (F-Principle) and interpretability are implemented to show the effectiveness of our method. A detailed comparison based on different wavelet base functions is presented. The code is available at the repository: \url{https://github.com/momo1986/AdversarialWaveletTraining}.

cs.CV↗

arXiv2022

DETR++: Taming Your Multi-Scale Detection Transformer

Convolutional Neural Networks (CNN) have dominated the field of detection ever since the success of AlexNet in ImageNet classification [12]. With the sweeping reform of Transformers [27] in natural language processing, Carion et al. [2] introduce the Transformer-based detection method, i.e., DETR. However, due to the quadratic complexity in the self-attention mechanism in the Transformer, DETR is never able to incorporate multi-scale features as performed in existing CNN-based detectors, leading to inferior results in small object detection. To mitigate this issue and further improve performance of DETR, in this work, we investigate different methods to incorporate multi-scale features and find that a Bi-directional Feature Pyramid (BiFPN) works best with DETR in further raising the detection precision. With this discovery, we propose DETR++, a new architecture that improves detection results by 1.9% AP on MS COCO 2017, 11.5% AP on RICO icon detection, and 9.1% AP on RICO layout extraction over existing baselines.

cs.CV↗

arXiv2022

High thermoelectric performances in PbP monolayers considering full electron-phonon coupling and four-phonon scattering processes

The band convergence strategy, which improves Seebeck coefficient by inducing multi-valley in bandstructures, has been widely used in thermoelectric performance (TE) enhancing. However, the phonon-assisted intervalley scattering effect is neglected and the mode-selection rules remain unclear. In this work, TE properties for $α$-, $β$- and $γ$-PbP are intestigated under the consideration of full mode-, energy- and momentum-resolved electron-phonon interactions (EPI). The group theory is used to analyze the selection rules for EPI matrix elements. Our calculations reveal that, the intervalley scattering contributes non-trivially to the total carrier relaxation time, and the intervalley scattering can be modulated through crystal symmetry. In addition, the investigation on the thermal properties reveals that four-phonon scattering effect dominates the phonon relaxation processes, since the three-phonon scattering is suppressed due to the significantly large acoustic-optical phonon bandgap in $α$-, $β$- and $γ$-PbP. By considering full EPI effect and high-order phonon scattering processes, the calculated ZT values reach 0.90, 0.24 and 1.25 for $α$-, $β$- and $γ$-PbP, repectively, indicating their promising applications in thermoelectric devices.

cond-mat.mtrl-sci↗