arXiv subjects

Han Wang

Publications and source records attributed to Han Wang.

At least 379 records · Page 21Linked to original sources

arXiv2023

Side Channel-Assisted Inference Leakage from Machine Learning-based ECG Classification

The Electrocardiogram (ECG) measures the electrical cardiac activity generated by the heart to detect abnormal heartbeat and heart attack. However, the irregular occurrence of the abnormalities demands continuous monitoring of heartbeats. Machine learning techniques are leveraged to automate the task to reduce labor work needed during monitoring. In recent years, many companies have launched products with ECG monitoring and irregular heartbeat alert. Among all classification algorithms, the time series-based algorithm dynamic time warping (DTW) is widely adopted to undertake the ECG classification task. Though progress has been achieved, the DTW-based ECG classification also brings a new attacking vector of leaking the patients' diagnosis results. This paper shows that the ECG input samples' labels can be stolen via a side-channel attack, Flush+Reload. In particular, we first identify the vulnerability of DTW for ECG classification, i.e., the correlation between warping path choice and prediction results. Then we implement an attack that leverages Flush+Reload to monitor the warping path selection with known ECG data and then build a predictor for constructing the relation between warping path selection and labels of input ECG samples. Based on experiments, we find that the Flush+Reload-based inference leakage can achieve an 84.0\% attacking success rate to identify the labels of the two samples in DTW.

cs.CR↗

arXiv2023

Charge-density-wave resistive switching and voltage oscillations in ternary chalcogenide BaTiS3

Phase change materials, which show different electrical characteristics across the phase transitions, have attracted considerable research attention for their potential electronic device applications. Materials with metal-to-insulator or charge density wave (CDW) transitions such as VO2 and 1T-TaS2 have demonstrated voltage oscillations due to their robust bi-state resistive switching behavior with some basic neuronal characteristics. BaTiS3 is a small bandgap ternary chalcogenide that has recently reported the emergence CDW order below 245 K. Here, we report on the discovery of DC voltage / current-induced reversible threshold switching in BaTiS3 devices between a CDW phase and a room temperature semiconducting phase. The resistive switching behavior is consistent with a Joule heating scheme and sustained voltage oscillations with a frequency of up to 1 kHz has been demonstrated by leveraging the CDW phase transition and the associated negative differential resistance. Strategies of reducing channel sizes and improving thermal management may further improve the device performance. Our findings establish BaTiS3 as a promising CDW material for future energy-efficient electronics, especially for neuromorphic computing.

cond-mat.mtrl-sci↗

arXiv2023

PyPose: A Library for Robot Learning with Physics-based Optimization

Deep learning has had remarkable success in robotic perception, but its data-centric nature suffers when it comes to generalizing to ever-changing environments. By contrast, physics-based optimization generalizes better, but it does not perform as well in complicated tasks due to the lack of high-level semantic information and reliance on manual parametric tuning. To take advantage of these two complementary worlds, we present PyPose: a robotics-oriented, PyTorch-based library that combines deep perceptual models with physics-based optimization. PyPose's architecture is tidy and well-organized, it has an imperative style interface and is efficient and user-friendly, making it easy to integrate into real-world robotic applications. Besides, it supports parallel computing of any order gradients of Lie groups and Lie algebras and $2^{\text{nd}}$-order optimizers, such as trust region methods. Experiments show that PyPose achieves more than $10\times$ speedup in computation compared to the state-of-the-art libraries. To boost future research, we provide concrete examples for several fields of robot learning, including SLAM, planning, control, and inertial navigation.

cs.RO↗

arXiv2023

Evaluations of some Toeplitz-type determinants

In this paper we evaluate some Toeplitz-type determinants. Let $n>1$ be an integer. We prove the following two basic identities: \begin{align*} \det{[j-k+δ_{jk}]_{1\leq j,k\leq n}}&=1+\frac{n^2(n^2-1)}{12}, \\ \det{[|j-k|+δ_{jk}]_{1\leq j,k\leq n}}&= \begin{cases} \frac{1+(-1)^{(n-1)/2}n}{2}&\text{if}\ 2\nmid n,\\ \frac{1+(-1)^{n/2}}{2}&\text{if}\ 2\mid n, \end{cases} \end{align*} where $δ_{jk}$ is the Kronecker delta. For complex numbers $a,b,c$ with $b\not=0$ and $a^2\not=4b$, and the sequence $(w_m)_{m\in\mathbb Z}$ with $w_{k+1}=aw_k-bw_{k-1}$ for all $k\in\mathbb Z$, we establish the identity $$\det[w_{j-k}+cδ_{jk}]_{1\le j,k\le n} =c^n+c^{n-1}nw_0+c^{n-2}(w_1^2-aw_0w_1+bw_0^2)\frac{u_n^2b^{1-n}-n^2}{a^2-4b},$$ where $u_0=0$, $u_1=1$ and $u_{k+1}=au_k-bu_{k-1}$ for all $k=1,2,\ldots$.

math.NT↗

arXiv2023

A class of fuzzy numbers induced by probability density functions and their arithmetic operations

In this paper we are interested in a class of fuzzy numbers which is uniquely identified by their membership functions. The function space, denoted by $X_{h, p}$, will be constructed by combining a class of nonlinear mappings $h$ (subjective perception) and a class of probability density functions (PDF) $p$ (objective entity), respectively. Under our assumptions, we prove that there always exists a class of $h$ to fulfill the observed outcome for a given class of $p$. Especially, we prove that the common triangular number can be interpreted by a function pair $(h, p)$. As an example, we consider a sample function space $X_{h, p}$ where $h$ is the tangent function and $p$ is chosen as the Gaussian kernel with free variable $μ$. By means of the free variable $μ$ (which is also the expectation of $p(x; μ)$), we define the addition, scalar multiplication and subtraction on $X_{h, p}$. We claim that, under our definitions, $X_{h, p}$ has a linear algebra. Some numerical examples are provided to illustrate the proposed approach.

math.GM↗

arXiv2023

Data-Driven Prediction of Complex Crystal Structures of Dense Lithium

Lithium (Li) is a prototypical simple metal at ambient conditions, but exhibits remarkable changes in structural and electronic properties under compression. There has been intense debate about the structure of dense Li, and recent experiments offered fresh evidence for new yet undetermined crystalline phases near the enigmatic melting minimum region in the pressure-temperature phase diagram of Li. Here, we report on an extensive exploration of the energy landscape of Li using an advanced crystal structure search method combined with a machine learning approach, which greatly expands the scale of structure search, leading to the prediction of four complex Li crystal phases containing up to 192 atoms in the unit cell that are energetically competitive with known Li structures. These findings provide a viable solution to the newly observed yet unidentified crystalline phases of Li, and showcase the predictive power of the global structure search method for discovering complex crystal structures in conjunction with accurate machine-learning potentials.

cond-mat.mtrl-sci↗

arXiv2022

Ask Question First for Enhancing Lifelong Language Learning

Lifelong language learning aims to stream learning NLP tasks while retaining knowledge of previous tasks. Previous works based on the language model and following data-free constraint approaches have explored formatting all data as "begin token (\textit{B}) + context (\textit{C}) + question (\textit{Q}) + answer (\textit{A})" for different tasks. However, they still suffer from catastrophic forgetting and are exacerbated when the previous task's pseudo data is insufficient for the following reasons: (1) The model has difficulty generating task-corresponding pseudo data, and (2) \textit{A} is prone to error when \textit{A} and \textit{C} are separated by \textit{Q} because the information of the \textit{C} is diminished before generating \textit{A}. Therefore, we propose the Ask Question First and Replay Question (AQF-RQ), including a novel data format "\textit{BQCA}" and a new training task to train pseudo questions of previous tasks. Experimental results demonstrate that AQF-RQ makes it easier for the model to generate more pseudo data that match corresponding tasks, and is more robust to both sufficient and insufficient pseudo-data when the task boundary is both clear and unclear. AQF-RQ can achieve only 0.36\% lower performance than multi-task learning.

cs.CL↗

arXiv2022

GWRBoost:A geographically weighted gradient boosting method for explainable quantification of spatially-varying relationships

The geographically weighted regression (GWR) is an essential tool for estimating the spatial variation of relationships between dependent and independent variables in geographical contexts. However, GWR suffers from the problem that classical linear regressions, which compose the GWR model, are more prone to be underfitting, especially for significant volume and complex nonlinear data, causing inferior comparative performance. Nevertheless, some advanced models, such as the decision tree and the support vector machine, can learn features from complex data more effectively while they cannot provide explainable quantification for the spatial variation of localized relationships. To address the above issues, we propose a geographically gradient boosting weighted regression model, GWRBoost, that applies the localized additive model and gradient boosting optimization method to alleviate underfitting problems and retains explainable quantification capability for spatially-varying relationships between geographically located variables. Furthermore, we formulate the computation method of the Akaike information score for the proposed model to conduct the comparative analysis with the classic GWR algorithm. Simulation experiments and the empirical case study are applied to prove the efficient performance and practical value of GWRBoost. The results show that our proposed model can reduce the RMSE by 18.3% in parameter estimation accuracy and AICc by 67.3% in the goodness of fit.

cs.LG↗

arXiv2022

Atomistic modelling of all dislocations and twins in HCP and BCC Ti

Ti exhibits complex plastic deformation controlled by active dislocation and twinning systems. Understandings on dislocation cores and twin interfaces are currently not complete or quantitative, despite extensive experimental and simulation studies. Here, we determine all the core and twin interface properties in both HCP and BCC Ti using a Deep Potential (DP) and DFT. We determine the core structures, critical resolved shear stresses and mobilities of , , dislocations in HCP and <111>/2 dislocations in BCC Ti. The slip consists of slow core migration on pyramidal-I planes and fast migration on prism-planes, and is kinetically limited by cross-slips among them. This behaviour is consistent with "locking-unlocking" phenomena in TEM and is likely an intrinsic property. Large-scale DFT calculations provide a peek at the screw core and glide behaviour, which is further quantified using DP-Ti. The screw is unstable on pyramidal-II planes. The mixed is nearly sessile on pyramidal-I planes, consistent with observations of long dislocations in this orientation. The edge and mixed are unstable against a pyramidal-to-basal (PB) transition and become sessile at high temperatures, corroborate the difficulties in -axis compression of Ti. Finally, in BCC Ti, the <111>/2 screw has a degenerate core with average glide on {112} planes; the <111>/2 edge and mixed dislocations have non-dissociated cores on {110} planes. This work paints a self-consistent, complete picture on all dislocations in Ti, rationalises previous experimental observations and points to future HRTEM examinations of unusual dislocations such as the mixed and PB transformed cores.

cond-mat.mtrl-sci↗

arXiv2022

Ultrafast Charge Transfer Enhancement in CdS-MoS2 via Linker Molecule

Hybrid systems, which take advantage of low material dimensionality, have great potential for designing nanoscale devices. Quantum dots (QDs) -- a 0D nanostructure -- can be combined with 2D monolayers to achieve success in photovoltaics and photocatalytic water splitting. In such colloidal systems, ligand molecules such as cysteine play an important role in device performance. The role of the ligand molecule in these QD heterostructures is poorly understood. In this study, time-dependent density functional theory (TD-DFT) is employed in order to explore how the ligand affect the charge transfer at the ultra-fast timescale. We study the charge transfer dynamics in CdS-MoS2 heterostructures both with and without an organic linker molecule. We find that the ligand molecule enhances the ultrafast charge transfer, and that electrons are preferentially transferred from CdS to MoS2 as band alignment would predict. The electronic dynamics and time-evolved projection character are sensitive to the ionic temperature and excitation density.

physics.comp-ph↗

arXiv2022

Pre-training strategy for solving evolution equations based on physics-informed neural networks

The physics informed neural network (PINN) is a promising method for solving time-evolution partial differential equations (PDEs). However, the standard PINN method may fail to solve the PDEs with strongly nonlinear characteristics or those with high-frequency solutions. The physics informed neural network (PINN) is a promising method for solving time-evolution partial differential equations (PDEs). However, the standard PINN method may fail to solve the PDEs with strongly nonlinear characteristics or those with high-frequency solutions. The PT-PINN method transforms the difficult problem on the entire time domain to relatively simple problems defined on small subdomains. The neural network trained on small subdomains provides the neural network initialization and extra supervised learning data for the problems on larger subdomains or on the entire time-domain. By numerical experiments, we demonstrate that the PT-PINN succeeds in solving the evolution PDEs with strong non-linearity and/or high frequency solutions, including the strongly nonlinear heat equation, the Allen-Cahn equation, the convection equation with high-frequency solutions and so on, and that the convergence and accuracy of the PT-PINN is superior to the standard PINN method. The PT-PINN method is a competitive method for solving the time-evolution PDEs.

math.NA↗

arXiv2022

Safety-Critical Optimal Control for Robotic Manipulators in A Cluttered Environment

Designing safety-critical control for robotic manipulators is challenging, especially in a cluttered environment. First, the actual trajectory of a manipulator might deviate from the planned one due to the complex collision environments and non-trivial dynamics, leading to collision; Second, the feasible space for the manipulator is hard to obtain since the explicit distance functions between collision meshes are unknown. By analyzing the relationship between the safe set and the controlled invariant set, this paper proposes a data-driven control barrier function (CBF) construction method, which extracts CBF from distance samples. Specifically, the CBF guarantees the controlled invariant property for considering the system dynamics. The data-driven method samples the distance function and determines the safe set. Then, the CBF is synthesized based on the safe set by a scenario-based sum of square (SOS) program. Unlike most existing linearization based approaches, our method reserves the volume of the feasible space for planning without approximation, which helps find a solution in a cluttered environment. The control law is obtained by solving a CBF-based quadratic program in real time, which works as a safe filter for the desired planning-based controller. Moreover, our method guarantees safety with the proven probabilistic result. Our method is validated on a 7-DOF manipulator in both real and virtual cluttered environments. The experiments show that the manipulator is able to execute tasks where the clearance between obstacles is in millimeters.

cs.RO↗

arXiv2022

Safety-Aware Optimal Control for Motion Planning with Low Computing Complexity

The existence of multiple irregular obstacles in the environment introduces nonconvex constraints into the optimization for motion planning, which makes the optimal control problem hard to handle. One efficient approach to address this issue is Successive Convex Approximation (SCA), where the nonconvex problem is convexified and solved successively. However, this approach still faces two main challenges: I) infeasibility, caused by linearisation about infeasible reference points; ii) high computational complexity incurred by multiple constraints, when solving the optimal control problem with a long planning horizon and multiple obstacles. To overcome these challanges, this paper proposes an energy efficient safetyaware control method for motion planning with low computing complexity and address these challenges. Specifically, a control barrier function-based linear quadratic regulator is formulated for the motion planning to guarantee safety and energy efficiency. Then, to avoid infeasibility, Backward Receding SCA (BRSCA) approach with a dynamic constraints-selection rule is proposed. Dynamic programming with primal-dual iteration is designed to decrease computational complexity. It is found that BRSCA is applicable to time-varying control limits. Numerical simulations and hardware experiments vevify the efficiency of BRSCA. Simulations demonstrates that BRSCA has a higher probability of finding feasible solutions, reduces the computation time by about 17.4% and the energy cost by about four times compared to other methods in the literature.

eess.SY↗

arXiv2022

X-ray Free Electron Laser Studies of Electron and Phonon Dynamics of Graphene Adsorbed on Copper

We report optical pumping and X-ray absorption spectroscopy experiments at the PAL free electron laser that directly probe the electron dynamics of a graphene monolayer adsorbed on copper in the femtosecond regime. By analyzing the results with ab-initio theory we infer that the excitation of graphene is dominated by indirect excitation from hot electron-hole pairs created in the copper by the optical laser pulse. However, once the excitation is created in graphene, its decay follows a similar path as in many previous studies of graphene adsorbed on semiconductors, i e. rapid excitation of SCOPS (Strongly Coupled Optical Phonons) and eventual thermalization. It is likely that the lifetime of the hot electron-hole pairs in copper governs the lifetime of the electronic excitation of the graphene.

cond-mat.mes-hall↗

arXiv2022

Language Model Pre-Training with Sparse Latent Typing

Modern large-scale Pre-trained Language Models (PLMs) have achieved tremendous success on a wide range of downstream tasks. However, most of the LM pre-training objectives only focus on text reconstruction, but have not sought to learn latent-level interpretable representations of sentences. In this paper, we manage to push the language models to obtain a deeper understanding of sentences by proposing a new pre-training objective, Sparse Latent Typing, which enables the model to sparsely extract sentence-level keywords with diverse latent types. Experimental results show that our model is able to learn interpretable latent type categories in a self-supervised manner without using any external knowledge. Besides, the language model pre-trained with such an objective also significantly improves Information Extraction related downstream tasks in both supervised and few-shot settings. Our code is publicly available at: https://github.com/renll/SparseLT.

cs.CL↗

arXiv2022

On two new kinds of restricted sumsets

Let $A_1,\ldots,A_n$ be finite subsets of an additive abelian group $G$ with $|A_1|=\cdots=|A_n|\ge2$. Concerning the two new kinds of restricted sumsets $$L(A_1,\ldots,A_n)=\{a_1+\cdots+a_n:\ a_1\in A_1,\ldots,a_n\in A_n,\ \text{and}\ a_i\not=a_{i+1} \ \text{for}\ 1\le i<n\}$$ and $$C(A_1,\ldots,A_n)=\{a_1+\cdots+a_n:\ a_i\in A_i\ (1\le i\le n),\ \text{and}\ a_i\not=a_{i+1} \ \text{for}\ 1\le i<n,\ \text{and}\ a_n\not=a_1\}$$ recently introduced by the second author, when $G$ is the additive group of a field we obtain lower bounds for $|L(A_1,\ldots,A_n)|$ and $|C(A_1,\ldots,A_n)|$ via the polynomial method. Moreover, when $G$ is torsion-free and $A_1=\cdots=A_n$, we determine completely when $|L(A_1,\ldots,A_n)|$ or $|C(A_1,\ldots,A_n)|$ attains its lower bound.

math.NT↗

arXiv2022

DouFu: A Double Fusion Joint Learning Method For Driving Trajectory Representation

Driving trajectory representation learning is of great significance for various location-based services, such as driving pattern mining and route recommendation. However, previous representation generation approaches tend to rarely address three challenges: 1) how to represent the intricate semantic intentions of mobility inexpensively; 2) complex and weak spatial-temporal dependencies due to the sparsity and heterogeneity of the trajectory data; 3) route selection preferences and their correlation to driving behavior. In this paper, we propose a novel multimodal fusion model, DouFu, for trajectory representation joint learning, which applies multimodal learning and attention fusion module to capture the internal characteristics of trajectories. We first design movement, route, and global features generated from the trajectory data and urban functional zones and then analyze them respectively with the attention encoder or feed forward network. The attention fusion module incorporates route features with movement features to create a better spatial-temporal embedding. With the global semantic feature, DouFu produces a comprehensive embedding for each trajectory. We evaluate representations generated by our method and other baseline models on classification and clustering tasks. Empirical results show that DouFu outperforms other models in most of the learning algorithms like the linear regression and the support vector machine by more than 10%.

cs.LG↗

arXiv2022

Causal Inference via Nonlinear Variable Decorrelation for Healthcare Applications

Causal inference and model interpretability research are gaining increasing attention, especially in the domains of healthcare and bioinformatics. Despite recent successes in this field, decorrelating features under nonlinear environments with human interpretable representations has not been adequately investigated. To address this issue, we introduce a novel method with a variable decorrelation regularizer to handle both linear and nonlinear confounding. Moreover, we employ association rules as new representations using association rule mining based on the original features to further proximate human decision patterns to increase model interpretability. Extensive experiments are conducted on four healthcare datasets (one synthetically generated and three real-world collections on different diseases). Quantitative results in comparison to baseline approaches on parameter estimation and causality computation indicate the model's superior performance. Furthermore, expert evaluation given by healthcare professionals validates the effectiveness and interpretability of the proposed model.

cs.LG↗