arXiv subjects

Chen Wang

Publications and source records attributed to Chen Wang.

At least 631 records · Page 35Linked to original sources

arXiv2021

Imbalance-XGBoost: Leveraging Weighted and Focal Losses for Binary Label-Imbalanced Classification with XGBoost

The paper presents Imbalance-XGBoost, a Python package that combines the powerful XGBoost software with weighted and focal losses to tackle binary label-imbalanced classification tasks. Though a small-scale program in terms of size, the package is, to the best of the authors' knowledge, the first of its kind which provides an integrated implementation for the two losses on XGBoost and brings a general-purpose extension on XGBoost for label-imbalanced scenarios. In this paper, the design and usage of the package are described with exemplar code listings, and its convenience to be integrated into Python-driven Machine Learning projects is illustrated. Furthermore, as the first- and second-order derivatives of the loss functions are essential for the implementations, the algebraic derivation is discussed and it can be deemed as a separate algorithmic contribution. The performances of the algorithms implemented in the package are empirically evaluated on Parkinson's disease classification data set, and multiple state-of-the-art performances have been observed. Given the scalable nature of XGBoost, the package has great potentials to be applied to real-life binary classification tasks, which are usually of large-scale and label-imbalanced.

cs.LG↗

arXiv2021

Generalization Through Hand-Eye Coordination: An Action Space for Learning Spatially-Invariant Visuomotor Control

Imitation Learning (IL) is an effective framework to learn visuomotor skills from offline demonstration data. However, IL methods often fail to generalize to new scene configurations not covered by training data. On the other hand, humans can manipulate objects in varying conditions. Key to such capability is hand-eye coordination, a cognitive ability that enables humans to adaptively direct their movements at task-relevant objects and be invariant to the objects' absolute spatial location. In this work, we present a learnable action space, Hand-eye Action Networks (HAN), that can approximate human's hand-eye coordination behaviors by learning from human teleoperated demonstrations. Through a set of challenging multi-stage manipulation tasks, we show that a visuomotor policy equipped with HAN is able to inherit the key spatial invariance property of hand-eye coordination and achieve zero-shot generalization to new scene configurations. Additional materials available at https://sites.google.com/stanford.edu/han

cs.RO↗

arXiv2021

Encirclement Guaranteed Cooperative Pursuit with Robust Model Predictive Control

This paper studies a novel encirclement guaranteed cooperative pursuit problem involving $N$ pursuers and a single evader in an unbounded two-dimensional game domain. Throughout the game, the pursuers are required to maintain encirclement of the evader, i.e., the evader should always stay inside the convex hull generated by all the pursuers, in addition to achieving the classical capture condition. To tackle this challenging cooperative pursuit problem, a robust model predictive control (RMPC) based formulation framework is first introduced, which simultaneously accounts for the encirclement and capture requirements under the assumption that the evader's action is unavailable to all pursuers. Despite the reformulation, the resulting RMPC problem involves a bilinear constraint due to the encirclement requirement. To further handle such a bilinear constraint, a novel encirclement guaranteed partitioning scheme is devised that simplifies the original bilinear RMPC problem to a number of linear tube MPC (TMPC) problems solvable in a decentralized manner. Simulation experiments demonstrate the effectiveness of the proposed solution framework. Furthermore, comparisons with existing approaches show that the explicit consideration of the encirclement condition significantly improves the chance of successful capture of the evader in various scenarios.

cs.MA↗

arXiv2021

On singular values of data matrices with general independent columns

In this paper, we analyse singular values of a large $p\times n$ data matrix $\mathbf{X}_n= (\mathbf{x}_{n1},\ldots,\mathbf{x}_{nn})$ where the column $\mathbf{x}_{nj}$'s are independent $p$-dimensional vectors, possibly with different distributions. Such data matrices are common in high-dimensional statistics. Under a key assumption that the covariance matrices $\mathbfΣ_{nj}=\text{Cov}(\mathbf{x}_{nj})$ can be asymptotically simultaneously diagonalizable, and appropriate convergence of their spectra, we establish a limiting distribution for the singular values of $\mathbf{X}_n$ when both dimension $p$ and $n$ grow to infinity in a comparable magnitude. The matrix model goes beyond and includes many existing works on different types of sample covariance matrices, including the weighted sample covariance matrix, the Gram matrix model and the sample covariance matrix of linear times series models. Furthermore, we develop two applications of our general approach. First, we obtain the existence and uniqueness of a new limiting spectral distribution of realized covariance matrices for a multi-dimensional diffusion process with anisotropic time-varying co-volatility processes. Secondly, we derive the limiting spectral distribution for singular values of the data matrix for a recent matrix-valued auto-regressive model. Finally, for a generalized finite mixture model, the limiting spectral distribution for singular values of the data matrix is obtained.

math.ST↗

arXiv2021

Proof of some conjectural hypergeometric supercongruences via curious identities

In this paper, we prove several supercongruences conjectured by Z.-W. Sun ten years ago via certain strange hypergeometric identities. For example, for any prime $p>3$, we show that $$\sum_{k=0}^{p-1}\frac{\binom{4k}{2k+1}\binom{2k}k}{48^k}\equiv0\pmod{p^2},$$ and $$ \sum_{k=0}^{p-1}\frac{\binom{2k}{k}\binom{3k}{k}}{24^k}\equiv\begin{cases}\binom{(2p-2)/3}{(p-1)/3}\pmod{p^2}\ &\mbox{if}\ p\equiv1\pmod{3},\\ p/\binom{(2p+2)/3}{(p+1)/3}\pmod{p^2}\ &\mbox{if}\ p\equiv2\pmod{3}.\end{cases} $$ We also obtain some other results of such types.

math.NT↗

arXiv2021

Predictive power for superheavy nuclear mass and possible stability beyond the neutron drip line in deformed relativistic Hartree-Bogoliubov theory in continuum

The predictive power of the deformed relativistic Hartree-Bogoliubov theory in continuum (DRHBc) for nuclear mass is examined in the superheavy region, $102 \le Z \le 120$. The accuracy of predicting the 10 (56) measured (measured and empirical) masses is $0.635$ ($0.642$) MeV, in comparison with $0.515$ ($1.360$) MeV by WS4 and $0.910$ ($2.831$) MeV by FRDM. Possible stability against multineutron emission beyond the two-neutron drip line is explored by the DRHBc theory, which takes into account simultaneously the deformation effects, the pairing correlations, and the continuum effects. Nuclei stable against two- and multineutron emissions beyond the two-neutron drip line are predicted in $_{106}$Sg, $_{108}$Hs, $_{110}$Ds, and $_{112}$Cn isotopic chains, forming a peninsula of stability adjacent to the nuclear mainland. This stability is mainly due to the deformation which significantly affects the shell structure around the Fermi surface. The pairing correlations and continuum influence the stability peninsula in a self-consistent way.

nucl-th↗

arXiv2021

On the Circular Polarisation of Repeating Fast Radio Bursts

Fast spinning (e.g., sub-second) neutron star with ultra-strong magnetic fields (or so-called magnetar) is one of the promising origins of repeating fast radio bursts (FRBs). Here we discuss circularly polarised emissions produced by propagation effects in the magnetosphere of fast spinning magnetars. We argue that the polarisation-limiting region is well beyond the light cylinder, suggesting that wave mode coupling effects are unlikely to produce strong circular polarisation for fast spinning magnetars. Cyclotron absorption could be significant if the secondary plasma density is high. However, high degrees of circular polarisation can only be produced with large asymmetries in electrons and positrons. We draw attention to the non-detection of circular polarisation in current observations of known repeating FRBs. We suggest that the circular polarisation of FRBs could provide key information on their origins and help distinguish different radiation mechanisms.

astro-ph.HE↗

arXiv2021

Short term minutes-time scale temporal variation statistics of sodium layer dynamics

The brightness and height of the sodium laser guide star of adaptive optics could vary significantly due to the temporal dynamics of sodium column density and the mean height of sodium layer. To measure these dynamics, an independent sodium Lidar is a necessity. Without such an instrument, it is almost impossible to discern the cause of the brightness variation of laser guide star from the sodium layer's dynamics or other factors from the laser itself. For applications such as characterizing the performance of sodium laser for sodium laser guide star generation, minutes scale short term statistics of the sodium layers' abundance and height is extremely helpful for estimating the contribution of sodium layer's variation to the variation of laser guide star's brightness. In this paper, we analyzed our previous measurement of sodium layer dynamics that has been gathered in two winters, and presented the temporal variation statistics of sodium column density and mean height within minute time scale based on our measurements.

astro-ph.IM↗

arXiv2021

Nonequilibrium thermal transport and photon squeezing in a quadratic qubit-resonator system

We investigate steady-state thermal transport and photon statistics in a nonequilibrium hybrid quantum system, in which a qubit is longitudinally and quadratically coupled to an optical resonator. Our calculations are conducted with the method of the quantum dressed master equation combined with full counting statistics. The effect of negative differential thermal conductance is unravelled at finite temperature bias, which stems from the suppression of cyclic heat transitions and large mismatch of two squeezed photon modes at weak and strong qubit-resonator hybridizations, respectively. The giant thermal rectification is also exhibited at large temperature bias. It is found that the intrinsically asymmetric structure of the hybrid system and negative differential thermal conductance show the cooperative contribution. Noise power and skewness, as typical current fluctuations, exhibit global maximum with strong hybridization at small and large temperature bias limits, respectively. Moreover, the effect of photon quadrature squeezing is discovered in the strong hybridization and low-temperature regime, which shows asymmetric response to two bath temperatures. These results would provide some insight to thermal functional design and photon manipulation in qubit-resonator hybrid quantum systems.

quant-ph↗

arXiv2021

Cycle Flux Ranking of Network Analysis in Quantum Thermal Device

Manipulating quantum thermal transport relies on uncovering the principle working cycles of quantum devices. Here, we apply the cycle flux ranking of network analysis to nonequilibrium thermal devices described by graphs of quantum state transitions. To excavate the principal mechanism out of complex transport behaviors, we decompose the quantum-transition network into cycles, calculate the cycle flux by algebraic graph theory, and pick out the dominant cycles with top-ranked fluxes, i.e., the cycle trajectories with highest probabilities. We demonstrate the cycle flux ranking in typical quantum device models, such as a thermal-drag spin-Seebeck pump, and a quantum thermal transistor as thermal switch or heat amplifier. The dominant cycle trajectories indeed elucidate the principal working mechanisms of those quantum devices. The cycle flux analysis provides an alternative perspective that naturally describes the working cycle corresponding to the main functionality of quantum thermal devices, which would further guide the device optimization with desired performance

quant-ph↗

arXiv2021

F-LOAM: Fast LiDAR Odometry And Mapping

Simultaneous Localization and Mapping (SLAM) has wide robotic applications such as autonomous driving and unmanned aerial vehicles. Both computational efficiency and localization accuracy are of great importance towards a good SLAM system. Existing works on LiDAR based SLAM often formulate the problem as two modules: scan-to-scan match and scan-to-map refinement. Both modules are solved by iterative calculation which are computationally expensive. In this paper, we propose a general solution that aims to provide a computationally efficient and accurate framework for LiDAR based SLAM. Specifically, we adopt a non-iterative two-stage distortion compensation method to reduce the computational cost. For each scan input, the edge and planar features are extracted and matched to a local edge map and a local plane map separately, where the local smoothness is also considered for iterative pose optimization. Thorough experiments are performed to evaluate its performance in challenging scenarios, including localization for a warehouse Automated Guided Vehicle (AGV) and a public dataset on autonomous driving. The proposed method achieves a competitive localization accuracy with a processing rate of more than 10 Hz in the public dataset evaluation, which provides a good trade-off between performance and computational cost for practical applications.

cs.RO↗

arXiv2021

Interpreting Depression From Question-wise Long-term Video Recording of SDS Evaluation

Self-Rating Depression Scale (SDS) questionnaire has frequently been used for efficient depression preliminary screening. However, the uncontrollable self-administered measure can be easily affected by insouciantly or deceptively answering, and producing the different results with the clinician-administered Hamilton Depression Rating Scale (HDRS) and the final diagnosis. Clinically, facial expression (FE) and actions play a vital role in clinician-administered evaluation, while FE and action are underexplored for self-administered evaluations. In this work, we collect a novel dataset of 200 subjects to evidence the validity of self-rating questionnaires with their corresponding question-wise video recording. To automatically interpret depression from the SDS evaluation and the paired video, we propose an end-to-end hierarchical framework for the long-term variable-length video, which is also conditioned on the questionnaire results and the answering time. Specifically, we resort to a hierarchical model which utilizes a 3D CNN for local temporal pattern exploration and a redundancy-aware self-attention (RAS) scheme for question-wise global feature aggregation. Targeting for the redundant long-term FE video processing, our RAS is able to effectively exploit the correlations of each video clip within a question set to emphasize the discriminative information and eliminate the redundancy based on feature pair-wise affinity. Then, the question-wise video feature is concatenated with the questionnaire scores for final depression detection. Our thorough evaluations also show the validity of fusing SDS evaluation and its video recording, and the superiority of our framework to the conventional state-of-the-art temporal modeling methods.

cs.CV↗

arXiv2021

Geometric Heat Pump: Controlling Thermal Transport with Time-dependent Modulations

The second law of thermodynamics dictates that heat simultaneously flows from the hot to cold bath on average. To go beyond this picture, a range of works in the past decade show that, other than the average dynamical heat flux determined by instantaneous thermal bias, a non-trivial flux contribution of intrinsic geometric origin is generally present in temporally driven systems. This additional heat flux provides a free lunch for the pumped heat and could even drive heat against the bias. We review here the emergence and development of this so called ``geometric heat pump'', originating from the topological geometric phase effect, and cover various quantum and classical transport systems with different internal dynamics. The generalization from the adiabatic to the non-adiabatic regime and the application of control theory are also discussed. Then, we briefly discuss the symmetry restriction on the heat pump effect, such as duality, supersymmetry and time-reversal symmetry. Finally, we examine open problems concerning the geometric heat pump process and elucidate their prospective significance in devising thermal machines with high performance.

cond-mat.stat-mech↗

arXiv2021

Architectural Patterns for the Design of Federated Learning Systems

Federated learning has received fast-growing interests from academia and industry to tackle the challenges of data hungriness and privacy in machine learning. A federated learning system can be viewed as a large-scale distributed system with different components and stakeholders as numerous client devices participate in federated learning. Designing a federated learning system requires software system design thinking apart from machine learning knowledge. Although much effort has been put into federated learning from the machine learning technique aspects, the software architecture design concerns in building federated learning systems have been largely ignored. Therefore, in this paper, we present a collection of architectural patterns to deal with the design challenges of federated learning systems. Architectural patterns present reusable solutions to a commonly occurring problem within a given context during software architecture design. The presented patterns are based on the results of a systematic literature review and include three client management patterns, four model management patterns, three model training patterns, and four model aggregation patterns. The patterns are associated to the particular state transitions in a federated learning model lifecycle, serving as a guidance for effective use of the patterns in the design of federated learning systems.

cs.LG↗

arXiv2021

Learning Implicit Glyph Shape Representation

In this paper, we present a novel implicit glyph shape representation, which models glyphs as shape primitives enclosed by quadratic curves, and naturally enables generating glyph images at arbitrary high resolutions. Experiments on font reconstruction and interpolation tasks verified that this structured implicit representation is suitable for describing both structure and style features of glyphs. Furthermore, based on the proposed representation, we design a simple yet effective disentangled network for the challenging one-shot font style transfer problem, and achieve the best results comparing to state-of-the-art alternatives in both quantitative and qualitative comparisons. Benefit from this representation, our generated glyphs have the potential to be converted to vector fonts through post-processing, reducing the gap between rasterized images and vector graphics. We hope this work can provide a powerful tool for 2D shape analysis and synthesis, and inspire further exploitation in implicit representations for 2D shape modeling.

cs.CV↗

arXiv2021

A Systematic Literature Review on Federated Machine Learning: From A Software Engineering Perspective

Federated learning is an emerging machine learning paradigm where clients train models locally and formulate a global model based on the local model updates. To identify the state-of-the-art in federated learning and explore how to develop federated learning systems, we perform a systematic literature review from a software engineering perspective, based on 231 primary studies. Our data synthesis covers the lifecycle of federated learning system development that includes background understanding, requirement analysis, architecture design, implementation, and evaluation. We highlight and summarise the findings from the results, and identify future trends to encourage researchers to advance their current work.

cs.SE↗

arXiv2021

The FAST Galactic Plane Pulsar Snapshot survey: I. Project design and pulsar discoveries

Discovery of pulsars is one of the main goals for large radio telescopes. The Five-hundred-meter Aperture Spherical radio Telescope (FAST), that incorporates an L-band 19-beam receiver with a system temperature of about 20~K, is the most sensitive radio telescope utilized for discovering pulsars. We designed the {\it snapshot} observation mode for a FAST key science project, the Galactic Plane Pulsar Snapshot (GPPS) survey, in which every four nearby pointings can observe {\it a cover} of a sky patch of 0.1575 square degrees through beam-switching of the L-band 19-beam receiver. The integration time for each pointing is 300 seconds so that the GPPS observations for a cover can be made in 21 minutes. The goal of the GPPS survey is to discover pulsars within the Galactic latitude of $\pm10^{\circ}$ from the Galactic plane, and the highest priority is given to the inner Galaxy within $\pm5^{\circ}$. Up to now, the GPPS survey has discovered 201 pulsars, including currently the faintest pulsars which cannot be detected by other telescopes, pulsars with extremely high dispersion measures (DMs) which challenge the currently widely used models for the Galactic electron density distribution, pulsars coincident with supernova remnants, 40 millisecond pulsars, 16 binary pulsars, some nulling and mode-changing pulsars and rotating radio transients (RRATs). The follow-up observations for confirmation of new pulsars have polarization-signals recorded for polarization profiles of the pulsars. Re-detection of previously known pulsars in the survey data also leads to significant improvements in parameters for 64 pulsars. The GPPS survey discoveries are published and will be updated at http://zmtt.bao.ac.cn/GPPS/ .

astro-ph.HE↗

arXiv2021

De-Pois: An Attack-Agnostic Defense against Data Poisoning Attacks

Machine learning techniques have been widely applied to various applications. However, they are potentially vulnerable to data poisoning attacks, where sophisticated attackers can disrupt the learning procedure by injecting a fraction of malicious samples into the training dataset. Existing defense techniques against poisoning attacks are largely attack-specific: they are designed for one specific type of attacks but do not work for other types, mainly due to the distinct principles they follow. Yet few general defense strategies have been developed. In this paper, we propose De-Pois, an attack-agnostic defense against poisoning attacks. The key idea of De-Pois is to train a mimic model the purpose of which is to imitate the behavior of the target model trained by clean samples. We take advantage of Generative Adversarial Networks (GANs) to facilitate informative training data augmentation as well as the mimic model construction. By comparing the prediction differences between the mimic model and the target model, De-Pois is thus able to distinguish the poisoned samples from clean ones, without explicit knowledge of any ML algorithms or types of poisoning attacks. We implement four types of poisoning attacks and evaluate De-Pois with five typical defense methods on different realistic datasets. The results demonstrate that De-Pois is effective and efficient for detecting poisoned data against all the four types of poisoning attacks, with both the accuracy and F1-score over 0.9 on average.

cs.CR↗