arXiv subjects

Wei Cao

Publications and source records attributed to Wei Cao.

At least 55 records · Page 3Linked to original sources

arXiv2024

Qubit-Wise Architecture Search Method for Variational Quantum Circuits

Considering the noise level limit, one crucial aspect for quantum machine learning is to design a high-performing variational quantum circuit architecture with small number of quantum gates. As the classical neural architecture search (NAS), quantum architecture search methods (QAS) employ methods like reinforcement learning, evolutionary algorithms and supernet optimiza-tion to improve the search efficiency. In this paper, we propose a novel qubit-wise architec-ture search (QWAS) method, which progres-sively search one-qubit configuration per stage, and combine with Monte Carlo Tree Search al-gorithm to find good quantum architectures by partitioning the search space into several good and bad subregions. The numerical experimental results indicate that our proposed method can balance the exploration and exploitation of cir-cuit performance and size in some real-world tasks, such as MNIST, Fashion and MOSI. As far as we know, QWAS achieves the state-of-art re-sults of all tasks in the terms of accuracy and circuit size.

quant-ph↗

arXiv2024

Structural disorder-induced topological phase transitions in quasicrystals

Recently, the structural disorder-induced topological phase transitions in periodic systems have attracted much attention. However, in aperiodic systems such as quasicrystalline systems, the interplay between structural disorder and band topology is still unclear. In this work, we investigate the effects of structural disorder on a quantum spin Hall insulator phase and a higher-order topological phase in a two-dimensional Amman-Beenker tiling quasicrystalline lattice, respectively. We demonstrate that the structural disorder can induce a topological phase transition from a quasicrystalline normal insulator phase to an amorphous quantum spin Hall insulator phase, which is confirmed by bulk gap closing and reopening, robust edge states, quantized spin Bott index and conductance. Furthermore, the structural disorder-induced higher-order topological phase transition from a quasicrystalline normal insulator phase to an amorphous higher-order topological phase characterized by quantized quadrupole moment and topological corner states is also found. More strikingly, the disorder-induced higher-order topological insulator with eight corner states represents a distinctive topological state that eludes realization in conventional crystalline systems. Our work extends the study of the interplay between disorder effects and topologies to quasicrystalline and amorphous systems.

cond-mat.mes-hall↗

arXiv2023

UADB: Unsupervised Anomaly Detection Booster

Unsupervised Anomaly Detection (UAD) is a key data mining problem owing to its wide real-world applications. Due to the complete absence of supervision signals, UAD methods rely on implicit assumptions about anomalous patterns (e.g., scattered/sparsely/densely clustered) to detect anomalies. However, real-world data are complex and vary significantly across different domains. No single assumption can describe such complexity and be valid in all scenarios. This is also confirmed by recent research that shows no UAD method is omnipotent. Based on above observations, instead of searching for a magic universal winner assumption, we seek to design a general UAD Booster (UADB) that empowers any UAD models with adaptability to different data. This is a challenging task given the heterogeneous model structures and assumptions adopted by existing UAD methods. To achieve this, we dive deep into the UAD problem and find that compared to normal data, anomalies (i) lack clear structure/pattern in feature space, thus (ii) harder to learn by model without a suitable assumption, and finally, leads to (iii) high variance between different learners. In light of these findings, we propose to (i) distill the knowledge of the source UAD model to an imitation learner (booster) that holds no data assumption, then (ii) exploit the variance between them to perform automatic correction, and thus (iii) improve the booster over the original UAD model. We use a neural network as the booster for its strong expressive power as a universal approximator and ability to perform flexible post-hoc tuning. Note that UADB is a model-agnostic framework that can enhance heterogeneous UAD models in a unified way. Extensive experiments on over 80 tabular datasets demonstrate the effectiveness of UADB.

cs.LG↗

arXiv2023

Near-real-time monitoring of global ocean carbon sink

Mitigation of climate change will highly rely on a carbon emission trajectory that achieves carbon neutrality by the 2050s. The ocean plays a critical role in modulating climate change by sequestering CO2 from the atmosphere. Relying on the multidisciplinary cutting-edge methodologies and technologies, the near-real-time monitoring of global ocean carbon sinks from January 2022 to July 2023 aims to provide the world's latest assessment of monthly and gridded global ocean carbon sinks based on machine learning and other data science technologies. The project will help us find a robust route to deal with climate change, which will significantly promote the ocean carbon sinks research and will be of great interest for policy makers, researchers, and the public. This research aims to build up an integrated machine learning framework and methodology for assessing global ocean carbon neutral process; development of near-real-time dataset; development of visualization platform; research papers published in international prestigious journals; an executive report openly accessible to policy makers and the public.

physics.ao-ph↗

arXiv2023

Zeros of polynomials over finite Witt rings

Let $\mathbb{F}_q$ denote the finite field of characteristic $p$ and order $q$. Let $\mathbb{Z}_q$ denote the unramified extension of the $p$-adic rational integers $\mathbb{Z}_p$ with residue field $\mathbb{F}_q$. Given two positive integers $m,n$, define a box $\mathcal B_m$ to be a subset of $\mathbb{Z}_q^n$ with $q^{nm}$ elements such that $\mathcal B_m$ modulo $p^m$ is equal to $(\mathbb{Z}_q/p^m \mathbb{Z}_q)^n$. For a collection of nonconstant polynomials $f_1,\dots,f_s\in \mathbb{Z}_q[x_1,\ldots,x_n]$ and positive integers $m_1,\dots,m_s$, define the set of common zeros inside the box $\mathcal B_m$ to be $$V=\{X\in \mathcal B_m:\; f_i(X)\equiv 0\mod {p^{m_i}}\mbox{ for all } 1\leq i\leq s\}.$$ It is an interesting problem to give the sharp estimates for the $p$-divisibility of $|V|$. This problem has been partially solved for the three cases: (i) $m=m_1=\cdots=m_s=1$, which is just the Ax-Katz theorem, (ii) $m=m_1=\cdots=m_s>1$, which was solved by Katz, Marshal and Ramage, and (iii) $m=1$, and $ m_1,\dots,m_s\geq 1$, which was recently solved by Cao, Wan and Grynkiewicz. Based on the multi-fold addition and multiplication of the finite Witt rings over $\mathbb{F}_q$, we investigate the remaining unconsidered case of $m>1$ and $m\neq m_j$ for some $1\leq j\leq s$, and finally provide a complete answer to this problem.

math.NT↗

arXiv2023

Hybrid Successive Interference Cancellation and Power Adaptation: a Win-Win Strategy for Robust Uplink NOMA Transmission

The aim of this paper is to reveal the importance of hybrid successive interference cancellation (SIC) and power adaptation (PA) for improving transmission robustness of uplink non-orthogonal multiple access (NOMA). Particularly, a cognitive radio inspired uplink NOMA communication scenario is considered, where one primary user is allocated one dedicated resource block, while M secondary users compete with each other to be opportunistically served by using the same resource block of the primary user. Two novel schemes are proposed for the considered scenario, namely hybrid SIC with PA (HSIC-PA) scheme and fixed SIC with PA (FSIC-PA) scheme. Both schemes can ensure that the secondary users are served without degrading the transmission reliability of the primary user compared to conventional orthogonal multiple access (OMA) based schemes. Rigorous analytical results are presented to evaluate the performance of the proposed two schemes. It is shown that both schemes can avoid outage probability error floors without any constraints on users' target rates in the high SNR regime. Furthermore, it is shown that the diversity gain achieved by the HSIC-PA scheme is M, while that of the FISC-PA scheme is only 1. Numerical results are provided to verify the developed analytical results and also demonstrate the superior performance achieved by the proposed schemes by comparing with the existing HSIC without PA (HSIC-NPA) scheme. The presented simulation results also show that HSIC-PA scheme performs the best among the three schemes, which indicates the importance of the combination of HSIC and PA for improving transmission robustness.

cs.IT↗

arXiv2023

New Designs of Robust Uplink NOMA in Cognitive Radio Inspired Communications

This paper considers a cognitive radio inspired uplink communication scenario, where one primary user is allocated with one dedicated resource block, while $M$ secondary users compete with each other to opportunistically access the primary user's channel. Two new designs of NOMA schemes, namely hybrid successive interference cancellation with power adaptation (HSIC-PA) and fixed successive interference cancellation with power adaptation (FSIC-PA), are proposed. The significant advantages of the proposed schemes are two folds. First, the proposed two schemes can ensure that the secondary users are opportunistically served without degrading the transmission reliability of the primary user. Besides, the transmission robustness of the served secondary users can be guaranteed. Specifically, the outage probability error floors can be avoided for the secondary users, which is proved by asymptotic analysis in the paper. Extensive simulation results are also provided to demonstrate the superior performance of the proposed schemes.

cs.IT↗

arXiv2023

Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Series

Irregularly sampled multivariate time series are ubiquitous in various fields, particularly in healthcare, and exhibit two key characteristics: intra-series irregularity and inter-series discrepancy. Intra-series irregularity refers to the fact that time-series signals are often recorded at irregular intervals, while inter-series discrepancy refers to the significant variability in sampling rates among diverse series. However, recent advances in irregular time series have primarily focused on addressing intra-series irregularity, overlooking the issue of inter-series discrepancy. To bridge this gap, we present Warpformer, a novel approach that fully considers these two characteristics. In a nutshell, Warpformer has several crucial designs, including a specific input representation that explicitly characterizes both intra-series irregularity and inter-series discrepancy, a warping module that adaptively unifies irregular time series in a given scale, and a customized attention module for representation learning. Additionally, we stack multiple warping and attention modules to learn at different scales, producing multi-scale representations that balance coarse-grained and fine-grained signals for downstream tasks. We conduct extensive experiments on widely used datasets and a new large-scale benchmark built from clinical databases. The results demonstrate the superiority of Warpformer over existing state-of-the-art approaches.

cs.LG↗

arXiv2023

OpenFE: Automated Feature Generation with Expert-level Performance

The goal of automated feature generation is to liberate machine learning experts from the laborious task of manual feature generation, which is crucial for improving the learning performance of tabular data. The major challenge in automated feature generation is to efficiently and accurately identify effective features from a vast pool of candidate features. In this paper, we present OpenFE, an automated feature generation tool that provides competitive results against machine learning experts. OpenFE achieves high efficiency and accuracy with two components: 1) a novel feature boosting method for accurately evaluating the incremental performance of candidate features and 2) a two-stage pruning algorithm that performs feature pruning in a coarse-to-fine manner. Extensive experiments on ten benchmark datasets show that OpenFE outperforms existing baseline methods by a large margin. We further evaluate OpenFE in two Kaggle competitions with thousands of data science teams participating. In the two competitions, features generated by OpenFE with a simple baseline model can beat 99.3% and 99.6% data science teams respectively. In addition to the empirical results, we provide a theoretical perspective to show that feature generation can be beneficial in a simple yet representative setting. The code is available at https://github.com/ZhangTP1996/OpenFE.

cs.LG↗

arXiv2023

Spontaneous Electric Polarization in Graphene Polytypes

A crystalline solid is a periodic sequence of identical cells, each containing one or more atoms. If the constituting unit cell is not centrosymmetric, charge may distribute unevenly between the atoms, resulting in internal electric polarization. This effect serves as the basis for numerous ferroelectric, piezoelectric, and pyroelectric phenomena. In nearly all polar materials, including multilayered van der Waals stacks that were recently found to exhibit interfacial polarization, inversion symmetry is broken by having two or more atomic species within the unit cell. Here, we show that even elemental crystals, consisting of one type of atom, and composed of non-polar centrosymmetric layers, exhibit electric polarization if arranged in an appropriate three-dimensional architecture. This concept is demonstrated here for inversion and mirror asymmetric mixed-stacking tetra-layer polytypes of non-polar graphene sheets. Furthermore, we find that the room temperature out-of-plane electric polarization increases with external electrostatic doping, rather than decreases owing to screening. Using first-principles calculations, as well as tight-binding modeling, we unveil the origin of polytype-induced polarization and its dependence on doping. Extension of this idea to graphene multilayers suggests that solely by lateral shifts of constituent monolayers one can obtain multiple meta-stable interlayer stacking sequences that may allow for even larger electrical polarization.

cond-mat.mtrl-sci↗

arXiv2023

MINER: A Hybrid Data-Driven Approach for REST API Fuzzing

In recent years, REST API fuzzing has emerged to explore errors on a cloud service. Its performance highly depends on the sequence construction and request generation. However, existing REST API fuzzers have trouble generating long sequences with well-constructed requests to trigger hard-to-reach states in a cloud service, which limits their performance of finding deep errors and security bugs. Further, they cannot find the specific errors caused by using undefined parameters during request generation. Therefore, in this paper, we propose a novel hybrid data-driven solution, named MINER, with three new designs working together to address the above limitations. First, MINER collects the valid sequences whose requests pass the cloud service's checking as the templates, and assigns more executions to long sequence templates. Second, to improve the generation quality of requests in a sequence template, MINER creatively leverages the state-of-the-art neural network model to predict key request parameters and provide them with appropriate parameter values. Third, MINER implements a new data-driven security rule checker to capture the new kind of errors caused by undefined parameters. We evaluate MINER against the state-of-the-art fuzzer RESTler on GitLab, Bugzilla, and WordPress via 11 REST APIs. The results demonstrate that the average pass rate of MINER is 23.42% higher than RESTler. MINER finds 97.54% more unique errors than RESTler on average and 142.86% more reproducible errors after manual analysis. We have reported all the newly found errors, and 7 of them have been confirmed as logic bugs by the corresponding vendors.

cs.CR↗

arXiv2022

Autonomous Driving Simulator based on Neurorobotics Platform

There are many artificial intelligence algorithms for autonomous driving, but directly installing these algorithms on vehicles is unrealistic and expensive. At the same time, many of these algorithms need an environment to train and optimize. Simulation is a valuable and meaningful solution with training and testing functions, and it can say that simulation is a critical link in the autonomous driving world. There are also many different applications or systems of simulation from companies or academies such as SVL and Carla. These simulators flaunt that they have the closest real-world simulation, but their environment objects, such as pedestrians and other vehicles around the agent-vehicle, are already fixed programmed. They can only move along the pre-setting trajectory, or random numbers determine their movements. What is the situation when all environmental objects are also installed by Artificial Intelligence, or their behaviors are like real people or natural reactions of other drivers? This problem is a blind spot for most of the simulation applications, or these applications cannot be easy to solve this problem. The Neurorobotics Platform from the TUM team of Prof. Alois Knoll has the idea about "Engines" and "Transceiver Functions" to solve the multi-agents problem. This report will start with a little research on the Neurorobotics Platform and analyze the potential and possibility of developing a new simulator to achieve the true real-world simulation goal. Then based on the NRP-Core Platform, this initial development aims to construct an initial demo experiment. The consist of this report starts with the basic knowledge of NRP-Core and its installation, then focus on the explanation of the necessary components for a simulation experiment, at last, about the details of constructions for the autonomous driving system, which is integrated object detection and autonomous control.

cs.RO↗

arXiv2022

Handling Inter-class and Intra-class Imbalance in Class-imbalanced Learning

Class-imbalance is a common problem in machine learning practice. Typical Imbalanced Learning (IL) methods balance the data via intuitive class-wise resampling or reweighting. However, previous studies suggest that beyond class-imbalance, intrinsic data difficulty factors like overlapping, noise, and small disjuncts also play critical roles. To handle them, many solutions have been proposed (e.g., noise removal, borderline sampling, hard example mining) but are still confined to a specific factor and cannot generalize to broader scenarios, which raises an interesting question: how to handle both class-agnostic difficulties and the class-imbalance in a unified way? To answer this, we consider both class-imbalance and its orthogonal: intra-class imbalance, i.e., the imbalanced distribution over easy and hard samples. Such distribution naturally reflects the complex influence of class-agnostic intrinsic data difficulties thus providing a new unified view for identifying and handling these factors during learning. From this perspective, we discuss the pros and cons of existing IL solutions and further propose new balancing techniques for more robust and efficient IL. Finally, we wrap up all solutions into a generic ensemble IL framework, namely DuBE (Duple-Balanced Ensemble). It features explicit and efficient inter-\&intra-class balancing as well as easy extension with standardized APIs. Extensive experiments validate the effectiveness of DuBE. Code, examples, and documentation are available at https://github.com/AnonAuthorAI/duplebalance and https://duplebalance.readthedocs.io.

cs.LG↗

arXiv2022

Divisibility on point counting over finite Witt rings

Let $\mathbb{F}_q$ denote the finite field of $q$ elements with characteristic $p$. Let $\mathbb{Z}_q$ denote the unramified extension of the $p$-adic integers $\mathbb{Z}_p$ with residue field $\mathbb{F}_q$. In this paper, we investigate the $q$-divisibility for the number of solutions of a polynomial system in $n$ variables over the finite Witt ring $\mathbb{Z}_q/p^m\mathbb{Z}_q$, where the $n$ variables of the polynomials are restricted to run through a combinatorial box lifting $\mathbb{F}_q^n$. The introduction of the combinatorial box makes the problem much more complicated. We prove a $q$-divisibility theorem for any box of low algebraic complexity, including the simplest Teichmüller box.This extends the classical Ax-Katz theorem over finite field $\mathbb{F}_q$ (the case $m=1$). Taking $q=p$ to be a prime, our result extends and improves a recent combinatorial theorem of Grynkiewicz. Our different approach is based on the addition operation of Witt vectors and is conceptually much more transparent.

math.NT↗

arXiv2022

Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structures

Multivariate time series forecasting has seen widely ranging applications in various domains, including finance, traffic, energy, and healthcare. To capture the sophisticated temporal patterns, plenty of research studies designed complex neural network architectures based on many variants of RNNs, GNNs, and Transformers. However, complex models are often computationally expensive and thus face a severe challenge in training and inference efficiency when applied to large-scale real-world datasets. In this paper, we introduce LightTS, a light deep learning architecture merely based on simple MLP-based structures. The key idea of LightTS is to apply an MLP-based structure on top of two delicate down-sampling strategies, including interval sampling and continuous sampling, inspired by a crucial fact that down-sampling time series often preserves the majority of its information. We conduct extensive experiments on eight widely used benchmark datasets. Compared with the existing state-of-the-art methods, LightTS demonstrates better performance on five of them and comparable performance on the rest. Moreover, LightTS is highly efficient. It uses less than 5% FLOPS compared with previous SOTA methods on the largest benchmark dataset. In addition, LightTS is robust and has a much smaller variance in forecasting accuracy than previous SOTA methods in long sequence forecasting tasks.

cs.LG↗

arXiv2022

Cumulative Polarization Coexisting with Conductivity at Interfacial Ferroelectrics

Ferroelectricity in atomically thin bilayer structures has been recently predicted1 and measured[2-4] in two-dimensional (2D) materials with hexagonal non-centrosymmetric unit-cells. Interestingly, the crystal symmetry translates lateral shifts between parallel 2D layers to a change of sign in their out-of-plane electric polarization, a mechanism referred to as "Slide-Tronics"[4]. These observations, however, have been restricted to switching between only two polarization states under low charge carrier densities[5-12], strongly limiting the practical application of the revealed phenomena[13]. To overcome these issues, one needs to explore the nature of the polarization that arises in multi-layered van der Waals (vdW) stacks, how it is governed by intra- and inter-layer charge redistribution, and to which extent it survives the introduction of mobile charge carriers, all of which are presently unknown14. To explore these questions, we conduct surface potential measurements of parallel WSe2 and MoS2 multi-layers with aligned and anti-aligned configurations of the polar interfaces. We find evenly spaced, nearly decoupled potential steps, indicating highly confined interfacial electric fields, which provide means to design multi-state "ladder ferroelectrics". Furthermore, we find that the internal polarization remains significant upon electrostatic doping of a mobile charge carrier density as high as 1013 cm-2, with substantial in-plane conductivity. Using first-principles calculations based on density functional theory (DFT), we trace the extra charge redistribution in real and momentum space and identify an eventual doping-induced depolarization mechanism.

cond-mat.mtrl-sci↗

arXiv2022

Family of Two Dimensional Transition Metal Dichlorides Fundamental Properties, Structural Defects, and Environmental Stability

A large number of novel two-dimensional (2D) materials are constantly discovered and deposed into the databases. Consolidate implementation of machine learning algorithms and density functional theory (DFT) based predictions have allowed creating several databases containing an unimaginable amount of 2D samples. The next step in this chain, the investigation leads to a comprehensive study of the functionality of the invented materials. In this work, a family of transition metal dichlorides has been screened out for systematical investigation of their structural stability, fundamental properties, structural defects, and environmental stability via DFT based calculations. The work highlights the importance of using the potential of the invented materials and proposes a comprehensive characterization of a new family of 2D materials.

cond-mat.mtrl-sci↗

arXiv2022

Exploring Mechanisms of Hydration and Carbonation of MgO and Mg(OH)2 in Reactive Magnesium Oxide-based Cements

Reactive magnesium oxide (MgO)-based cement (RMC) can play a key role in carbon capture processes. However, knowledge on the driving forces that control the degree of carbonation and hydration and rate of reactions in this system remains limited. In this work, density functional theory-based simulations are used to investigate the physical nature of the reactions taking place during the fabrication of RMCs under ambient conditions. Parametric indicators such as adsorption energies, charge transfer, electron localization function, adsorption/dissociation energy barriers and the mechanisms of interaction of H2O and CO2 molecules with MgO and brucite (Mg(OH)2) clusters are considered. The following hydration and carbonation interactions relevant to RMCs are evaluated i) carbonation of MgO, ii) hydration of MgO, carbonation of hydrated MgO, iii) carbonation of Mg(OH)2, iv) hydration of Mg(OH)2 and v) hydration of carbonated Mg(OH)2. A comparison of the energy barriers and reaction pathways of these mechanisms shows that the carbonation of MgO is hindered by presence of H2O molecules, while the carbonation of Mg(OH)2 is hindered by the formation of initial carbonate and hydrate layers as well as presence of excessed H2O molecules. To compare these finding to bulk mineral surfaces, the interactions of the CO2 and H2O molecules with the MgO(001) and Mg(OH)2 (001) surfaces are studied. Therefore, this work presents deep insights into the physical nature of the reactions and the mechanisms involved in hydrated magnesium carbonates production that can be beneficial for its development.

cond-mat.mtrl-sci↗