arXiv subjects

Na Li

Publications and source records attributed to Na Li.

At least 253 records · Page 14Linked to original sources

arXiv2020

On Maintaining Linear Convergence of Distributed Learning and Optimization under Limited Communication

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The communication time of these algorithms follows a complex interplay between a) the algorithm's convergence properties, b) the compression scheme, and c) the transmission rate offered by the digital channel. We explore these relationships for a general class of linearly convergent distributed algorithms. In particular, we illustrate how to design quantizers for these algorithms that compress the communicated information to a few bits while still preserving the linear convergence. Moreover, we characterize the communication time of these algorithms as a function of the available transmission rate. We illustrate our results on learning algorithms using different communication structures, such as decentralized algorithms where a single master coordinates information from many workers and fully distributed algorithms where only neighbours in a communication graph can communicate. We conclude that a co-design of machine learning and communication protocols are mandatory to flourish machine learning over networks.

math.OC↗

arXiv2020

Stem-leaf segmentation and phenotypic trait extraction of maize shoots from three-dimensional point cloud

Nowadays, there are many approaches to acquire three-dimensional (3D) point clouds of maize plants. However, automatic stem-leaf segmentation of maize shoots from three-dimensional (3D) point clouds remains challenging, especially for new emerging leaves that are very close and wrapped together during the seedling stage. To address this issue, we propose an automatic segmentation method consisting of three main steps: skeleton extraction, coarse segmentation based on the skeleton, fine segmentation based on stem-leaf classification. The segmentation method was tested on 30 maize seedlings and compared with manually obtained ground truth. The mean precision, mean recall, mean micro F1 score and mean over accuracy of our segmentation algorithm were 0.964, 0.966, 0.963 and 0.969. Using the segmentation results, two applications were also developed in this paper, including phenotypic trait extraction and skeleton optimization. Six phenotypic parameters can be accurately and automatically measured, including plant height, crown diameter, stem height and diameter, leaf width and length. Furthermore, the values of R2 for the six phenotypic traits were all above 0.94. The results indicated that the proposed algorithm could automatically and precisely segment not only the fully expanded leaves, but also the new leaves wrapped together and close together. The proposed approach may play an important role in further maize research and applications, such as genotype-to-phenotype study, geometric reconstruction and dynamic growth animation. We released the source code and test data at the web site https://github.com/syau-miao/seg4maize.git

cs.CV↗

arXiv2020

A decision integration strategy for short-term demand forecasting and ordering for red blood cell components

Blood transfusion is one of the most crucial and commonly administered therapeutics worldwide. The need for more accurate and efficient ways to manage blood demand and supply is an increasing concern. Building a technology-based, robust blood demand and supply chain that can achieve the goals of reducing ordering frequency, inventory level, wastage and shortage, while maintaining the safety of blood usage, is essential in modern healthcare systems. In this study, we summarize the key challenges in current demand and supply management for red blood cells (RBCs). We combine ideas from statistical time series modeling, machine learning, and operations research in developing an ordering decision strategy for RBCs, through integrating a hybrid demand forecasting model using clinical predictors and a data-driven multi-period inventory problem considering inventory and reorder constraints. We have applied the integrated ordering strategy to the blood inventory management system in Hamilton, Ontario using a large clinical database from 2008 to 2018. The proposed hybrid demand forecasting model provides robust and accurate predictions, and identifies important clinical predictors for short-term RBC demand forecasting. Compared with the actual historical data, our integrated ordering strategy reduces the inventory level by 40% and decreases the ordering frequency by 60%, with low incidence of shortages and wastage due to expiration. If implemented successfully, our proposed strategy can achieve significant cost savings for healthcare systems and blood suppliers. The proposed ordering strategy is generalizable to other blood products or even other perishable products.

stat.AP↗

arXiv2020

Investigating Robustness of Adversarial Samples Detection for Automatic Speaker Verification

Recently adversarial attacks on automatic speaker verification (ASV) systems attracted widespread attention as they pose severe threats to ASV systems. However, methods to defend against such attacks are limited. Existing approaches mainly focus on retraining ASV systems with adversarial data augmentation. Also, countermeasure robustness against different attack settings are insufficiently investigated. Orthogonal to prior approaches, this work proposes to defend ASV systems against adversarial attacks with a separate detection network, rather than augmenting adversarial data into ASV training. A VGG-like binary classification detector is introduced and demonstrated to be effective on detecting adversarial samples. To investigate detector robustness in a realistic defense scenario where unseen attack settings may exist, we analyze various kinds of unseen attack settings' impact and observe that the detector is robust (6.27\% EER_{det} degradation in the worst case) against unseen substitute ASV systems, but it has weak robustness (50.37\% EER_{det} degradation in the worst case) against unseen perturbation methods. The weak robustness against unseen perturbation methods shows a direction for developing stronger countermeasures.

eess.AS↗

arXiv2020

Large spin to charge conversion in topological superconductor \b{eta}-PdBi2 at room temperature

\b{eta}-PdBi2 has attracted much attention for its prospective ability to possess simultaneously topological surface and superconducting states due to its unprecedented spin-orbit interaction (SOC). Whereas most works have focused solely on investigating its topological surface states, the coupling between spin and charge degrees of freedom in this class of quantum material remains unexplored. Here we first report a study of spin-to-charge conversion in a \b{eta}-PdBi2 ultrathin film grown by molecular beam epitaxy, utilizing a spin pumping technique to perform inverse spin Hall effect measurements. We find that the room temperature spin Hall angle of Fe/\b{eta}-PdBi2, θ_SH=0.037. This value is one order of magnitude larger than that of reported conventional superconductors, and is comparable to that of the best SOC metals and topological insulators. Our results provide an avenue for developing superconductor-based spintronic applications.

cond-mat.mes-hall↗

arXiv2020

Distributed Zero-Order Algorithms for Nonconvex Multi-Agent Optimization

Distributed multi-agent optimization finds many applications in distributed learning, control, estimation, etc. Most existing algorithms assume knowledge of first-order information of the objective and have been analyzed for convex problems. However, there are situations where the objective is nonconvex, and one can only evaluate the function values at finitely many points. In this paper we consider derivative-free distributed algorithms for nonconvex multi-agent optimization, based on recent progress in zero-order optimization. We develop two algorithms for different settings, provide detailed analysis of their convergence behavior, and compare them with existing centralized zero-order algorithms and gradient-based distributed algorithms.

math.OC↗

arXiv2020

Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we identify a rich class of networked MARL problems where the model exhibits a local dependence structure that allows it to be solved in a scalable manner. Specifically, we propose a Scalable Actor-Critic (SAC) method that can learn a near optimal localized policy for optimizing the average reward with complexity scaling with the state-action space size of local neighborhoods, as opposed to the entire network. Our result centers around identifying and exploiting an exponential decay property that ensures the effect of agents on each other decays exponentially fast in their graph distance.

math.OC↗

arXiv2020

Online Residential Demand Response via Contextual Multi-Armed Bandits

Residential loads have great potential to enhance the efficiency and reliability of electricity systems via demand response (DR) programs. One major challenge in residential DR is to handle the unknown and uncertain customer behaviors. Previous works use learning techniques to predict customer DR behaviors, while the influence of time-varying environmental factors is generally neglected, which may lead to inaccurate prediction and inefficient load adjustment. In this paper, we consider the residential DR problem where the load service entity (LSE) aims to select an optimal subset of customers to maximize the expected load reduction with a financial budget. To learn the uncertain customer behaviors under the environmental influence, we formulate the residential DR as a contextual multi-armed bandit (MAB) problem, and the online learning and selection (OLS) algorithm based on Thompson sampling is proposed to solve it. This algorithm takes the contextual information into consideration and is applicable to complicated DR settings. Numerical simulations are performed to demonstrate the learning effectiveness of the proposed algorithm.

eess.SY↗

arXiv2020

Epitaxial Growth and Band Structure of Antiferromagnetic Mott Insulator CeOI

The van der Waals material CeOI is predicted to be a layered antiferromagnetic Mott insulator by DFT+U calculation. We successfully grow the CeOI films down to monolayer on graphene/6H-SiC(0001) substrate by using molecular beam epitaxy. Films are studied by {\it in-situ} scanning tunneling microscopy and spectroscopy, which shows a band gap of 4.4 eV. A metallic phase with composition unidentified also exists. This rare earth oxyhalide adds a new member to the two-dimensional magnetic materials.

cond-mat.mtrl-sci↗

arXiv2020

Distributed Automatic Load-Frequency Control with Optimality in Power Systems

With the increasing penetration of renewable energy resources, power systems face new challenges in balancing power supply and demand and maintaining the nominal frequency. This paper studies load control to handle these challenges. In particular, a fully distributed automatic load control (ALC) algorithm, which only needs local measurement and local communication, is proposed. We prove that the load control algorithm globally converges to an optimal operating point which minimizes the total disutility of users, restores the nominal frequency and the scheduled tie-line power flows, and respects the load capacity limits and the thermal constraints of transmission lines. It is further shown that the asymptotic convergence still holds even when inaccurate system parameters are used in the control algorithm. In addition, the global exponential convergence of the reduced ALC algorithm without considering the capacity limits is proved and leveraged to study the dynamical tracking performance and robustness of the algorithm. Lastly, the effectiveness, optimality, and robustness of the proposed algorithm are demonstrated via numerical simulations.

math.OC↗

arXiv2020

Correlated states in twisted double bilayer graphene

Electron-electron interactions play an important role in graphene and related systems and can induce exotic quantum states, especially in a stacked bilayer with a small twist angle. For bilayer graphene where the two layers are twisted by a "magic angle", flat band and strong many-body effects lead to correlated insulating states and superconductivity. In contrast to monolayer graphene, the band structure of untwisted bilayer graphene can be further tuned by a displacement field, providing an extra degree of freedom to control the flat band that should appear when two bilayers are stacked on top of each other. Here, we report the discovery and characterization of such displacement-field tunable electronic phases in twisted double bilayer graphene. We observe insulating states at a half-filled conduction band in an intermediate range of displacement fields. Furthermore, the resistance gap in the correlated insulator increases with respect to the in-plane magnetic fields and we find that the g factor according to spin Zeeman effect is ~2, indicating spin polarization at half filling. These results establish the twisted double bilayer graphene as an easily tunable platform for exploring quantum many-body states.

cond-mat.supr-con↗

arXiv2020

A Reliability-aware Multi-armed Bandit Approach to Learn and Select Users in Demand Response

One challenge in the optimization and control of societal systems is to handle the unknown and uncertain user behavior. This paper focuses on residential demand response (DR) and proposes a closed-loop learning scheme to address these issues. In particular, we consider DR programs where an aggregator calls upon residential users to change their demand so that the total load adjustment is close to a target value. To learn and select the right users, we formulate the DR problem as a combinatorial multi-armed bandit (CMAB) problem with a reliability objective. We propose a learning algorithm: CUCB-Avg (Combinatorial Upper Confidence Bound-Average), which utilizes both upper confidence bounds and sample averages to balance the tradeoff between exploration (learning) and exploitation (selecting). We consider both a fixed time-invariant target and time-varying targets, and show that CUCB-Avg achieves $O(\log T)$ and $O(\sqrt{T \log(T)})$ regrets respectively. Finally, we numerically test our algorithms using synthetic and real data, and demonstrate that our CUCB-Avg performs significantly better than the classic CUCB and also better than Thompson Sampling.

eess.SY↗

arXiv2020

Online Optimization with Predictions and Switching Costs: Fast Algorithms and the Fundamental Limit

This paper studies an online optimization problem with a finite prediction window of cost functions and additional switching costs on decisions. We propose two gradient-based online algorithms: Receding Horizon Gradient Descent (RHGD), and Receding Horizon Accelerated Gradient (RHAG). Both algorithms only require a finite number of projected gradient evaluations at each stage. We provide upper bounds on the dynamic regrets of the proposed algorithms and show that the regret upper bounds decay exponentially with the length of the prediction window. Moreover, we study the fundamental lower bound on the dynamic regret for a broad class of deterministic online algorithms. The lower bound is close to RHAG's regret upper bound, indicating that our gradient-based RHAG is a near-optimal online algorithm. Finally, we conduct numerical experiments to complement our theoretical analysis.

math.OC↗

arXiv2020

MODMA dataset: a Multi-modal Open Dataset for Mental-disorder Analysis

According to the World Health Organization, the number of mental disorder patients, especially depression patients, has grown rapidly and become a leading contributor to the global burden of disease. However, the present common practice of depression diagnosis is based on interviews and clinical scales carried out by doctors, which is not only labor-consuming but also time-consuming. One important reason is due to the lack of physiological indicators for mental disorders. With the rising of tools such as data mining and artificial intelligence, using physiological data to explore new possible physiological indicators of mental disorder and creating new applications for mental disorder diagnosis has become a new research hot topic. However, good quality physiological data for mental disorder patients are hard to acquire. We present a multi-modal open dataset for mental-disorder analysis. The dataset includes EEG and audio data from clinically depressed patients and matching normal controls. All our patients were carefully diagnosed and selected by professional psychiatrists in hospitals. The EEG dataset includes not only data collected using traditional 128-electrodes mounted elastic cap, but also a novel wearable 3-electrode EEG collector for pervasive applications. The 128-electrodes EEG signals of 53 subjects were recorded as both in resting state and under stimulation; the 3-electrode EEG signals of 55 subjects were recorded in resting state; the audio data of 52 subjects were recorded during interviewing, reading, and picture description. We encourage other researchers in the field to use it for testing their methods of mental-disorder analysis.

cs.DL↗

arXiv2020

Distributed Optimal Voltage Control with Asynchronous and Delayed Communication

The increased penetration of volatile renewable energy into distribution networks necessities more efficient distributed voltage control. In this paper, we design distributed feedback control algorithms where each bus can inject \emph{both active and reactive} power into the grid to regulate the voltages. The control law on each bus is only based on local voltage measurements and communication to its physical neighbors. Moreover, the buses can perform their updates \emph{asynchronously} without receiving information from their neighbors for periods of time. The algorithm enforces \emph{hard upper and lower limits} on the active and reactive powers at every iteration. We prove that the algorithm converges to the optimal feasible voltage profile, assuming linear power flows. This provable convergence is maintained under bounded communication delays and asynchronous communications. We further numerically test the performance of the algorithm using the full \emph{nonlinear AC power flow} model. Our simulations show the effectiveness of our algorithm on realistic networks with both static and fluctuating loads, even in the presence of communication delays.

eess.SY↗

arXiv2019

Resilient Cyberphysical Systems and their Application Drivers: A Technology Roadmap

Cyberphysical systems (CPS) are ubiquitous in our personal and professional lives, and they promise to dramatically improve micro-communities (e.g., urban farms, hospitals), macro-communities (e.g., cities and metropolises), urban structures (e.g., smart homes and cars), and living structures (e.g., human bodies, synthetic genomes). The question that we address in this article pertains to designing these CPS systems to be resilient-from-the-ground-up, and through progressive learning, resilient-by-reaction. An optimally designed system is resilient to both unique attacks and recurrent attacks, the latter with a lower overhead. Overall, the notion of resilience can be thought of in the light of three main sources of lack of resilience, as follows: exogenous factors, such as natural variations and attack scenarios; mismatch between engineered designs and exogenous factors ranging from DDoS (distributed denial-of-service) attacks or other cybersecurity nightmares, so called "black swan" events, disabling critical services of the municipal electrical grids and other connected infrastructures, data breaches, and network failures; and the fragility of engineered designs themselves encompassing bugs, human-computer interactions (HCI), and the overall complexity of real-world systems. In the paper, our focus is on design and deployment innovations that are broadly applicable across a range of CPS application areas.

cs.CY↗

arXiv2019

Torsional refrigeration by twisted, coiled, and supercoiled fibers

Higher efficiency, lower cost refrigeration is needed for both large and small scale cooling. Refrigerators using entropy changes during cycles of stretching or hydrostatically compression of a solid are possible alternatives to the vapor-compression fridges found in homes. We show that high cooling results from twist changes for twisted, coiled, or supercoiled fibers, including those of natural rubber, NiTi, and polyethylene fishing line. By using opposite chiralities of twist and coiling, supercoiled natural rubber fibers and coiled fishing line fibers result that cool when stretched. A demonstrated twist-based device for cooling flowing water provides a high cooling energy and device efficiency. Theory describes the axial and spring index dependencies of twist-enhanced cooling and its origin in a phase transformation for polyethylene fibers.

physics.app-ph↗

arXiv2019

Online Optimal Control with Linear Dynamics and Predictions: Algorithms and Regret Analysis

This paper studies the online optimal control problem with time-varying convex stage costs for a time-invariant linear dynamical system, where a finite lookahead window of accurate predictions of the stage costs are available at each time. We design online algorithms, Receding Horizon Gradient-based Control (RHGC), that utilize the predictions through finite steps of gradient computations. We study the algorithm performance measured by dynamic regret: the online performance minus the optimal performance in hindsight. It is shown that the dynamic regret of RHGC decays exponentially with the size of the lookahead window. In addition, we provide a fundamental limit of the dynamic regret for any online algorithms by considering linear quadratic tracking problems. The regret upper bound of one RHGC method almost reaches the fundamental limit, demonstrating the effectiveness of the algorithm. Finally, we numerically test our algorithms for both linear and nonlinear systems to show the effectiveness and generality of our RHGC.

math.OC↗