arXiv subjects

Junbo Zhang

Publications and source records attributed to Junbo Zhang.

At least 91 records · Page 5Linked to original sources

arXiv2020

Fairness and Accuracy in Federated Learning

In the federated learning setting, multiple clients jointly train a model under the coordination of the central server, while the training data is kept on the client to ensure privacy. Normally, inconsistent distribution of data across different devices in a federated network and limited communication bandwidth between end devices impose both statistical heterogeneity and expensive communication as major challenges for federated learning. This paper proposes an algorithm to achieve more fairness and accuracy in federated learning (FedFa). It introduces an optimization scheme that employs a double momentum gradient, thereby accelerating the convergence rate of the model. An appropriate weight selection algorithm that combines the information quantity of training accuracy and training frequency to measure the weights is proposed. This procedure assists in addressing the issue of unfairness in federated learning due to preferences for certain clients. Our results show that the proposed FedFa algorithm outperforms the baseline algorithm in terms of accuracy and fairness.

cs.LG↗

arXiv2020

Data Augmentation For Children's Speech Recognition -- The "Ethiopian" System For The SLT 2021 Children Speech Recognition Challenge

This paper presents the "Ethiopian" system for the SLT 2021 Children Speech Recognition Challenge. Various data processing and augmentation techniques are proposed to tackle children's speech recognition problem, especially the lack of the children's speech recognition training data issue. Detailed experiments are designed and conducted to show the effectiveness of each technique, across different speech recognition toolkits and model architectures. Step by step, we explain how we come up with our final system, which provides the state-of-the-art results in the SLT 2021 Children Speech Recognition Challenge, with 21.66% CER on the Track 1 evaluation set (4th place overall), and 16.53% CER on the Track 2 evaluation set (1st place overall). Post-challenge analysis shows that our system actually achieves 18.82% CER on the Track 1 evaluation set, but we submitted the wrong version to the challenge organizer for Track 1.

cs.SD↗

arXiv2020

KIC 12268220: A $δ$ Scuti Pulsating Star and an Active Protohelium White Dwarf in an Eclipsing Binary System

We present a photometric, spectroscopic, asteroseismic, and evolutionary analysis of the Algol-type eclipsing binary KIC 12268220. We find the O'Connell effect and anticorrelated eclipse timing variations in the Kepler light curve, revealing the presence of large starspots. Radial velocities and atmospheric parameters are obtained from ground-based spectroscopic observations. Combined with the radial velocity measurements and Gaia-derived total luminosity, our light-curve modeling yields the solution of the physical parameters for both the primary and secondary components. We find 14 independent frequencies arising from the $δ$ Scuti primary, and the observed frequencies agree with the frequency range of unstable modes from nonadiabatic calculations. Based on the conclusion from previous literature, we run a grid of models to study the evolution process of our system. The evolutionary tracks of our model suggest that the low-mass ($\sim 0.23\,M_\odot$) evolved secondary shows a similar evolutionary state to the R CMa-type system, which might evolve to an EL CVn system.

astro-ph.SR↗

arXiv2020

Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks

Being able to predict the crowd flows in each and every part of a city, especially in irregular regions, is strategically important for traffic control, risk assessment, and public safety. However, it is very challenging because of interactions and spatial correlations between different regions. In addition, it is affected by many factors: i) multiple temporal correlations among different time intervals: closeness, period, trend; ii) complex external influential factors: weather, events; iii) meta features: time of the day, day of the week, and so on. In this paper, we formulate crowd flow forecasting in irregular regions as a spatio-temporal graph (STG) prediction problem in which each node represents a region with time-varying flows. By extending graph convolution to handle the spatial information, we propose using spatial graph convolution to build a multi-view graph convolutional network (MVGCN) for the crowd flow forecasting problem, where different views can capture different factors as mentioned above. We evaluate MVGCN using four real-world datasets (taxicabs and bikes) and extensive experimental results show that our approach outperforms the adaptations of state-of-the-art methods. And we have developed a crowd flow forecasting system for irregular regions that can now be used internally.

cs.CV↗

arXiv2020

ReAD: A Regional Anomaly Detection Framework Based on Dynamic Partition

The detection of the abnormal area from urban data is a significant research problem. However, to the best of our knowledge, previous methods designed on spatio-temporal anomalies are road-based or grid-based, which usually causes the data sparsity problem and affects the detection results. In this paper, we proposed a dynamic region partition method to address the above issues. Besides, we proposed an unsupervised REgional Anomaly Detection framework (ReAD) to detect abnormal regions with arbitrary shapes by jointly considering spatial and temporal properties. Specifically, the proposed framework first generate regions via a dynamic region partition method. It keeps that observations in the same region have adjacent locations and similar non-spatial attribute readings, and could alleviate data sparsity and heterogeneity compared with the grid-based approach. Then, an anomaly metric will be calculated for each region by a regional divergence calculation method. The abnormal regions could be finally detected by a weighted approach or a wavy approach according to the different scenario. Experiments on both the simulated dataset and real-world applications demonstrate the effectiveness and practicability of the proposed framework.

cs.SI↗

arXiv2020

Revisiting Convolutional Neural Networks for Citywide Crowd Flow Analytics

Citywide crowd flow analytics is of great importance to smart city efforts. It aims to model the crowd flow (e.g., inflow and outflow) of each region in a city based on historical observations. Nowadays, Convolutional Neural Networks (CNNs) have been widely adopted in raster-based crowd flow analytics by virtue of their capability in capturing spatial dependencies. After revisiting CNN-based methods for different analytics tasks, we expose two common critical drawbacks in the existing uses: 1) inefficiency in learning global spatial dependencies, and 2) overlooking latent region functions. To tackle these challenges, in this paper we present a novel framework entitled DeepLGR that can be easily generalized to address various citywide crowd flow analytics problems. This framework consists of three parts: 1) a local feature extraction module to learn representations for each region; 2) a global context module to extract global contextual priors and upsample them to generate the global features; and 3) a region-specific predictor based on tensor decomposition to provide customized predictions for each region, which is very parameter-efficient compared to previous methods. Extensive experiments on two typical crowd flow analytics tasks demonstrate the effectiveness, stability, and generality of our framework.

cs.CV↗

arXiv2020

Federated Extra-Trees with Privacy Preserving

It is commonly observed that the data are scattered everywhere and difficult to be centralized. The data privacy and security also become a sensitive topic. The laws and regulations such as the European Union's General Data Protection Regulation (GDPR) are designed to protect the public's data privacy. However, machine learning requires a large amount of data for better performance, and the current circumstances put deploying real-life AI applications in an extremely difficult situation. To tackle these challenges, in this paper we propose a novel privacy-preserving federated machine learning model, named Federated Extra-Trees, which applies local differential privacy in the federated trees model. A secure multi-institutional machine learning system was developed to provide superior performance by processing the modeling jointly on different clients without exchanging any raw data. We have validated the accuracy of our work by conducting extensive experiments on public datasets and the efficiency and robustness were also verified by simulating the real-world scenarios. Overall, we presented an extensible, scalable and practical solution to handle the data island problem.

cs.LG↗

arXiv2019

A wide star-black-hole binary system from radial-velocity measurements

All stellar mass black holes have hitherto been identified by X-rays emitted by gas that is accreting onto the black hole from a companion star. These systems are all binaries with black holes below 30 M$_{\odot}$$^{1-4}$. Theory predicts, however, that X-ray emitting systems form a minority of the total population of star-black hole binaries$^{5,6}$. When the black hole is not accreting gas, it can be found through radial velocity measurements of the motion of the companion star. Here we report radial velocity measurements of a Galactic star, LB-1, which is a B-type star, taken over two years. We find that the motion of the B-star and an accompanying H$α$ emission line require the presence of a dark companion with a mass of $68^{+11}_{-13}$ M$_{\odot}$, which can only be a black hole. The long orbital period of 78.9 days shows that this is a wide binary system. The gravitational wave experiments have detected similarly massive black holes$^{7,8}$, but forming such massive ones in a high-metallicity environment would be extremely challenging to current stellar evolution theories$^{9-11}$.

astro-ph.SR↗

arXiv2019

Urban flows prediction from spatial-temporal data using machine learning: A survey

Urban spatial-temporal flows prediction is of great importance to traffic management, land use, public safety, etc. Urban flows are affected by several complex and dynamic factors, such as patterns of human activities, weather, events and holidays. Datasets evaluated the flows come from various sources in different domains, e.g. mobile phone data, taxi trajectories data, metro/bus swiping data, bike-sharing data and so on. To summarize these methodologies of urban flows prediction, in this paper, we first introduce four main factors affecting urban flows. Second, in order to further analysis urban flows, a preparation process of multi-sources spatial-temporal data related with urban flows is partitioned into three groups. Third, we choose the spatial-temporal dynamic data as a case study for the urban flows prediction task. Fourth, we analyze and compare some well-known and state-of-the-art flows prediction methods in detail, classifying them into five categories: statistics-based, traditional machine learning-based, deep learning-based, reinforcement learning-based and transfer learning-based methods. Finally, we give open challenges of urban flows prediction and an outlook in the future of this field. This paper will facilitate researchers find suitable methods and open datasets for addressing urban spatial-temporal flows forecast problems.

cs.LG↗

arXiv2019

SN 2017gmr: An energetic Type II-P supernova with asymmetries

We present high-cadence ultraviolet (UV), optical, and near-infrared (NIR) data on the luminous Type II-P supernova SN 2017gmr from hours after discovery through the first 180 days. SN 2017gmr does not show signs of narrow, high-ionization emission lines in the early optical spectra, yet the optical lightcurve evolution suggests that an extra energy source from circumstellar medium (CSM) interaction must be present for at least 2 days after explosion. Modeling of the early lightcurve indicates a ~500R$_{\odot}$ progenitor radius, consistent with a rather compact red supergiant, and late-time luminosities indicate up to 0.130 $\pm$ 0.026 M$_{\odot}$ of $^{56}$Ni are present, if the lightcurve is solely powered by radioactive decay, although the $^{56}$Ni mass may be lower if CSM interaction contributes to the post-plateau luminosity. Prominent multi-peaked emission lines of H$α$ and [O I] emerge after day 154, as a result of either an asymmetric explosion or asymmetries in the CSM. The lack of narrow lines within the first two days of explosion in the likely presence of CSM interaction may be an example of close, dense, asymmetric CSM that is quickly enveloped by the spherical supernova ejecta.

astro-ph.HE↗

arXiv2019

An optical and X-ray study of the contact binary, BH Cassiopeiae

We present the revised and high quality CCD time series observations in 2017 and 2018 of the W UMa-type contact binary BH~Cas. The combination of our new determinations of minimum times and those collected from the literatures reveal a long-term period increase with a rate of $\textit{dP/dt}\,=\,+3.27 \times 10^{-7} \textrm{d}\,\textrm{yr}^{-1}$, which can be accounted for by angular momentum transfer as the less-massive component loses its mass to the more massive one. One cyclical oscillation ($A'=0.00300$~days and $P'=20.09$~yrs) superimposed on the long-term period increase tendency is attributed to one additional object that orbits BH Cas. The low-resolution spectra of this source are observed at phase $\sim$0.0 and $\sim$0.5 in 2018 and 2019, and the spectral types are identified as K3V$\,\pm\,$1 and G8V$\,\pm\,$2. According to the luminosity contributions and spectra at these phases, the spectral type of the primary star is close to K3V$\,\pm\,$1. We infer a cool spot on the hotter and less-massive component to fit the asymmetry of light curves. In addition, changes in the location, temperature, and area of spots on the secondary star in different observations may indicate that the magnetic field activity of the secondary is more active than that of the primary. Such strong spot activities and optical flare are both detected at the same time from a W UMa-type star for the first time. With the \emph{XMM-Newton} observations taken in 2003 and 2012, the X-ray light curve is obtained and the X-ray spectra can be well described with a black-body or a bremsstrahlung model. The soft X-ray luminosity of BH Cas is estimated as 8.8\,--\,9.7$\,\times\,10^{30}$\,erg\,s$^{-1}$.

astro-ph.SR↗

arXiv2019

DOER: Dual Cross-Shared RNN for Aspect Term-Polarity Co-Extraction

This paper focuses on two related subtasks of aspect-based sentiment analysis, namely aspect term extraction and aspect sentiment classification, which we call aspect term-polarity co-extraction. The former task is to extract aspects of a product or service from an opinion document, and the latter is to identify the polarity expressed in the document about these extracted aspects. Most existing algorithms address them as two separate tasks and solve them one by one, or only perform one task, which can be complicated for real applications. In this paper, we treat these two tasks as two sequence labeling problems and propose a novel Dual crOss-sharEd RNN framework (DOER) to generate all aspect term-polarity pairs of the input sentence simultaneously. Specifically, DOER involves a dual recurrent neural network to extract the respective representation of each task, and a cross-shared unit to consider the relationship between them. Experimental results demonstrate that the proposed framework outperforms state-of-the-art baselines on three benchmark datasets.

cs.CL↗

arXiv2019

Federated Forest

Most real-world data are scattered across different companies or government organizations, and cannot be easily integrated under data privacy and related regulations such as the European Union's General Data Protection Regulation (GDPR) and China' Cyber Security Law. Such data islands situation and data privacy & security are two major challenges for applications of artificial intelligence. In this paper, we tackle these challenges and propose a privacy-preserving machine learning model, called Federated Forest, which is a lossless learning model of the traditional random forest method, i.e., achieving the same level of accuracy as the non-privacy-preserving approach. Based on it, we developed a secure cross-regional machine learning system that allows a learning process to be jointly trained over different regions' clients with the same user samples but different attribute sets, processing the data stored in each of them without exchanging their raw data. A novel prediction algorithm was also proposed which could largely reduce the communication overhead. Experiments on both real-world and UCI data sets demonstrate the performance of the Federated Forest is as accurate as the non-federated version. The efficiency and robustness of our proposed system had been verified. Overall, our model is practical, scalable and extensible for real-life tasks.

cs.LG↗

arXiv2019

Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning

In this letter, we address the problem of controlling energy storage systems (ESSs) for arbitrage in real-time electricity markets under price uncertainty. We first formulate this problem as a Markov decision process, and then develop a deep reinforcement learning based algorithm to learn a stochastic control policy that maps a set of available information processed by a recurrent neural network to ESSs' charging/discharging actions. Finally, we verify the effectiveness of our algorithm using real-time electricity prices from PJM.

cs.LG↗

arXiv2019

High-resolution spectroscopic analysis of a large sample of Li-rich giants found by LAMOST

The discovery of Li-rich giant has cast a new challenge for the standard stellar evolution models, and to resolve this issue, the number of this type object has been rapidly increased because of the development of worldwide surveys these days. Taking advantage of the Large Sky Area Multi-Object Fiber Spectroscopic Telescope survey, 44 newly Li-rich giants are reported, which are confirmed with high-resolution observations. Based on the high-resolution and high signal-to-noise spectra, we derived the atmospheric parameters and elemental abundances with the spectral synthesis method. We performed a detailed analysis of their evolutionary stages, infrared excess, projected rotational velocity (v sin i), and the stellar population. We find that (1) The Li-rich giants concentrate at the evolutionary status of the red giant branch bump, red clump, and asymptotic giant branch; (2) Three of them are fast rotators and none exhibit infrared excess. Our results imply that the origins of Li enrichment are most likely to be associated with the extra mixing in the stellar interior, and the external sources maybe only make a minor contribution. Moreover, various Li-rich episodes take place at different evolutionary stages.

astro-ph.SR↗

arXiv2019

A Predictor-Corrector Method for Power System Variable Step Numerical Simulation

This letter proposes a predictor-corrector method to strike a balance between simulation accuracy and efficiency by appropriately tuning the numerical integration step length of a power system time-domain simulation. Numerical tests indicate that, by estimating the truncation error for step length tuning based on the 2-Step Adams-Moulton method and the implicit Trapezoidal method, the proposed method can provide much more precise results at little cost of efficiency compared to a conventional variable step method based on Newton's method.

cs.CE↗

arXiv2019

UrbanFM: Inferring Fine-Grained Urban Flows

Urban flow monitoring systems play important roles in smart city efforts around the world. However, the ubiquitous deployment of monitoring devices, such as CCTVs, induces a long-lasting and enormous cost for maintenance and operation. This suggests the need for a technology that can reduce the number of deployed devices, while preventing the degeneration of data accuracy and granularity. In this paper, we aim to infer the real-time and fine-grained crowd flows throughout a city based on coarse-grained observations. This task is challenging due to two reasons: the spatial correlations between coarse- and fine-grained urban flows, and the complexities of external impacts. To tackle these issues, we develop a method entitled UrbanFM based on deep neural networks. Our model consists of two major parts: 1) an inference network to generate fine-grained flow distributions from coarse-grained inputs by using a feature extraction module and a novel distributional upsampling module; 2) a general fusion subnet to further boost the performance by considering the influences of different external factors. Extensive experiments on two real-world datasets, namely TaxiBJ and HappyValley, validate the effectiveness and efficiency of our method compared to seven baselines, demonstrating the state-of-the-art performance of our approach on the fine-grained urban flow inference problem.

cs.CV↗

arXiv2019

Data-Driven Online Optimization for Enhancing Power System Oscillation Damping

This paper reports an initial work on power system oscillation damping improvement using a data-driven online optimization method. An online oscillation damping optimization mod-el is proposed and formulated in a form solvable by the data-driven method. Key issues in the online optimization procedures, including the damping sensitivity identification method, its compatibility with the dispatch plans, as well as other practical issues in real large-scale system are discussed. Simulation results based on the 2-area 4-machine system, and the NETS-NYPS 68-bus system verify the feasibility and efficiency of the proposed method. The results also show the capability of the proposed method to bridge the gap between online data analysis and complex optimization for power system dynamics.

math.OC↗