arXiv subjects

Jia Hu

Publications and source records attributed to Jia Hu.

62 records · Page 4Linked to original sources

arXiv2022

Accelerating Federated Learning with a Global Biased Optimiser

Federated Learning (FL) is a recent development in distributed machine learning that collaboratively trains models without training data leaving client devices, preserving data privacy. In real-world FL, the training set is distributed over clients in a highly non-Independent and Identically Distributed (non-IID) fashion, harming model convergence speed and final performance. To address this challenge, we propose a novel, generalised approach for incorporating adaptive optimisation into FL with the Federated Global Biased Optimiser (FedGBO) algorithm. FedGBO accelerates FL by employing a set of global biased optimiser values during training, reducing 'client-drift' from non-IID data whilst benefiting from adaptive optimisation. We show that in FedGBO, updates to the global model can be reformulated as centralised training using biased gradients and optimiser updates, and apply this framework to prove FedGBO's convergence on nonconvex objectives when using the momentum-SGD (SGDm) optimiser. We also conduct extensive experiments using 4 FL benchmark datasets (CIFAR100, Sent140, FEMNIST, Shakespeare) and 3 popular optimisers (SGDm, RMSProp, Adam) to compare FedGBO against six state-of-the-art FL algorithms. The results demonstrate that FedGBO displays superior or competitive performance across the datasets whilst having low data-upload and computational costs, and provide practical insights into the trade-offs associated with different adaptive-FL algorithms and optimisers.

cs.LG↗

arXiv2022

The impact of filaments on dwarf galaxy properties in the Auriga simulations

With a hydrodynamical simulation using a simple galaxy formation model without taking into account feedback, our previous work has shown that dense and massive filaments at high redshift can provide potential wells to trap and compress gas, and hence affect galaxy formation in their resident low-mass haloes. In this paper, we make use of the Auriga simulations, a suite of high-resolution zoom-in hydrodynamical simulations of Milky Way-like galaxies, to study whether the conclusion still holds in the simulations with a sophisticated galaxy formation model. In agreement with the results of our previous work, we find that, comparing to their counterparts with similar halo masses in field, dwarf galaxies residing in filaments tend to have higher baryonic and stellar fractions. At the fixed parent halo mass, the filament dwarfs tend to have slightly higher star formation rates than those of field ones. But overall we do not find a clear difference in galaxy g - r colours between the filament and field populations. We also show that at high redshifts, the gas components in dwarf galaxies tend to have their spins aligned with the filaments in which they reside. Our results support a picture in which massive filaments at high redshift assist gas accretion and enhance star formation in their resident dwarf sized dark matter haloes.

astro-ph.GA↗

arXiv2021

Illumination and Temperature-Aware Multispectral Networks for Edge-Computing-Enabled Pedestrian Detection

Accurate and efficient pedestrian detection is crucial for the intelligent transportation system regarding pedestrian safety and mobility, e.g., Advanced Driver Assistance Systems, and smart pedestrian crosswalk systems. Among all pedestrian detection methods, vision-based detection method is demonstrated to be the most effective in previous studies. However, the existing vision-based pedestrian detection algorithms still have two limitations that restrict their implementations, those being real-time performance as well as the resistance to the impacts of environmental factors, e.g., low illumination conditions. To address these issues, this study proposes a lightweight Illumination and Temperature-aware Multispectral Network (IT-MN) for accurate and efficient pedestrian detection. The proposed IT-MN is an efficient one-stage detector. For accommodating the impacts of environmental factors and enhancing the sensing accuracy, thermal image data is fused by the proposed IT-MN with visual images to enrich useful information when visual image quality is limited. In addition, an innovative and effective late fusion strategy is also developed to optimize the image fusion performance. To make the proposed model implementable for edge computing, the model quantization is applied to reduce the model size by 75% while shortening the inference time significantly. The proposed algorithm is evaluated by comparing with the selected state-of-the-art algorithms using a public dataset collected by in-vehicle cameras. The results show that the proposed algorithm achieves a low miss rate and inference time at 14.19% and 0.03 seconds per image pair on GPU. Besides, the quantized IT-MN achieves an inference time of 0.21 seconds per image pair on the edge device, which also demonstrates the potentiality of deploying the proposed model on edge devices as a highly efficient pedestrian detection algorithm.

cs.CV↗

arXiv2021

Multi-Task Federated Learning for Personalised Deep Neural Networks in Edge Computing

Federated Learning (FL) is an emerging approach for collaboratively training Deep Neural Networks (DNNs) on mobile devices, without private user data leaving the devices. Previous works have shown that non-Independent and Identically Distributed (non-IID) user data harms the convergence speed of the FL algorithms. Furthermore, most existing work on FL measures global-model accuracy, but in many cases, such as user content-recommendation, improving individual User model Accuracy (UA) is the real objective. To address these issues, we propose a Multi-Task FL (MTFL) algorithm that introduces non-federated Batch-Normalization (BN) layers into the federated DNN. MTFL benefits UA and convergence speed by allowing users to train models personalised to their own data. MTFL is compatible with popular iterative FL optimisation algorithms such as Federated Averaging (FedAvg), and we show empirically that a distributed form of Adam optimisation (FedAvg-Adam) benefits convergence speed even further when used as the optimisation strategy within MTFL. Experiments using MNIST and CIFAR10 demonstrate that MTFL is able to significantly reduce the number of rounds required to reach a target UA, by up to $5\times$ when using existing FL optimisation strategies, and with a further $3\times$ improvement when using FedAvg-Adam. We compare MTFL to competing personalised FL algorithms, showing that it is able to achieve the best UA for MNIST and CIFAR10 in all considered scenarios. Finally, we evaluate MTFL with FedAvg-Adam on an edge-computing testbed, showing that its convergence and UA benefits outweigh its overhead.

cs.LG↗

arXiv2020

Fast Adaptive Task Offloading in Edge Computing based on Meta Reinforcement Learning

Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile applications from user equipment (UE) to MEC hosts. Recently, many deep reinforcement learning (DRL) based methods have been proposed to learn offloading policies through interacting with the MEC environment that consists of UE, wireless channels, and MEC hosts. However, these methods have weak adaptability to new environments because they have low sample efficiency and need full retraining to learn updated policies for new environments. To overcome this weakness, we propose a task offloading method based on meta reinforcement learning, which can adapt fast to new environments with a small number of gradient updates and samples. We model mobile applications as Directed Acyclic Graphs (DAGs) and the offloading policy by a custom sequence-to-sequence (seq2seq) neural network. To efficiently train the seq2seq network, we propose a method that synergizes the first order approximation and clipped surrogate objective. The experimental results demonstrate that this new offloading method can reduce the latency by up to 25% compared to three baselines while being able to adapt fast to new environments.

cs.DC↗

arXiv2020

A General Architecture for Behavior Modeling of Nonlinear Power Amplifier using Deep Convolutional Neural Network

Nonlinearity of power amplifier is one of the major limitations to the achievable capacity in wireless transmission systems. Nonlinear impairments are determined by the nonlinear distortions of the power amplifier and modulator imperfections. The Volterra model, several compact Volterra models and neural network models to establish a nonlinear model of power amplifier have all been demonstrated. However, the computational cost of these models increases and their implementation demands more signal processing resources as the signal bandwidth gets wider or the number of carrier aggregation. A completely different approach uses deep convolutional neural network to learn from the training data to figure out the nonlinear distortion. In this work, a low complexity, general architecture based on the deep real-valued convolutional neural network (DRVCNN) is proposed to build the nonlinear behavior of the power amplifier. With each of the multiple inputs equivalent to an input vector, the DRVCNN tensor weights are constructed from training data thanks to the current and historical envelope-dependent terms, I, and Q, which are components of the input. The effectiveness of the general framework in modeling single-carrier and multi-carrier power amplifiers is verified.

eess.SP↗

arXiv2020

Location-Enabled IoT (LE-IoT): A Survey of Positioning Techniques, Error Sources, and Mitigation

The Internet of Things (IoT) has started to empower the future of many industrial and mass-market applications. Localization techniques are becoming key to add location context to IoT data without human perception and intervention. Meanwhile, the newly-emerged Low-Power Wide-Area Network (LPWAN) technologies have advantages such as long-range, low power consumption, low cost, massive connections, and the capability for communication in both indoor and outdoor areas. These features make LPWAN signals strong candidates for mass-market localization applications. However, there are various error sources that have limited localization performance by using such IoT signals. This paper reviews the IoT localization system through the following sequence: IoT localization system review -- localization data sources -- localization algorithms -- localization error sources and mitigation -- localization performance evaluation. Compared to the related surveys, this paper has a more comprehensive and state-of-the-art review on IoT localization methods, an original review on IoT localization error sources and mitigation, an original review on IoT localization performance evaluation, and a more comprehensive review of IoT localization applications, opportunities, and challenges. Thus, this survey provides comprehensive guidance for peers who are interested in enabling localization ability in the existing IoT systems, using IoT systems for localization, or integrating IoT signals with the existing localization sensors.

cs.NI↗

arXiv2015

Global existence and steady states of a two competing species Keller-Segel chemotaxis model

We study an one{dimensional quasilinear system proposed by J. Tello and M. Winkler [19] which models the population dynamics of two competing species attracted by the same chemical. The kinetics terms of the interacting species are chosen to be the Lotka{Volterra type. We prove the existence of global bounded and classical solutions for all chemoattraction rates. Under homogeneous Neumann boundary conditions, we establish the existence of nonconstant steady states by local bifurcation theory. The stability of the bifurcating solutions is also obtained when the diffusivity of both species is large. Finally, we perform extensive numerical studies to demonstrate the formation of stable positive steady states with various interesting spatial structures.

math.AP↗