arXiv subjects

Stephen Jarvis

Publications and source records attributed to Stephen Jarvis.

6 recordsLinked to original sources

arXiv2020

Graph Hierarchy: A novel approach to understanding hierarchical structures in complex networks

Trophic coherence, a measure of a graph's hierarchical organisation, has been shown to be linked to a graph's structural and dynamical aspects such as cyclicity, stability and normality. Trophic levels of vertices can reveal their functional properties and partition and rank the vertices accordingly. Yet trophic levels and hence trophic coherence can only be defined on graphs with basal vertices, vertices with zero in-degree. Consequently, trophic analysis of graphs had been restricted until now. In this paper we introduce a novel framework, a generalisation of trophic levels, which we call hierarchical levels, that can be defined on any simple graph. Within this general framework, we develop additional metrics named influence centrality, a measure of a vertices ability to influence dynamics, and democracy coefficient, a measure of overall feedback in the system, both of which have implications for the controllability of complex systems. We discuss how our generalisation relates to previous attempts and what new insights are illuminated on the topological and dynamical aspects of graphs. Finally, we show how the hierarchical structure of a network relates to the incidence rate in a SIS epidemic model.

physics.soc-ph↗

arXiv2020

kD-STR: A Method for Spatio-Temporal Data Reduction and Modelling

Analysing and learning from spatio-temporal datasets is an important process in many domains, including transportation, healthcare and meteorology. In particular, data collected by sensors in the environment allows us to understand and model the processes acting within the environment. Recently, the volume of spatio-temporal data collected has increased significantly, presenting several challenges for data scientists. Methods are therefore needed to reduce the quantity of data that needs to be processed in order to analyse and learn from spatio-temporal datasets. In this paper, we present the k-Dimensional Spatio-Temporal Reduction method (kD-STR) for reducing the quantity of data used to store a dataset whilst enabling multiple types of analysis on the reduced dataset. kD-STR uses hierarchical partitioning to find spatio-temporal regions of similar instances and models the instances within each region to summarise the dataset. We demonstrate the generality of kD-STR with 3 datasets exhibiting different spatio-temporal characteristics and present results for a range of data modelling techniques. Finally, we compare kD-STR with other techniques for reducing the volume of spatio-temporal data. Our results demonstrate that kD-STR is effective in reducing spatio-temporal data and generalises to datasets that exhibit different properties.

cs.DB↗

arXiv2019

SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overhead

Federated learning (FL) has attracted increasing attention as a promising approach to driving a vast number of end devices with artificial intelligence. However, it is very challenging to guarantee the efficiency of FL considering the unreliable nature of end devices while the cost of device-server communication cannot be neglected. In this paper, we propose SAFA, a semi-asynchronous FL protocol, to address the problems in federated learning such as low round efficiency and poor convergence rate in extreme conditions (e.g., clients dropping offline frequently). We introduce novel designs in the steps of model distribution, client selection and global aggregation to mitigate the impacts of stragglers, crashes and model staleness in order to boost efficiency and improve the quality of the global model. We have conducted extensive experiments with typical machine learning tasks. The results demonstrate that the proposed protocol is effective in terms of shortening federated round duration, reducing local resource wastage, and improving the accuracy of the global model at an acceptable communication cost.

cs.DC↗

arXiv2019

Developing an Unsupervised Real-time Anomaly Detection Scheme for Time Series with Multi-seasonality

On-line detection of anomalies in time series is a key technique used in various event-sensitive scenarios such as robotic system monitoring, smart sensor networks and data center security. However, the increasing diversity of data sources and the variety of demands make this task more challenging than ever. Firstly, the rapid increase in unlabeled data means supervised learning is becoming less suitable in many cases. Secondly, a large portion of time series data have complex seasonality features. Thirdly, on-line anomaly detection needs to be fast and reliable. In light of this, we have developed a prediction-driven, unsupervised anomaly detection scheme, which adopts a backbone model combining the decomposition and the inference of time series data. Further, we propose a novel metric, Local Trend Inconsistency (LTI), and an efficient detection algorithm that computes LTI in a real-time manner and scores each data point robustly in terms of its probability of being anomalous. We have conducted extensive experimentation to evaluate our algorithm with several datasets from both public repositories and production environments. The experimental results show that our scheme outperforms existing representative anomaly detection algorithms in terms of the commonly used metric, Area Under Curve (AUC), while achieving the desired efficiency.

cs.LG↗

arXiv2018

Resilience or Robustness: Identifying Topological Vulnerabilities in Rail Networks

Many critical infrastructure systems have network structure and are under stress. Despite their national importance, the complexity of large-scale transport networks means we do not fully understand their vulnerabilities to cascade failures. The research in this paper examines the interdependent rail networks in Greater London and surrounding commuter area. We focus on the morning commuter hours, where the system is under the most demand stress. There is increasing evidence that the topological shape of the network plays an important role in dynamic cascades. Here, we examine whether the different topological measures of resilience (stability) or robustness (failure) are more appropriate for understanding poor railway performance. The results show that resilience and not robustness has a strong correlation to the consumer experience statistics. Our results are a way of describing the complexity of cascade dynamics on networks without the involvement of detailed agent-based-models, showing that cascade effects are more responsible for poor performance than failures. The network science analysis hints at pathways towards making the network structure more resilient by reducing feedback loops.

physics.soc-ph↗

arXiv2018

Community Structures, Interactions and Dynamics in London's Bicycle Sharing Network

Bikesharing schemes are transportation systems that not only provide an efficient mode of transportation in congested urban areas, but also improve last-mile connectivity with public transportation and local accessibility. Bikesharing schemes around the globe generate detailed trip data sets with spatial and temporal dimensions, which, with proper mining and analysis, reveal valuable information on urban mobility patterns. In this paper, we study the London bicycle sharing dataset to explore community structures. Using a novel clustering technique, we derive distinctive behavioural patterns and assess community interactions and spatio-temporal dynamics. The analyses reveal self-contained, interconnected and hybrid clusters that mimic London's physical structure. Exploring changes over time, we find geographically isolated and specialized communities to be relatively consistent, while the remaining system exhibits volatility, especially during and around peak commuting times. By increasing our understanding of the collective behaviour of the bikesharing users, this analysis supports policy appraisal, operational decision-making and motivates improvements in infrastructure design and management.

cs.SI↗