arXiv subjects

Anders Løland

Publications and source records attributed to Anders Løland.

11 recordsLinked to original sources

arXiv2025

AI/ML for 5G and Beyond Cybersecurity

The advancements in communication technology (5G and beyond) and global connectivity Internet of Things (IoT) also come with new security problems that will need to be addressed in the next few years. The threats and vulnerabilities introduced by AI/ML based 5G and beyond IoT systems need to be investigated to avoid the amplification of attack vectors on AI/ML. AI/ML techniques are playing a vital role in numerous applications of cybersecurity. Despite the ongoing success, there are significant challenges in ensuring the trustworthiness of AI/ML systems. However, further research is needed to define what is considered an AI/ML threat and how it differs from threats to traditional systems, as currently there is no common understanding of what constitutes an attack on AI/ML based systems, nor how it might be created, hosted and propagated [ETSI, 2020]. Therefore, there is a need for studying the AI/ML approach to ensure safe and secure development, deployment, and operation of AI/ML based 5G and beyond IoT systems. For 5G and beyond, it is essential to continuously monitor and analyze any changing environment in real-time to identify and reduce intentional and unintentional risks. In this study, we will review the role of the AI/ML technique for 5G and beyond security. Furthermore, we will provide our perspective for predicting and mitigating 5G and beyond security using AI/ML techniques.

cs.CR↗

arXiv2024

MCCE: Monte Carlo sampling of realistic counterfactual explanations

We introduce MCCE: Monte Carlo sampling of valid and realistic Counterfactual Explanations for tabular data, a novel counterfactual explanation method that generates on-manifold, actionable and valid counterfactuals by modeling the joint distribution of the mutable features given the immutable features and the decision. Unlike other on-manifold methods that tend to rely on variational autoencoders and have strict prediction model and data requirements, MCCE handles any type of prediction model and categorical features with more than two levels. MCCE first models the joint distribution of the features and the decision with an autoregressive generative model where the conditionals are estimated using decision trees. Then, it samples a large set of observations from this model, and finally, it removes the samples that do not obey certain criteria. We compare MCCE with a range of state-of-the-art on-manifold counterfactual methods using four well-known data sets and show that MCCE outperforms these methods on all common performance metrics and speed. In particular, including the decision in the modeling process improves the efficiency of the method substantially.

stat.ML↗

arXiv2022

Some recent trends in embeddings of time series and dynamic networks

We give a review of some recent developments in embeddings of time series and dynamic networks. We start out with traditional principal components and then look at extensions to dynamic factor models for time series. Unlike principal components for time series, the literature on time-varying nonlinear embedding is rather sparse. The most promising approaches in the literature is neural network based, and has recently performed well in forecasting competitions. We also touch upon different forms of dynamics in topological data analysis. The last part of the paper deals with embedding of dynamic networks where we believe there is a gap between available theory and the behavior of most real world networks. We illustrate our review with two simulated examples. Throughout the review, we highlight differences between the static and dynamic case, and point to several open problems in the dynamic case.

stat.ME↗

arXiv2022

Statistical embedding: Beyond principal components

There has been an intense recent activity in embedding of very high dimensional and nonlinear data structures, much of it in the data science and machine learning literature. We survey this activity in four parts. In the first part we cover nonlinear methods such as principal curves, multidimensional scaling, local linear methods, ISOMAP, graph based methods and diffusion mapping, kernel based methods and random projections. The second part is concerned with topological embedding methods, in particular mapping topological properties into persistence diagrams and the Mapper algorithm. Another type of data sets with a tremendous growth is very high-dimensional network data. The task considered in part three is how to embed such data in a vector space of moderate dimension to make the data amenable to traditional techniques such as cluster and classification techniques. Arguably this is the part where the contrast between algorithmic machine learning methods and statistical modeling, the so-called stochastic block modeling, is at its greatest. In the paper, we discuss the pros and cons for the two approaches. The final part of the survey deals with embedding in $\mathbb{R}^ 2$, i.e. visualization. Three methods are presented: $t$-SNE, UMAP and LargeVis based on methods in parts one, two and three, respectively. The methods are illustrated and compared on two simulated data sets; one consisting of a triplet of noisy Ranunculoid curves, and one consisting of networks of increasing complexity generated with stochastic block models and with two types of nodes.

stat.ML↗

arXiv2021

Explaining predictive models using Shapley values and non-parametric vine copulas

The original development of Shapley values for prediction explanation relied on the assumption that the features being described were independent. If the features in reality are dependent this may lead to incorrect explanations. Hence, there have recently been attempts of appropriately modelling/estimating the dependence between the features. Although the proposed methods clearly outperform the traditional approach assuming independence, they have their weaknesses. In this paper we propose two new approaches for modelling the dependence between the features. Both approaches are based on vine copulas, which are flexible tools for modelling multivariate non-Gaussian distributions able to characterise a wide range of complex dependencies. The performance of the proposed methods is evaluated on simulated data sets and a real data set. The experiments demonstrate that the vine copula approaches give more accurate approximations to the true Shapley values than its competitors.

stat.ME↗

arXiv2020

Explaining individual predictions when features are dependent: More accurate approximations to Shapley values

Explaining complex or seemingly simple machine learning models is an important practical problem. We want to explain individual predictions from a complex machine learning model by learning simple, interpretable explanations. Shapley values is a game theoretic concept that can be used for this purpose. The Shapley value framework has a series of desirable theoretical properties, and can in principle handle any predictive model. Kernel SHAP is a computationally efficient approximation to Shapley values in higher dimensions. Like several other existing methods, this approach assumes that the features are independent, which may give very wrong explanations. This is the case even if a simple linear model is used for predictions. In this paper, we extend the Kernel SHAP method to handle dependent features. We provide several examples of linear and non-linear models with various degrees of feature dependence, where our method gives more accurate approximations to the true Shapley values. We also propose a method for aggregating individual Shapley values, such that the prediction can be explained by groups of dependent variables.

stat.ML↗

arXiv2019

Probabilistic Forecasting of Temporal Trajectories of Regional Power Production - Part 1: Wind

Renewable energy sources provide a constantly increasing contribution to the total energy production worldwide. However, the power generation from these sources is highly variable due to their dependence on meteorological conditions. Accurate forecasts for the production at various temporal and spatial scales are thus needed for an efficiently operating electricity market. In this article - part 1 - we propose fully probabilistic prediction models for spatially aggregated wind power production at an hourly time scale with lead times up to several days using weather forecasts from numerical weather prediction systems as covariates. After an appropriate cubic transformation of the power production, we build up a multivariate Gaussian prediction model under a Bayesian inference framework which incorporates the temporal error correlation. In an application to predict wind production in Germany, the method provides calibrated and skillful forecasts. Comparison is made between several formulations of the correlation structure.

stat.AP↗

arXiv2019

Probabilistic Forecasting of Temporal Trajectories of Regional Power Production - Part 2: Photovoltaic Solar

We propose a fully probabilistic prediction model for spatially aggregated solar photovoltaic (PV) power production at an hourly time scale with lead times up to several days using weather forecasts from numerical weather prediction systems as covariates. After an appropriate logarithmic transformation of the power production, we develop a multivariate Gaussian prediction model under a Bayesian inference framework. The model incorporates the temporal error correlation yielding physically consistent forecast trajectories. Several formulations of the correlation structure are proposed and investigated. Our method is one of a few approaches that issue full predictive distributions for PV power production. In a case study of PV power production in Germany, the method gives calibrated and skillful forecasts.

stat.AP↗

arXiv2018

Using published bid/ask curves to error dress spot electricity price forecasts

Accurate forecasts of electricity spot prices are essential to the daily operational and planning decisions made by power producers and distributors. Typically, point forecasts of these quantities suffice, particularly in the Nord Pool market where the large quantity of hydro power leads to price stability. However, when situations become irregular, deviations on the price scale can often be extreme and difficult to pinpoint precisely, which is a result of the highly varying marginal costs of generating facilities at the edges of the load curve. In these situations it is useful to supplant a point forecast of price with a distributional forecast, in particular one whose tails are adaptive to the current production regime. This work outlines a methodology for leveraging published bid/ask information from the Nord Pool market to construct such adaptive predictive distributions. Our methodology is a non-standard application of the concept of error-dressing, which couples a feature driven error distribution in volume space with a non-linear transformation via the published bid/ask curves to obtain highly non-symmetric, adaptive price distributions. Using data from the Nord Pool market, we show that our method outperforms more standard forms of distributional modeling. We further show how such distributions can be used to render `warning systems' that issue reliable probabilities of prices exceeding various important thresholds.

q-fin.ST↗

arXiv2014

Coping with area price risk in electricity markets: Forecasting Contracts for Difference in the Nordic power market

Contracts for Difference (CfDs) are forwards on the spread between an area price and the system price. Together with the system price forwards, these products are used to hedge the area price risk in the Nordic electricity market. The CfDs are typically available for the next two months, three quarters and three years. This is fine, except that CfDs are not traded at NASDAQ OMX Commodities for every Nord Pool Spot price area. We therefore ask the hypothetical question: What would the CfD market price have been, say in the price area NO2, if it had been traded? We build regression models for each observable price area, and use Bayesian elicitation techniques to obtain prior information on how similar the different price areas are to forecast the price in an area where CfDs are not traded.

stat.AP↗

arXiv2011

Causal modeling and inference for electricity markets

How does dynamic price information flow among Northern European electricity spot prices and prices of major electricity generation fuel sources? We use time series models combined with new advances in causal inference to answer these questions. Applying our methods to weekly Nordic and German electricity prices, and oil, gas and coal prices, with German wind power and Nordic water reservoir levels as exogenous variables, we estimate a causal model for the price dynamics, both for contemporaneous and lagged relationships. In contemporaneous time, Nordic and German electricity prices are interlinked through gas prices. In the long run, electricity prices and British gas prices adjust themselves to establish the equlibrium price level, since oil, coal, continental gas and EUR/USD are found to be weakly exogenous.

stat.AP↗