arXiv subjects

Abhinav Das

Publications and source records attributed to Abhinav Das.

7 recordsLinked to original sources

arXiv2026

A Low-Cost IoT Device for Environmental Monitoring and Embedded Solar Forecasting with On-Device Incremental Learning

Hyperlocal meteorological sensing is essential for accurate solar photovoltaic forecasting, yet professional-grade meteorological stations require investments easily exceeding 1000~USD per node, making distributed deployments economically inaccessible. This work presents a modular internet of things (IoT) device based on the ESP32 microcontroller integrating temperature, humidity, luminosity, and solar irradiance sensors in an IP68-rated enclosure at a total hardware costs of about \$65~USD when components are sourced in Germany. A hybrid architecture decouples external model training, performed on a conventional computer using the software Python and the open-source library TensorFlow, from autonomous 24-hour solar voltage forecasting executed on-device via a three-layer feedforward network with 3{,}011 parameters (11.8\,KB). The network is trained offline on site-collected data and deployed on the microcontroller as static weight matrices without cloud connectivity. An on-device incremental gradient descent mechanism enables continuous model adaptation after deployment without external retraining. The system was evaluated through two field deployments: a short period of hardware and firmware validation in Ulm, Germany, and a 115-day deployment in Zapopan, Mexico, comprising 84~days of training and 31~days of autonomous operation with zero missing records. Over a clean 28-day daytime window, the embedded model attained a coefficient of determination of 0.9165 and a mean absolute error of 0.2975~V (4.65\% of the operational range), outperforming a climatology baseline (skill score 0.64) while not surpassing a 24-hour persistence baseline. A frozen-weight ablation confirms that the on-device update mechanism yields a small but statistically robust accuracy gain ($p = 0.001$), demonstrating that autonomous incremental learning is feasible on low-cost hardware without cloud connectivity.

eess.SP↗

arXiv2025

Bayesian Neural Networks with Monte Carlo Dropout for Probabilistic Electricity Price Forecasting

Accurate electricity price forecasting is critical for strategic decision-making in deregulated electricity markets, where volatility stems from complex supply-demand dynamics and external factors. Traditional point forecasts often fail to capture inherent uncertainties, limiting their utility for risk management. This work presents a framework for probabilistic electricity price forecasting using Bayesian neural networks (BNNs) with Monte Carlo (MC) dropout, training separate models for each hour of the day to capture diurnal patterns. A critical assessment and comparison with the benchmark model, namely: generalized autoregressive conditional heteroskedasticity with exogenous variable (GARCHX) model and the LASSO estimated auto-regressive model (LEAR), highlights that the proposed model outperforms the benchmark models in terms of point prediction and intervals. This work serves as a reference for leveraging probabilistic neural models in energy market predictions.

cs.LG↗

arXiv2025

Analyzing Uncertainty Quantification in Statistical and Deep Learning Models for Probabilistic Electricity Price Forecasting

Precise probabilistic forecasts are fundamental for energy risk management, and there is a wide range of both statistical and machine learning models for this purpose. Inherent to these probabilistic models is some form of uncertainty quantification. However, most models do not capture the full extent of uncertainty, which arises not only from the data itself but also from model and distributional choices. In this study, we examine uncertainty quantification in state-of-the-art statistical and deep learning probabilistic forecasting models for electricity price forecasting in the German market. In particular, we consider deep distributional neural networks (DDNNs) and augment them with an ensemble approach, Monte Carlo (MC) dropout, and conformal prediction to account for model uncertainty. Additionally, we consider the LASSO-estimated autoregressive (LEAR) approach combined with quantile regression averaging (QRA), generalized autoregressive conditional heteroskedasticity (GARCH), and conformal prediction. Across a range of performance metrics, we find that the LEAR-based models perform well in terms of probabilistic forecasting, irrespective of the uncertainty quantification method. Furthermore, we find that DDNNs benefit from incorporating both data and model uncertainty, improving both point and probabilistic forecasting. Uncertainty itself appears to be best captured by the models using conformal prediction. Overall, our extensive study shows that all models under consideration perform competitively. However, their relative performance depends on the choice of metrics for point and probabilistic forecasting.

cs.LG↗

arXiv2025

Regime-Aware Conditional Neural Processes with Multi-Criteria Decision Support for Operational Electricity Price Forecasting

This work integrates Bayesian regime detection with conditional neural processes for 24-hour electricity price prediction in the German market. Our methodology integrates regime detection using a disentangled sticky hierarchical Dirichlet process hidden Markov model (DS-HDP-HMM) applied to daily electricity prices. Each identified regime is subsequently modeled by an independent conditional neural process (CNP), trained to learn localized mappings from input contexts to 24-dimensional hourly price trajectories, with final predictions computed as regime-weighted mixtures of these CNP outputs. We rigorously evaluate R-NP against deep neural networks (DNN) and Lasso estimated auto-regressive (LEAR) models by integrating their forecasts into diverse battery storage optimization frameworks, including price arbitrage, risk management, grid services, and cost minimization. This operational utility assessment revealed complex performance trade-offs: LEAR often yielded superior absolute profits or lower costs, while DNN showed exceptional optimality in specific cost-minimization contexts. Recognizing that raw prediction accuracy doesn't always translate to optimal operational outcomes, we employed TOPSIS as a comprehensive multi-criteria evaluation layer. Our TOPSIS analysis identified LEAR as the top-ranked model for 2021, but crucially, our proposed R-NP model emerged as the most balanced and preferred solution for 2021, 2022 and 2023.

cs.LG↗

arXiv2024

Electricity Price Prediction Using Multi-Kernel Gaussian Process Regression Combined with Kernel-Based Support Vector Regression

This paper presents a new hybrid model for predicting German electricity prices. The algorithm is based on a combination of Gaussian Process Regression (GPR) and Support Vector Regression (SVR). Although GPR is a competent model for learning stochastic patterns within data and for interpolation, its performance for out-of-sample data is not very promising. By choosing a suitable data-dependent covariance function, we can enhance the performance of GPR for the German hourly power prices being tested. However, since the out-of-sample prediction is dependent on the training data, the prediction is vulnerable to noise and outliers. To overcome this issue, a separate prediction is calculated using SVR, which applies margin-based optimization. This method is advantageous when dealing with non-linear processes and outliers, since only certain necessary points (support vectors) in the training data are responsible for regression. The individual predictions are then linearly combined using uniform weights. When tested on historic German power prices, this approach outperforms the publicly available benchmarks, namely the LASSO estimated autoregressive regression model, deep neural network provided in the recent research by [1].

cs.LG↗

arXiv2024

Optimal Control of a Battery Storage On the Energy Market

Electricity storage is crucial for a successful transition towards carbon-neutral energy production. Despite considerable research and a number of promising future alternatives such as hydrogen, battery storages currently remain the first choice. However, costs remain high and it remains to be shown whether an investment can be profitable. This article addresses this question by modelling a battery storage operating in the German power market. We consider two periods with very distinct price dynamics, namely a calm year (2020) and a turbulent year (2023). It shows that even for low battery costs a 2020 style price environment does not allow for profitable battery operation, whereas current market conditions allow for positive payoffs.

math.OC↗

arXiv2021

Extrapolation of Stationary Random Fields Via Level Sets

In this paper, we use the concept of excursion sets for the extrapolation of stationary random fields. Doing so, we define excursion sets for the field and its linear predictor, and then minimize the expected volume of the symmetric difference of these sets under the condition that the univariate distributions of the predictor and of the field itself coincide. We illustrate the new approach on Gaussian random fields.

math.PR↗