SearcharxivSearch

arXiv subjects

Lorenzo Zambon

Publications and source records attributed to Lorenzo Zambon.

6 recordsLinked to original sources

Nonlinear Probabilistic Forecast Reconciliation

Forecast reconciliation adjusts independently generated forecasts across multiple time series so that they satisfy some known constraints. While probabilistic forecast reconciliation is well established for linear constraints, some practical forecasting problems involve nonlinear relationships among time series. In this paper, we address probabilistic forecast reconciliation with nonlinear constraints for the first time. We extend both reconciliation via projection and conditioning to the case of nonlinear constraints. The former approach reconciles forecast samples by mapping them onto the nonlinear coherent manifold. The latter approach conditions the joint forecast distribution on the constraints; the reconciled distribution is approximated with an algorithm based on the Unscented Kalman Filter (UKF). We evaluate both methods on synthetic and real datasets. Empirically, both reconciliation approaches generally improve forecast accuracy. The UKF-based approach achieves the best overall performance, is consistently retained in the Model Confidence Set -- either alone or alongside other reconciliation methods -- and is substantially faster than the projection-based approach.

stat.ME

Modeling uncertainty in the covariance matrix for probabilistic forecast reconciliation

In minimum trace (MinT) forecast reconciliation, the covariance matrix of the base forecast errors plays a crucial role. Typically, this matrix is estimated and then treated as known. This can lead to an underestimation of the variance of the predictive distribution. To address the problem, we propose a Bayesian reconciliation model that accounts for uncertainty in the estimation of the covariance matrix. By adopting an Inverse-Wishart prior and assuming Gaussian residuals, the reconciled predictive distribution follows a multivariate t-distribution, obtained in closed form, rather than a multivariate Gaussian distribution. We evaluate our method on three tourism-related datasets, including a new publicly available dataset. Empirical results show that our approach consistently improves prediction intervals compared to MinT reconciliation.

stat.ME

End-to-end probabilistic hierarchical forecasting of large hierarchies via probabilistic top-down

Retail and supply chain operations rely on demand forecasts to drive decisions, from replenishment at the product level to capacity planning at the store level. These forecasts should be probabilistic, to allow risk-aware decisions, and coherent across the aggregation hierarchy, so that decisions taken at different levels are not based on conflicting demand forecasts. Producing such forecasts is computationally demanding; at retail scale, with hierarchies of hundreds of thousands of time series, this cost becomes a primary concern. Existing two-step forecast-then-reconcile procedures and end-to-end neural models scale poorly, rely on restrictive assumptions, or require specialized hardware and engineering effort. We propose e2eTD, a scalable method for coherent probabilistic forecasting of large hierarchical and grouped time series. e2eTD directly forecasts only a small subset of aggregate series (about 0.3\% of the hierarchy in our experiments), which are smoother and thus more predictable than the intermittent bottom series. The resulting forecast samples are propagated to the bottom level through a novel probabilistic top-down sampling algorithm, in which the historical disaggregation proportions are modeled as joint distributions, estimated in-sample. Since the bottom samples retain the cross-series dependence, summing them yields coherent forecasts for all aggregation levels. On the M5 and Favorita datasets, e2eTD achieves the lowest weighted scaled pinball loss across aggregation levels among all competing methods; it would have ranked 11th of 892 teams in the M5 Uncertainty competition. On a standard laptop, e2eTD runs in about five minutes on M5 ($\sim$40K series) and twenty minutes on Favorita ($\sim$300K series).

stat.ME

Model selection with proper scoring rules on data sets of time series: prefer the mean scaled score

We study the problem of model selection among probabilistic forecasting models evaluated on datasets of multiple time series. The performance of a model on a single time series is quantified by the average value (score) of a proper scoring rule over a test set, but extending model selection to data sets of time series requires aggregating these scores. Common approaches either rely on scaling scores and averaging them (mean scaled score) or avoid scaling by using alternative statistics such as mean ranks or win rates. However, these approaches can yield conflicting conclusions. We show that such discrepancies arise from the skewness of the distribution of the scores, which is particularly pronounced when test sets are short. The skewness can cause non-mean criteria (e.g., mean rank, median, win rate) to select misspecified models. In contrast, the mean score is immune from this problem. We further show that, as the size of the test sets increases, all aggregation criteria converge to the same model selection decision, mitigating these discrepancies. Our experiments on intermittent demand time series, including data from the M5 competition, highlight the importance of sufficiently large test sets; the mean scaled score appears to be the more reliable approach, also because empirically we found its decision to remain consistent when different scaling factors are adopted.

stat.ML

Properties of the reconciled distributions for Gaussian and count forecasts

Reconciliation enforces coherence between hierarchical forecasts, in order to satisfy a set of linear constraints. While most works focus on the reconciliation of the point forecasts, we consider probabilistic reconciliation and we analyze the properties of the distributions reconciled via conditioning. We provide a formal analysis of the variance of the reconciled distribution, treating separately the case of Gaussian forecasts and count forecasts. We also study the reconciled upper mean in the case of 1-level hierarchies; also in this case we analyze separately the case of Gaussian forecasts and count forecasts. We then show experiments on the reconciliation of intermittent time series related to the count of extreme market events. The experiments confirm our theoretical results and show that reconciliation largely improves the performance of probabilistic forecasting.

stat.AP

Efficient probabilistic reconciliation of forecasts for real-valued and count time series

Hierarchical time series are common in several applied fields. The forecasts for these time series are required to be coherent, that is, to satisfy the constraints given by the hierarchy. The most popular technique to enforce coherence is called reconciliation, which adjusts the base forecasts computed for each time series. However, recent works on probabilistic reconciliation present several limitations. In this paper, we propose a new approach based on conditioning to reconcile any type of forecast distribution. We then introduce a new algorithm, called Bottom-Up Importance Sampling, to efficiently sample from the reconciled distribution. It can be used for any base forecast distribution: discrete, continuous, or in the form of samples, providing a major speedup compared to the current methods. Experiments on several temporal hierarchies show a significant improvement over base probabilistic forecasts.

stat.ML