SearcharxivSearch

arXiv subjects

Víctor Parada

Publications and source records attributed to Víctor Parada.

2 recordsLinked to original sources

Adaptive Automatic Model Selection for Demand Forecasting under Heterogeneous Demand Patterns

Demand forecasting is critical for inventory planning, procurement, replenishment, production, and capacity decisions in heterogeneous supply chains. However, selecting the most appropriate model for each demand series remains challenging because performance varies across datasets, demand structures, horizons, and evaluation metrics. This study proposes the Adaptive Hybrid Selector (AHS), an automatic model-selection rule that combines observed predictive performance with structural demand information. AHS uses demand frequency and series variability to activate a hierarchical logic based on RMSSE, MAE, sMAPE, and BIAS. The proposed selector is compared with Overall Weighted Average (OWA), a benchmark-relative criterion based on sMAPE and MASE, and Equilibrium Ranking Aggregation (ERA), a comparator based on MAE, RMSE, and R^2 rankings. The empirical evaluation uses the Walmart, M3, M4, and M5 datasets, three training-testing partitions, 22 forecasting models, and horizons of up to 12 cycles. Selector performance is assessed ex post using Global Relative Accuracy (GRA), interpreted as an indicator of volumetric coherence between accumulated forecasted demand and observed demand. Results show that AHS provides the most robust overall behavior, especially in M5, while OWA remains competitive in more regular datasets. ERA shows lower volumetric coherence in most configurations. These findings suggest that automatic model selection should account for demand structure and be evaluated using ex post indicators of volumetric coherence.

cs.LG

Hierarchical Evaluation Function: A Multi-Metric Approach for Optimizing Demand Forecasting Models

Demand forecasting in competitive, uncertain business environments requires models that can integrate multiple evaluation perspectives rather than being restricted to hyperparameter optimization based on a single metric. This traditional approach tends to prioritize one error indicator, which can bias results when metrics provide contradictory signals. In this context, the Hierarchical Evaluation Function (HEF) is proposed as a multi-metric framework for hyperparameter optimization that integrates explanatory power (R2), sensitivity to extreme errors (RMSE), and average accuracy (MAE). The performance of HEF was assessed using four widely recognized benchmark datasets in the forecasting domain: Walmart, M3, M4, and M5. Prediction models were optimized through Grid Search, Particle Swarm Optimization (PSO), and Optuna, and statistical analyses based on difference-of-proportions tests confirmed that HEF delivers superior results compared to a unimetric reference function, regardless of the optimizer employed, with particular relevance for heterogeneous monthly time series (M3) and highly granular daily demand scenarios (M5). The findings demonstrate that HEF improves stability, generalization, and robustness at low computational cost, consolidating its role as a reliable evaluation framework that enhances model selection, enables more accurate demand forecasts, and supports decision-making in dynamic, competitive business environments.

cs.LG