SearcharxivSearch

arXiv subjects

Lucas Poßner

Publications and source records attributed to Lucas Poßner.

2 recordsLinked to original sources

Sensitivity analysis of image classification models using generalized polynomial chaos

Integrating advanced communication protocols in production has accelerated the adoption of data-driven predictive quality methods, notably machine learning (ML) models. However, ML models in image classification often face significant uncertainties arising from model, data, and domain shifts. These uncertainties lead to overconfidence in the classification model's output. To better understand these models, sensitivity analysis can help to analyze the relative influence of input parameters on the output. This work investigates the sensitivity of image classification models used for predictive quality. We propose modeling the distributional domain shifts of inputs with random variables and quantifying their impact on the model's outputs using Sobol indices computed via generalized polynomial chaos (GPC). This approach is validated through a case study involving a welding defect classification problem, utilizing a fine-tuned ResNet18 model and an emblem classification model used in BMW Group production facilities.

cs.LG

Comparison of the performance and reliability between improved sampling strategies for polynomial chaos expansion

As uncertainty and sensitivity analysis of complex models grows ever more important, the difficulty of their timely realizations highlights a need for more efficient numerical operations. Non-intrusive Polynomial Chaos methods are highly efficient and accurate methods of mapping input-output relationships to investigate complex models. There is substantial potential to increase the efficacy of the method regarding the selected sampling scheme. We examine state-of-the-art sampling schemes categorized in space-filling-optimal designs such as Latin Hypercube sampling and L1-optimal sampling and compare their empirical performance against standard random sampling. The analysis was performed in the context of L1 minimization using the least-angle regression algorithm to fit the GPCE regression models. Due to the random nature of the sampling schemes, we compared different sampling approaches using statistical stability measures and evaluated the success rates to construct a surrogate model with relative errors of $<0.1$\%, $<1$\%, and $<10$\%, respectively. The sampling schemes are thoroughly investigated by evaluating the y of surrogate models constructed for various distinct test cases, which represent different problem classes covering low, medium and high dimensional problems. Finally, the sampling schemes are tested on an application example to estimate the sensitivity of the self-impedance of a probe that is used to measure the impedance of biological tissues at different frequencies. We observed strong differences in the convergence properties of the methods between the analyzed test functions.

math.NA