arXiv · 2611.13869
Outliers and the Hard-Margin Linear SVM in High-Dimension, Low-Sample-Size Settings
Abstract
We study how outliers affect the hard-margin linear support vector machine when the dimension grows while the sample sizes remain fixed. For one-sided contamination, the centered Gram matrix converges to a constant inlier block plus an outlier-diagonal component, and the limiting dual problem has a closed-form solution. All outliers act through one effective distance. This representation yields explicit thresholds for loss of inlier support, margin shrinkage. intercept displacement, and asymptotic misclassification. We then treat contamination in both classes. The limiting intercept is the multiplier of the class-balance constraint, and the two classes pull it in opposite directions. Consequently, at most one class can collapse or be asymptotically misclassified, whereas symmetric contamination leaves the limiting discriminant function unchanged even though the margin shrinks. Seven numerical experiments verify the dual allocation, phase transitions, and discriminant limits.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Yugo Nakayama. 2026-11-10. Outliers and the Hard-Margin Linear SVM in High-Dimension, Low-Sample-Size Settings. https://searcharxiv.com/abs/2611.13869
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.