arXiv subjects

Kaisa Joki

Publications and source records attributed to Kaisa Joki.

3 recordsLinked to original sources

arXiv2026

Inexact Limited Memory Bundle Method

Large-scale nonsmooth optimization problems arise in many real-world applications, but obtaining exact function and subgradient values for these problems may be computationally expensive or even infeasible. In many practical settings, only inexact information is available due to measurement or modeling errors, privacy-preserving computations, or stochastic approximations, making inexact optimization methods particularly relevant. In this paper, we propose a novel inexact limited memory bundle method for large-scale nonsmooth nonconvex optimization. The method tolerates noise in both function values and subgradients. We prove the global convergence of the proposed method to an approximate stationary point. Numerical experiments with different levels of noise in function and/or subgradient values show that the method performs well with both exact and noisy data. In particular, the results demonstrate competitiveness in large-scale nonsmooth optimization and highlight the suitability of the method for applications where noise is unavoidable, such as differential privacy in machine learning.

math.OC↗

arXiv2025

Clust-Splitter - an Efficient Nonsmooth Optimization-Based Algorithm for Clustering Large Datasets

Clustering is a fundamental task in data mining and machine learning, particularly for analyzing large-scale data. In this paper, we introduce Clust-Splitter, an efficient algorithm based on nonsmooth optimization, designed to solve the minimum sum-of-squares clustering problem in very large datasets. The clustering task is approached through a sequence of three nonsmooth optimization problems: two auxiliary problems used to generate suitable starting points, followed by a main clustering formulation. To solve these problems effectively, the limited memory bundle method is combined with an incremental approach to develop the Clust-Splitter algorithm. We evaluate Clust-Splitter on real-world datasets characterized by both a large number of attributes and a large number of data points and compare its performance with several state-of-the-art large-scale clustering algorithms. Experimental results demonstrate the efficiency of the proposed method for clustering very large datasets, as well as the high quality of its solutions, which are on par with those of the best existing methods.

cs.LG↗

arXiv2025

A truncated epsilon-subdifferential method for global DC optimization

We consider the difference of convex (DC) optimization problem subject to box constraints. Utilizing epsilon-subdifferentials of DC components of the objective, we develop a new method for finding global solutions to this problem. The method combines a local search approach with a special procedure for escaping non-global solutions by identifying improved initial points for a local search. The method terminates when the solution cannot be improved further. The escaping procedure is designed using subsets of the epsilon-subdifferentials of DC components. We compute the deviation between these subsets and determine epsilon-subgradients, providing this deviation. Using these specific epsilon-subgradients, we formulate a subproblem with a convex objective function. The solution to this subproblem serves as a starting point for a local search. We study the convergence of the conceptual version of the proposed method and discuss its implementation. A large number of academic test problems demonstrate that the method requires reasonable computational effort to find higher-quality solutions than other local DC optimization methods. Additionally, we apply the new method to find global solutions to DC optimization problems and compare its performance with two benchmark global optimization solvers.

math.OC↗