arXiv subjects

Boris Mordukhovich

Publications and source records attributed to Boris Mordukhovich.

At least 19 recordsLinked to original sources

arXiv2026

Sensitivity Analysis and Robust Optimal Control for Coupled Evolution Inclusions with State-Dependent Maximal Monotone Operators

We consider a class of strongly coupled nonsmooth systems consisting of a semilinear evolution inclusion and a differential inclusion governed by state-dependent maximal monotone operators. Our main contributions are fourfold. First, we collect the well-posedness, compactness, and Painlevé--Kuratowski continuity properties of the parameterized solution map required for the subsequent optimization analysis. Second, for Bolza-type optimization over the solution set, we prove the existence of optimal pairs, establish continuity properties of the value function, and derive upper semicontinuity of the optimal-solution map. Third, we study fixed-parameter optimal control, simultaneous control-parameter design, min--max robust control, and Hurwicz-type compromise control under parameter uncertainty, and we establish existence results for each formulation. Fourth, we report numerical experiments for sweeping-type systems that illustrate the sensitivity and robustness phenomena predicted by the theory.

math.OC↗

arXiv2025

$\ell_0$-Norm Multiobjective Optimization Models Motivated by Applications to Proton Therapy

The paper is devoted to investigating single-objective and multiobjective optimization problems involving the $\ell_0$-norm function, which is nonconvex and nondifferentiable. Our motivation comes from proton beam therapy models in cancer research. The developed approach uses subdifferential tools of variational analysis and the Gerstewitz (Tammer) scalarization function in multiobjective optimization. Based on this machinery, we propose several algorithms of the subgradient type and conduct their convergence analysis. The obtained results are illustrated by numerical examples, which reveal some characteristic features of the proposed algorithms and their interactions with the gradient descent.

math.OC↗

arXiv2025

Convergence of First-Order Algorithms with Momentum from the Perspective of an Inexact Gradient Descent Method

This paper introduces a novel inexact gradient descent method with momentum (IGDm) considered as a general framework for various first-order methods with momentum. This includes, in particular, the inexact proximal point method (IPPm), extragradient method (EGm), and sharpness-aware minimization (SAMm). Asymptotic convergence properies of IGDm are established under both global and local assumptions on objective functions with providing constructive convergence rates depending on the Polyak-Łojasiewicz-Kurdyka (PLK) conditions for the objective function. Global convergence of EGm and SAMm for general smooth functions and of IPPM for weakly convex functions is derived in this way. Moreover, local convergence properties of EGm and SAMm for locally smooth functions as well as of IPPm for prox-regular functions are established. Numerical experiments for derivative-free optimization problems are conducted to confirm the efficiency of the momentum effects of the developed methods under inexactness of gradient computations

math.OC↗

arXiv2024

Well-posedness and Stability of Discrete Approximations for Controlled Sweeping Processes with Time Delay

This paper addresses, for the first time in the literature, optimal control problems for dynamic systems governed by a novel class of sweeping processes with time delay. We establish well-posedness of such processes, in the sense of the existence and uniqueness of feasible trajectories corresponding to feasible controls under fairly unrestrictive assumptions. Then we construct a well-posed family of discrete approximations and find efficient conditions under the discretized time-delayed sweeping process exhibits stability with respect to strong convergence of feasible and optimal solutions. This creates a bridge between optimization of continuous-time and discrete-time sweeping control systems and justifies the effective use of discrete approximations in deriving optimality conditions and numerical techniques to solve the original time-delayed sweeping control problems via discrete approximations.

math.OC↗

arXiv2024

Nash Equilibrium and Minimax Theorems via Variational Tools of Convex Analysis

In this paper, we first provide a simple variational proof of the existence of Nash equilibrium in Hilbert spaces by using optimality conditions in convex minimization and Schauder's fixed-point theorem. Then applications of convex analysis and generalized differentiation are given to the existence of Nash equilibrium and extended versions of von Neumann's minimax theorem in locally convex topological vector spaces. Our analysis in this part combines generalized differential tools of convex analysis with elements of fixed point theory revolving around Kakutani's fixed-point theorem and related issues.

math.OC↗

arXiv2024

Generalized Metric Subregularity with Applications to High-Order Regularized Newton Methods

This paper pursues a twofold goal. First, we introduce and study in detail a new notion of variational analysis called generalized metric subregularity, which is a far-going extension of the conventional metric subregularity conditions. Our primary focus is on examining this concept concerning first-order and second-order stationary points. We develop an extended convergence framework that enables us to derive superlinear and quadratic convergence under the generalized metric subregularity condition, broadening the widely used KL convergence analysis framework. We present verifiable sufficient conditions to ensure the proposed generalized metric subregularity condition and provide examples demonstrating that the derived convergence rates are sharp. Second, we design a new high-order regularized Newton method with momentum steps, and apply the generalized metric subregularity to establish its superlinear convergence. Quadratic convergence is obtained under additional assumptions. Specifically, when applying the proposed method to solve the (nonconvex) over-parameterized compressed sensing model, we achieve global convergence with a quadratic local convergence rate towards a global minimizer under a strict complementarity condition.

math.OC↗

arXiv2023

Inexact proximal methods for weakly convex functions

This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal mapping of the nonsmooth term. A general framework for finding zeros of a continuous mapping is derived from our previous paper on this subject to establish convergence properties of the inexact proximal point method when the smooth term is vanished and of the inexact proximal gradient method when the smooth term satisfies a descent condition. The inexact proximal point method achieves global convergence with constructive convergence rates when the Moreau envelope of the objective function satisfies the Kurdyka-Lojasiewicz (KL) property. Meanwhile, when the smooth term is twice continuously differentiable with a Lipschitz continuous gradient and a differentiable approximation of the objective function satisfies the KL property, the inexact proximal gradient method achieves the global convergence of iterates with constructive convergence rates.

math.OC↗

arXiv2023

Generalized Relative Interiors and Generalized Convexity in Infinite Dimensions

This paper focuses on investigating generalized relative interior notions for sets in locally convex topological vector spaces with particular attentions to graphs of set-valued mappings and epigraphs of extended-real-valued functions. We introduce, study, and utilize a novel notion of quasi-near convexity of sets that is an infinite-dimensional extension of the widely acknowledged notion of near convexity. Quasi-near convexity is associated with the quasi-relative interior of sets, which is investigated in the paper together with other generalized relative interior notions for sets, not necessarily convex. In this way, we obtain new results on generalized relative interiors for graphs of set-valued mappings in convexity and generalized convexity settings.

math.OC↗

arXiv2023

Globally Convergent Coderivative-Based Generalized Newton Methods in Nonsmooth Optimization

This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are coderivative-based and employ generalized Hessians (coderivatives of subgradient mappings) associated with objective functions, which are either of class $\mathcal{C}^{1,1}$, or are represented in the form of convex composite optimization, where one of the terms may be extended-real-valued. The proposed globally convergent algorithms are of two types. The first one extends the damped Newton method and requires positive-definiteness of the generalized Hessians for its well-posedness and efficient performance, while the other algorithm is of {the regularized Newton type} being well-defined when the generalized Hessians are merely positive-semidefinite. The obtained convergence rates for both methods are at least linear, but become superlinear under the semismooth$^*$ property of subgradient mappings. Problems of convex composite optimization are investigated with and without the strong convexity assumption {on smooth parts} of objective functions by implementing the machinery of forward-backward envelopes. Numerical experiments are conducted for Lasso problems and for box constrained quadratic programs with providing performance comparisons of the new algorithms and some other first-order and second-order methods that are highly recognized in nonsmooth optimization.

math.OC↗

arXiv2023

Revisiting Rockafellar's Theorem on Relative Interiors of Convex Graphs with Applications to Convex Generalized Differentiation

In this paper we revisit a theorem by Rockafellar on representing the relative interior of the graph of a convex set-valued mapping in terms of the relative interior of its domain and function values. Then we apply this theorem to provide a simple way to prove many calculus rules of generalized differentiation of set-valued mappings and nonsmooth functions in finite dimensions. These results improve upon those in [14] by replacing the relative interior qualifications on graphs with qualifications on domains and/or ranges.

math.OC↗

arXiv2023

Fenchel-Rockafellar Theorem in Infinite Dimensions via Generalized Relative Interiors

In this paper we provide further studies of the Fenchel duality theory in the general frame work of locally convex topological vector (LCTV) spaces. We prove the validity of the Fenchel strong duality under some qualification conditions via generalized relative interiors imposed on the epigraphs and the domains of the functions involved. Our results directly generalize the classical Fenchel-Rockafellar theorem on strong duality from finite dimensions to LCTV spaces.

math.FA↗

arXiv2022

A Generalized Newton Method for Subgradient Systems

This paper proposes and develops a new Newton-type algorithm to solve subdifferential inclusions defined by subgradients of extended-real-valued prox-regular functions. The proposed algorithm is formulated in terms of the second-order subdifferential of such functions that enjoys extensive calculus rules and can be efficiently computed for broad classes of extended-real-valued functions. Based on this and on metric regularity and subregularity properties of subgradient mappings, we establish verifiable conditions ensuring well-posedness of the proposed algorithm and its local superlinear convergence. The obtained results are also new for the class of equations defined by continuously differentiable functions with Lipschitzian gradients (${\cal C}^{1,1}$ functions), which is the underlying case of our consideration. The developed algorithms for prox-regular functions and its extension to a structured class of composite functions are formulated in terms of proximal mappings and forward-backward envelopes. Besides numerous illustrative examples and comparison with known algorithms for ${\cal C}^{1,1}$ functions and generalized equations, the paper presents applications of the proposed algorithms to regularized least square problems arising in statistics, machine learning, and related disciplines.

math.OC↗

arXiv2022

Generalized Damped Newton Algorithms in Nonsmooth Optimization via Second-Order Subdifferentials

The paper proposes and develops new globally convergent algorithms of the generalized damped Newton type for solving important classes of nonsmooth optimization problems. These algorithms are based on the theory and calculations of second-order subdifferentials of nonsmooth functions with employing the machinery of second-order variational analysis and generalized differentiation. First we develop a globally superlinearly convergent damped Newton-type algorithm for the class of continuously differentiable functions with Lipschitzian gradients, which are nonsmooth of second order. Then we design such a globally convergent algorithm to solve a structured class of nonsmooth quadratic composite problems with extended-real-valued cost functions, which typically arise in machine learning and statistics. Finally, we present the results of numerical experiments and compare the performance of our main algorithm applied to an important class of Lasso problems with those achieved by other first-order and second-order optimization algorithms.

math.OC↗

arXiv2021

Optimality Conditions for Variational Problems in Incomplete Functional Spaces

This paper develops a novel approach to necessary optimality conditions for constrained variational problems defined in generally incomplete subspaces of absolutely continuous functions. Our approach involves reducing a variational problem to a (nondynamic) problem of constrained optimization in a normed space and then applying the results recently obtained for the latter class using generalized differentiation. In this way, we derive necessary optimality conditions for nonconvex problems of the calculus of variations with velocity constraints under the weakest metric subregularity-type constraint qualification. The developed approach leads us to a short and simple proof of the First-order necessary optimality conditions for such and related problems in broad spaces of functions, including those of class C^k.

math.OC↗

arXiv2021

Generalized Differentiation and Duality in Infinite Dimensions under Polyhedral Convexity

This paper addresses the study and applications of polyhedral duality of locally convex topological vector (LCTV) spaces. We first revisit the classical Rockafellar's proper separation theorem for two convex sets one which is polyhedral and then present its LCTV extension with replacing the relative interior by its quasi-relative interior counterpart. Then we apply this result to derive enhanced calculus rules for normals to convex sets, coderivatives of convex set-valued mappings, and subgradients of extended-real-valued functions under certain polyhedrality requirements in LCTV spaces by developing a geometric approach. We also establish in this way new results on conjugate calculus and duality in convex optimization with relaxed qualification conditions in polyhedral settings. Our developments contain significant improvements to a number of existing results obtained by Ng and Song in [31].

math.OC↗

arXiv2021

Applications of Controlled Sweeping Processes to Nonlinear Crowd Motion Models with Obstacles

This paper mainly focuses on solving the dynamic optimization of the planar controlled crowd motion models with obstacles which is an application of a class of optimal control problems governed by a general perturbed nonconvex sweeping process. This can be considered as a significant extension of the previous work regarding the controlled crowd motion models, where the obstacles have not been considered. The necessary optimality conditions for the problem under consideration are established and illustrated by a nontrivial example of practical importance.

math.OC↗

arXiv2020

Generalized Newton Algorithms for Tilt-Stable Minimizers in Nonsmooth Optimization

This paper aims at developing two versions of the generalized Newton method to compute not merely arbitrary local minimizers of nonsmooth optimization problems but just those, which possess an important stability property known as tilt stability. We start with unconstrained minimization of continuously differentiable cost functions having Lipschitzian gradients and suggest two second-order algorithms of the Newton type: one involving coderivatives of Lipschitzian gradient mappings, and the other based on graphical derivatives of the latter. Then we proceed with the propagation of these algorithms to minimization of extended-real-valued prox-regular functions, while covering in this way problems of constrained optimization, by using Moreau envelops. Employing advanced techniques of second-order variational analysis and characterizations of tilt stability allows us to establish the solvability of subproblems in both algorithms and to prove the Q-superlinear convergence of their iterations.

math.OC↗

arXiv2020

Variational analysis in normed Spaces with applications to constrained optimization

This paper is devoted to developing and applications of a generalized differential theory of variational analysis that allows us to work in incomplete normed spaces, without employing conventional variational techniques based on completeness and limiting procedures. The main attention is paid to generalized derivatives and subdifferentials of the Dini-Hadamard type with the usage of mild qualification conditions revolved around metric subregularity. In this way we develop calculus rules of generalized differentiation in normed spaces without imposing restrictive normal compactness assumptions and the like and then apply them to general problems of constrained optimization. Most of the obtained results are new even in finite dimensions. Finally, we derive refined necessary optimality conditions for nonconvex problems of semi-infinite and semidefinite programming.

math.OC↗