SearcharxivSearch

arXiv subjects

Marta Pozzi

Publications and source records attributed to Marta Pozzi.

3 recordsLinked to original sources

Exploring polynomial models in the Search Step of Direct Multisearch

Direct Multisearch (DMS) is a class of direct-search algorithms designed for multiobjective derivative-free optimization. Its framework consists of an optional search step and a poll step, the latter ensuring the corresponding theoretical convergence properties. Recently, a search strategy based on the minimization of quadratic polynomial models, constructed from previously evaluated points, was proposed to improve the numerical efficiency of the method. While the construction of these surrogate models has been investigated, considerably less attention has been devoted to how they should be jointly minimized, with min-max scalarization typically being adopted. This work investigates how different model-minimization strategies influence the performance of DMS. To this end, alternative strategies for exploring the quadratic polynomial models within the search step of DMS are proposed and numerically assessed, including one based on the recently proposed Improved Front Steepest Descent algorithm.

math.OC

A simple Path-based LP Relaxation for Directed Steiner Tree

We study the Directed Steiner Tree (DST) problem in layered graphs through a simple path-based linear programming relaxation. This relaxation achieves an integrality gap of O(l log k), where k is the number of terminals and l is the number of layers, which matches the best known bounds for DST previously obtained via lift-and-project hierarchies. Our formulation bypasses hierarchy machinery, offering a more transparent route to the state-of-the-art bound, and it can be exploited to provide an alternative simpler proof that O(l) rounds of the Sherali-Adams hierarchy suffice for reducing the integrality gap on layered instances of DST.

cs.DS

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity

We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers. Using an unbiassed compression technique, we develop a new method-Shadowheart SGD-that provably improves the time complexities of all previous centralized methods. Moreover, we show that the time complexity of Shadowheart SGD is optimal in the family of centralized methods with compressed communication. We also consider the bidirectional setup, where broadcasting from the server to the workers is non-negligible, and develop a corresponding method.

math.OC