arXiv subjects

Alexander Malyshev

Publications and source records attributed to Alexander Malyshev.

13 recordsLinked to original sources

arXiv2023

Accelerated Proximal Iterative re-Weighted $\ell_1$ Alternating Minimization for Image Deblurring

The quadratic penalty alternating minimization (AM) method is widely used for solving the convex $\ell_1$ total variation (TV) image deblurring problem. However, quadratic penalty AM for solving the nonconvex nonsmooth $\ell_p$, $0 < p < 1$ TV image deblurring problems is less studied. In this paper, we propose two algorithms, namely proximal iterative re-weighted $\ell_1$ AM (PIRL1-AM) and its accelerated version, accelerated proximal iterative re-weighted $\ell_1$ AM (APIRL1-AM) for solving the nonconvex nonsmooth $\ell_p$ TV image deblurring problem. The proposed algorithms are derived from the proximal iterative re-weighted $\ell_1$ (IRL1) algorithm and the proximal gradient algorithm. Numerical results show that PIRL1-AM is effective in retaining sharp edges in image deblurring while APIRL1-AM can further provide convergence speed up in terms of the number of algorithm iterations and computational time.

math.OC↗

arXiv2017

Signal reconstruction via operator guiding

Signal reconstruction from a sample using an orthogonal projector onto a guiding subspace is theoretically well justified, but may be difficult to practically implement. We propose more general guiding operators, which increase signal components in the guiding subspace relative to those in a complementary subspace, e.g., iterative low-pass edge-preserving filters for super-resolution of images. Two examples of super-resolution illustrate our technology: a no-flash RGB photo guided using a high resolution flash RGB photo, and a depth image guided using a high resolution RGB photo.

cs.CV↗

arXiv2017

Preconditioned warm-started Newton-Krylov methods for MPC with discontinuous control

We present Newton-Krylov methods for efficient numerical solution of optimal control problems arising in model predictive control, where the optimal control is discontinuous. As in our earlier work, preconditioned GMRES practically results in an optimal $O(N)$ complexity, where $N$ is a discrete horizon length. Effects of a warm-start, shifting along the predictive horizon, are numerically investigated. The~method is tested on a classical double integrator example of a minimum-time problem with a known bang-bang optimal control.

math.OC↗

arXiv2017

Least squares dynamics in Newton-Krylov Model Predictive Control

Newton-Krylov methods for nonlinear Model Predictive Control are pioneered by T. Ohtsuka under the name "C/GMRES". Ohtsuka eliminates a system state over the horizon from Karush-Kuhn-Tucker stationarity conditions of a Lagrangian using equations of system dynamics. We propose instead using least squares to fit the state to the dynamics and some constraints on the state, if they are inconsistent. Correspondingly modified Newton-Krylov methods are described. Numerical tests demonstrate workability of our modification.

math.OC↗

arXiv2015

Accelerated graph-based nonlinear denoising filters

Denoising filters, such as bilateral, guided, and total variation filters, applied to images on general graphs may require repeated application if noise is not small enough. We formulate two acceleration techniques of the resulted iterations: conjugate gradient method and Nesterov's acceleration. We numerically show efficiency of the accelerated nonlinear filters for image denoising and demonstrate 2-12 times speed-up, i.e., the acceleration techniques reduce the number of iterations required to reach a given peak signal-to-noise ratio (PSNR) by the above indicated factor of 2-12.

cs.CV↗

arXiv2015

Sparse preconditioning for model predictive control

We propose fast O(N) preconditioning, where N is the number of gridpoints on the prediction horizon, for iterative solution of (non)-linear systems appearing in model predictive control methods such as forward-difference Newton-Krylov methods. The Continuation/GMRES method for nonlinear model predictive control, suggested by T. Ohtsuka in 2004, is a specific application of the Newton-Krylov method, which uses the GMRES iterative algorithm to solve a forward difference approximation of the optimality equations on every time step.

math.OC↗

arXiv2015

Continuation model predictive control on smooth manifolds

Model predictive control (MPC) anticipates future events to take appropriate control actions. Nonlinear MPC (NMPC) describes systems with nonlinear models and/or constraints. Continuation MPC, suggested by T.~Ohtsuka in 2004, uses Krylov-Newton iterations. Continuation MPC is suitable for nonlinear problems and has been recently adopted for minimum time problems. We extend the continuation MPC approach to a case where the state is implicitly constrained to a smooth manifold. We propose an algorithm for on-line controller implementation and demonstrate its numerical effectiveness for a test problem on a hemisphere.

math.OC↗

arXiv2015

Efficient particle continuation model predictive control

Continuation model predictive control (MPC), introduced by T. Ohtsuka in 2004, uses Krylov-Newton approaches to solve MPC optimization and is suitable for nonlinear and minimum time problems. We suggest particle continuation MPC in the case, where the system dynamics or constraints can discretely change on-line. We propose an algorithm for on-line controller implementation of continuation MPC for ensembles of predictions corresponding to various anticipated changes and demonstrate its numerical effectiveness for a test minimum time problem arriving to a destination. Simultaneous on-line particle computation of ensembles of controls, for several dynamically changing system dynamics, allows choosing the optimal destination on-line and adapt it as needed.

math.OC↗

arXiv2015

Preconditioning for continuation model predictive control

Model predictive control (MPC) anticipates future events to take appropriate control actions. Nonlinear MPC (NMPC) deals with nonlinear models and/or constraints. A Continuation/GMRES Method for NMPC, suggested by T. Ohtsuka in 2004, uses the GMRES iterative algorithm to solve a forward difference approximation $Ax=b$ of the original NMPC equations on every time step. We have previously proposed accelerating the GMRES and MINRES convergence by preconditioning the coefficient matrix $A$. We now suggest simplifying the construction of the preconditioner, by approximately solving a forward recursion for the state and a backward recursion for the costate, or simply reusing previously computed solutions.

math.OC↗

arXiv2015

Accelerated graph-based spectral polynomial filters

Graph-based spectral denoising is a low-pass filtering using the eigendecomposition of the graph Laplacian matrix of a noisy signal. Polynomial filtering avoids costly computation of the eigendecomposition by projections onto suitable Krylov subspaces. Polynomial filters can be based, e.g., on the bilateral and guided filters. We propose constructing accelerated polynomial filters by running flexible Krylov subspace based linear and eigenvalue solvers such as the Block Locally Optimal Preconditioned Conjugate Gradient (LOBPCG) method.

cs.CV↗

arXiv2015

Conjugate Gradient Acceleration of Non-Linear Smoothing Filters

The most efficient signal edge-preserving smoothing filters, e.g., for denoising, are non-linear. Thus, their acceleration is challenging and is often performed in practice by tuning filter parameters, such as by increasing the width of the local smoothing neighborhood, resulting in more aggressive smoothing of a single sweep at the cost of increased edge blurring. We propose an alternative technology, accelerating the original filters without tuning, by running them through a special conjugate gradient method, not affecting their quality. The filter non-linearity is dealt with by careful freezing and restarting. Our initial numerical experiments on toy one-dimensional signals demonstrate 20x acceleration of the classical bilateral filter and 3-5x acceleration of the recently developed guided filter.

cs.CV↗

arXiv2015

Preconditioned Continuation Model Predictive Control

Model predictive control (MPC) anticipates future events to take appropriate control actions. Nonlinear MPC (NMPC) describes systems with nonlinear models and/or constraints. A Continuation/GMRES Method for NMPC, suggested by T. Ohtsuka in 2004, uses the GMRES iterative algorithm to solve a forward difference approximation $Ax=b$ of the Continuation NMPC (CNMPC) equations on every time step. The coefficient matrix $A$ of the linear system is often ill-conditioned, resulting in poor GMRES convergence, slowing down the on-line computation of the control by CNMPC, and reducing control quality. We adopt CNMPC for challenging minimum-time problems, and improve performance by introducing efficient preconditioning, utilizing parallel computing, and substituting MINRES for GMRES.

math.OC↗

arXiv2013

Resonance Features of the Conductance of Open Billiards with the Spin-Orbit Interaction

The transport properties of a circular billiard with attached channels, which is an open system, have been studied in the presence of the Dresselhaus and Rashba spin-orbit interactions. It has been shown that this interaction leads to the appearance of additional Fano resonances in the energy dependence of the conductance, the width of which is proportional to the fourth power of the spin-orbit coupling constant.

quant-ph↗