SearcharxivSearch

arXiv subjects

Mazen Alamir

Publications and source records attributed to Mazen Alamir.

At least 19 recordsLinked to original sources

A Unified Efficient Gradient-Based Heuristic For Box-Constrained Expectation-Related and Risk-Averse Stochastic Optimization Problems

This paper presents a new algorithm addressing the problem of stochastic optimization where the cost function depends on a vector of uncertain parameters with known statistics. The algorithm is parameterized so as to address various stochastic formulations spanning from Expectation-focused to Value-at-Risk (VaR) as well as Conditional-Value-at-Risk (CVaR)-focused formulations. The algorithm leverages a recently proposed gradient-based Search & Accelerate algorithm which is originally dedicated to deterministic optimization problems. The approach is based on a sequence of warm-started solutions of instances of the problem. These solutions together with a samples of other solutions belonging to the convex hull of the first ones constitute the set of admissible candidates. Among this discrete set of candidates, the optimal solution is selected with regards to a sample-based approximation of the targeted criterion. The relevance of the algorithm and its efficiency are discussed and shown using a tailored illustrative example.

math.OC

A Nonlinear Model Predictive Control Perspective on Gradient-Based Optimization: A New Efficient, Parameter-Free and Provably Stable Algorithm

This paper discusses some aspects related to gradient-based optimization algorithms with special focus on the requirements associated to their use in the implementation of Nonlinear Model Predictive Control. Based on a dedicated discussion, a new algorithm, termed Search and Accelerate (SaA) is proposed that mixes together a novel line search, a trust region mechanism together with an adaptation of the gradient acceleration scheme. A dedicated benchmark involving a set of 600 instances of box constrained optimization problems is designed and used in order to show the algorithm performances which make it a highly competitive general purpose gradient-based alternative for box-constrained optimization problems. An appealing feature of the algorithm is its robustness to the choice of the few parameters involved in its definition making the default values a valid option for any problem without a priori knowledge of the related Lipchitz constant. Moreover, an example of use of the proposed algorithm in NMPC implementation is proposed showing the possibility to reduce the control updating period which might be mandatory in some circumstances.

cs.CE

Identifying Explicit Parsimonious Piece-wise Polynomial Relationships in Industrial time-series: Application to manipulator robots

This paper addresses the problem of identifying parsimonious explicit piece-wise polynomial relationships that might involve a relatively large number of raw features. The algorithm leverages a recently proposed identification algorithm that yields parsimonious implicit relationships enabling to derive normality characterization in the context of anomaly detection and localization. The algorithm proposed in this paper goes a step further by deriving explicit piece-wise representations that are built using the set of polynomials involved in the implicit representations. The framework is illustrated on the problem of identifying parsimonious explicit representations of the inverse model of a 6-axis manipulator robot. Moreover, further experiments on a 4-axis robot are also shown which are designed to investigate the generalization capability of parsimonious models compared to state-of-the-art DNNs structures, when models face unseen contexts of use.

cs.RO

How is remifentanil dosed without dedicated indicator?

This study investigates the paradigm of intraoperative analgesic dosage using a data-driven approach based on retrospective clinical data. Remifentanil, an analgesic widely used during anesthesia, presents a dosing challenge due to the absence of an universally accepted indicator of analgesia. To examine how changes in patient state correlate with adjustments in remifentanil target concentration triggered by the practitioner, we analyzed data from two sources: VitalDB (Seoul, Korea) and PREDIMED (Grenoble, France). Results show that only features derived from arterial pressure are consistently associated with changes in remifentanil targets. This finding is robust across both datasets despite variations in specific thresholds. In particular, increases in remifentanil targets are associated with high or rising arterial pressure over short periods (1--2 minutes), whereas decreases are linked to low, stable, or declining arterial pressure over longer periods (5--7 minutes). By capturing anesthesiologists' dosing strategies we provide a foundation for the future development of closed-loop control algorithms. Beyond the specific example of remifentanil's change prediction, the proposed feature generation and associated sparse fitting approach can be applied to other domain where human decision can be viewed as sensors interpretation.

eess.SP

On polynomial explicit partial estimator design for nonlinear systems with parametric uncertainties

This paper investigates the idea of designing data-driven partial estimators for nonlinear systems showing parametric uncertainties using sparse multivariate polynomial relationships. A general framework is first presented and then validated on two illustrative examples with comparison to different possible Machine/Deep-Learning based alternatives. The results suggests the superiority of the proposed sparse identification scheme, at least when the learning data is small.

eess.SY

On continuous-time sparse identification of nonlinear polynomial systems

This paper leverages recent advances in high derivatives reconstruction from noisy-time series and sparse multivariate polynomial identification in order to improve the process of parsimoniously identifying, from a small amount of data, unknown Single-Input/Single-Output nonlinear dynamics of relative degree up to 4. The methodology is illustrated on the Electronic Throttle Controlled automotive system.

eess.SY

On relaxing the N-Reachability Implicit Requirement in NMPC Design

This paper proposes a proof of stability for Model Predictive Control formulations involving a prediction horizon that might be too short to meet the reachability condition generally invoked as a sufficient condition for closed-loop stability. This condition is replaced by a contraction condition on the stage cost. But unlike the contraction based existing formulations where the prediction horizon becomes a decision variable, the formulation proposed in this paper remains standard in that it uses constant and short prediction horizon. An illustrative example is provided to assess the relevance of the proposed formulation.

eess.SY

optipoly: A Python package for boxed-constrained multi-variable polynomial cost functions optimization

In this paper, a new python package (optipoly) is described that solves box-constrained optimization problem over multivariate polynomial cost functions. The principle of the algorithm is described before its performance is compared to three general purpose NLP solvers implemented in the state-of-the-art Gekko and scipy packages. The comparison show statistically better best solution provided by the algorithm with significantly less computation times. The package will be shortly made freely and easily available through the simple (pip install) process.

cs.CE

On reconstructing high derivatives of noisy time-series with confidence intervals

Reconstructing high derivatives of noisy measurements is an important step in many control, identification and diagnosis problems. In this paper, a heuristic is proposed to address this challenging issue. The framework is based on a dictionary of identified models indexed by the bandwidth, the noise level and the required degrees of derivation. Each model in the dictionary is identified via cross-validation using tailored learning data. It is also shown that the proposed approach provides heuristically defined confidence intervals on the resulting estimation. The performance of the framework is compared to the state-of-the-art available algorithms showing noticeably higher accuracy. Although the results are shown for up to the 4-th derivative, higher derivation orders can be used with comparable results.

eess.SY

Model-Free Unsupervised Anomaly Detection Framework in Multivariate Time-Series of Industrial Dynamical Systems

In this paper, a new model-free anomaly detection framework is proposed for time-series induced by industrial dynamical systems.The framework lies in the category of conventional approaches which enable appealing features such as a learning with reduced amount of training data, a high potential for explainability as well as a compatibility with incremental learning mechanism to incorporate operator feedback after an alarm is raised and analyzed. Although these are crucial features towards acceptance of data-driven solutions by industry, they are rarely considered in the comparisons that generally almost exclusively focus on performance metrics. Moreover, the features engineering step involved in the proposed framework is inspired by the time-series being implicitly governed by physical laws as it is generally the case in industrial time-series. Two examples are given to assess the efficiency of the proposed approach.

eess.SY

A Framework and a python-package for Real-time NMPC parameters settings

This paper presents a framework that enables a systematic and rational choice of NMPC design components such as control updating period, down-sampling period for prediction, control parameterization, prediction horizon's length, the maximum number of iterations as well as penalties on the terminal cost and the soft constraints. The rationale that underlines the design choices is based on real-time implementability, convergence and constraints satisfaction for a given computational device and a specific optimization algorithm. Moreover, a freely available associated Python-based implementation is also described with a fully developed illustrative example implementing a nonlinear MPC controller for a Planar Vertical Take-Off and Landing (PVTOL) aircraft under control saturation and state constraints.

eess.SY

Sparse Dynamical Features generation, application to Parkinson's Disease diagnosis

In this study we focus on the diagnosis of Parkinson's Disease (PD) based on electroencephalogram (EEG) signals. We propose a new approach inspired by the functioning of the brain that uses the dynamics, frequency and temporal content of EEGs to extract new demarcating features of the disease. The method was evaluated on a publicly available dataset containing EEG signals recorded during a 3-oddball auditory task involving N = 50 subjects, of whom 25 suffer from PD. By extracting two features, and separating them with a straight line using a Linear Discriminant Analysis (LDA) classifier, we can separate the healthy from the unhealthy subjects with an accuracy of 90 % $(p < 0.03)$ using a single channel. By aggregating the information from three channels and making them vote, we obtain an accuracy of 94 %, a sensitivity of 96 % and a specificity of 92 %. The evaluation was carried out using a nested Leave-One-Out cross-validation procedure, thus preventing data leakage problems and giving a less biased evaluation. Several tests were carried out to assess the validity and robustness of our approach, including the test where we use only half the available data for training. Under this constraint, the model achieves an accuracy of 83.8 %.

eess.SY

Learning-Based sensitivity analysis and feedback design for drug delivery of mixed therapy of cancer in the presence of high model uncertainties

In this paper, a methodology is proposed that enables to analyze the sensitivity of the outcome of a therapy to unavoidable high dispersion of the patient specific parameters on one hand and to the choice of the parameters that define the drug delivery feedback strategy on the other hand. More precisely, a method is given that enables to extract and rank the most influent parameters that determine the probability of success/failure of a given feedback therapy for a given set of initial conditions over a cloud of realizations of uncertainties. Moreover predictors of the expectations of the amounts of drugs being used can also be derived. This enables to design an efficient stochastic optimization framework that guarantees safe contraction of the tumor while minimizing a weighted sum of the quantities of the different drugs being used. The framework is illustrated and validated using the example of a mixed therapy of cancer involving three combined drugs namely: a chemotherapy drug, an immunology vaccine and an immunotherapy drug. Finally, in this specific case, it is shown that dash-boards can be built in the 2D-space of the most influent state components that summarize the outcomes' probabilities and the associated drug usage as iso-values curves in the reduced state space.

eess.SY

Investigation of fast-NMPC and deep learning approach in fixed-point-based hierarchical control

This paper explores some variations of a hierarchical control framework that has been recently proposed. The framework is dedicated to control a network of interconnected subsystems such as the ones describing cryogenic processes or power plants. Recent investigations showed that handling constraints and nonlinearities might challenge the real-time feasibility of the approach. This paper investigates and combine two successful directions, namely, the use of truncated fast gradient and deep neural networks based controller modeling in order to reduce the computation time of the most critical subsystem. It is also shown that by doing so, the control updating period can be drastically reduced and the closed-loop performances highly improved. The paper can therefore be seen as a concrete implementation and validation of some key ideas in real-time distributed NMPC design. All the concepts are validated using the realistic and challenging example of real-life cryogenic refrigerator.

eess.SY

On the use of Anderson acceleration in hierarchical control

This paper investigates the use of fixed-point Anderson acceleration method (AA) to a recently proposed hierarchical control framework. Due to its model-free property, the AA-based resulting hierarchical framework becomes more generic since no mathematical model of the subsystems at the lower layer is required at the upper coordinator layer. Numerical results are proposed to evaluate the effectiveness of this approach. The paper also presents a modified version of the original hierarchical approach that involves the AA in hierarchical control.

eess.SY

A generic fixed-point iteration-based hierarchical control design: Application to a cryogenic process

This paper presents an extension of a recently proposed hierarchical control framework applied to a cryogenic system. While in the previous work, each sub-system in the decomposition needed to show at least one component of the control input, in the present contribution, this condition is removed enabling a higher flexibility in the definition of the decomposition graph. The impact of this extended flexibility on the computation time is shown using the same cryogenic station where a decomposition in four sub-system is made possible (instead of two in the previous setting).

eess.SY

Partial Extended Observability Certification and Optimal Design of Moving Horizon Estimators Under Uncertainties

This paper addresses the observability analysis and the optimal design of observation parameters in the presence of noisy measurements and parametric uncertainties. The main underlying frameworks are the nonlinear constrained moving horizon estimator design and the probabilistic certification via randomized optimization. As the perfect observability concept is not relevant under the considered uncertain and noisy context, the notion of almost $ε$-observability is introduced and a systematic procedure to assess its satisfaction for a given system with a priori known measurement noise statistics and parameter discrepancy is sketched. A nice feature in the proposed framework is that the observability is not necessarily defined as the ability to reconstruct the whole state, rather, the more general concept of observation-target quantities is used so that one can analyze the precision with which specific chosen expressions of the state and the parameters can be reconstructed. The overall framework is exposed and validated through an illustrative example.

eess.SY

A Heuristic for Dynamic Output Predictive Control Design for Uncertain Nonlinear Systems

In this paper, a simple heuristic is proposed for the design of uncertainty aware predictive controllers for nonlinear models involving uncertain parameters. The method relies on Machine Learning-based approximation of ideal deterministic MPC solutions with perfectly known parameters. An efficient construction of the learning data set from these off-line solutions is proposed in which each solution provides many samples in the learning data. This enables a drastic reduction of the required number of Non Linear Programming problems to be solved off-line while explicitly exploiting the statistics of the parameters dispersion. The learning data is then used to design a fast on-line output dynamic feedback that explicitly incorporate information of the statistics of the parameters dispersion. An example is provided to illustrate the efficiency and the relevance of the proposed framework. It is in particular shown that the proposed solution recovers up to 78\% of the expected advantage of having a perfect knowledge of the parameters compared to nominal design.

eess.SY