arXiv subjects

Johan Schoukens

Publications and source records attributed to Johan Schoukens.

At least 37 records · Page 2Linked to original sources

arXiv2018

Regularized Nonparametric Volterra Kernel Estimation

In this paper, the regularization approach introduced recently for nonparametric estimation of linear systems is extended to the estimation of nonlinear systems modelled as Volterra series. The kernels of order higher than one, representing higher dimensional impulse responses in the series, are considered to be realizations of multidimensional Gaussian processes. Based on this, prior information about the structure of the Volterra kernel is introduced via an appropriate penalization term in the least squares cost function. It is shown that the proposed method is able to deliver accurate estimates of the Volterra kernels even in the case of a small amount of data points.

eess.SY↗

arXiv2018

Information and Statistical Efficiency When Quantizing Noisy DC Values

This paper considers estimation of a quantized constant in noise when using uniform and nonuniform quantizers. Estimators based on simple arithmetic averages, on sample statistical moments and on the maximum-likelihood procedure are considered. It provides expressions for the statistical efficiency of the arithmetic mean by comparing its variance to the proper Cramér-Rao lower bound. It is conjectured that the arithmetic mean is optimal among all estimators with an exactly known bias. Conditions under which its statistical performance are improved by the other estimation procedures when the exact bias is not known are found and analyzed. Using simulations and analysis of experimental data, it is shown that both moment-based and maximum-likelihood-based estimators provide better results, when the noise standard deviation is comparable with the quantization step and the noise model of quantization can not be applied.

eess.SP↗

arXiv2018

Efficient Multidimensional Regularization for Volterra Series Estimation

This paper presents an efficient nonparametric time domain nonlinear system identification method. It is shown how truncated Volterra series models can be efficiently estimated without the need of long, transient-free measurements. The method is a novel extension of the regularization methods that have been developed for impulse response estimates of linear time invariant systems. To avoid the excessive memory needs in case of long measurements or large number of estimated parameters, a practical gradient-based estimation method is also provided, leading to the same numerical results as the proposed Volterra estimation method. Moreover, the transient effects in the simulated output are removed by a special regularization method based on the novel ideas of transient removal for Linear Time-Varying (LTV) systems. Combining the proposed methodologies, the nonparametric Volterra models of the cascaded water tanks benchmark are presented in this paper. The results for different scenarios varying from a simple Finite Impulse Response (FIR) model to a 3rd degree Volterra series with and without transient removal are compared and studied. It is clear that the obtained models capture the system dynamics when tested on a validation dataset, and their performance is comparable with the white-box (physical) models.

eess.SY↗

arXiv2018

Parametric System Identification Using Quantized Data

The estimation of signal parameters using quantized data is a recurrent problem in electrical engineering. As an example, this includes the estimation of a noisy constant value and of the parameters of a sinewave, that is, its amplitude, initial record phase, and offset. Conventional algorithms, such as the arithmetic mean, in the case of the estimation of a constant, are known not to be optimal in the presence of quantization errors. They provide biased estimates if particular conditions regarding the quantization process are not met, as it usually happens in practice. In this paper, a quantile-based estimator is presented, which is based on the Gauss-Markov theorem. The general theory is first described and the estimator is then applied to both direct current and alternate current input signals with unknown characteristics. Using simulations and experimental results, it is shown that the new estimator outperforms conventional estimators in both problems, by removing the estimation bias.

eess.SP↗

arXiv2018

Structure detection of Wiener-Hammerstein systems with process noise

Identification of nonlinear block-oriented models has been extensively studied. The presence of the process noise, more precisely its location in the block-oriented model influences essentially the development of a consistent identification algorithm. The present work is proposed with the aim to localize the process noise in the block-oriented model for accurate nonlinear modeling. To this end, the response of a Wiener-Hammerstein system is theoretically analyzed, the disturbance component in the output, caused by the process noise preceding the static nonlinearity, is shown to be dependent on the input signal. Inspired by such theoretical observation, a simple and new protocol is developed to determine the location of the process noise with respect to the static nonlinearity by using an input signal that is periodic, but nonstationary within one period. In addition, the proposed technique is promising to detect the type of certain static nonlinearity (e.g., dead-zone, saturation). Finally, it is validated on a simulated example and a real-life benchmark.

eess.SY↗

arXiv2018

Structure Discrimination in Block-Oriented Models Using Linear Approximations: A Theoretic Framework

In this paper we show that it is possible to retrieve structural information about complex block-oriented nonlinear systems, starting from linear approximations of the nonlinear system around different setpoints.The key idea is to monitor the movements of the poles and zeros of the linearized models and to reduce the number of candidate models on the basis of these observations. Besides the well known open loop single branch Wiener-, Hammerstein-, and Wiener-Hammerstein systems, we also cover a number of more general structures like parallel (multi branch) Wiener-Hammerstein models, and closed loop block oriented models, including linear fractional representation (LFR) models.

eess.SY↗

arXiv2018

Linear System Identification in a Nonlinear Setting - Nonparametric analysis of the nonlinear distortions and their impact on the best linear approximation

This article addresses the following problems: 1) First, a nonlinearity analysis is made looking for the presence of nonlinearities in an early phase of the identification process. The level and the nature of the nonlinearities should be retrieved without a significant increase in the amount of measured data. 2) Next it is studied if it is safe to use a linear system identification approach, even if the presence of nonlinear distortions is detected. The properties of the linear system identification approach under these conditions are studied, and the reliability of the uncertainty bounds is checked. 3) Eventually, tools are provided to check how much can be gained if a nonlinear model were identified instead of a linear model. Addressing these three questions forms the outline of this article. The possibilities and pitfalls of using a linear identification framework in the presence of nonlinear distortions will be discussed and illustrated on lab-scale and industrial examples. In this article, the focus is on nonparametric and parametric black box identification methods, however the results might also be useful for physical modeling methods. Knowing the actual nonlinear distortion level can help to choose the required level of detail that is needed in the physical model. This will strongly influence the modeling effort. Also, in this case, significant time can be saved if it is known from experiments that the system behaves almost linearly. The converse is also true. If the experiments show that some (sub-)systems are highly nonlinear, it helps to focus the physical modeling effort on these critical elements.

eess.SY↗

arXiv2018

Nonlinear state-space modelling of the kinematics of an oscillating circular cylinder in a fluid flow

The flow-induced vibration of bluff bodies is an important problem of many marine, civil, or mechanical engineers. In the design phase of such structures, it is vital to obtain good predictions of the fluid forces acting on the structure. Current methods rely on computational fluid dynamic simulations (CFD), with a too high computational cost to be effectively used in the design phase or for control applications. Alternative methods use heuristic mathematical models of the fluid forces, but these lack the accuracy (they often assume the system to be linear) or flexibility to be useful over a wide operating range. In this work we show that it is possible to build an accurate, flexible and low-computational-cost mathematical model using nonlinear system identification techniques. This model is data driven: it is trained over a user-defined region of interest using data obtained from experiments or simulations, or both. Here we use a Van der Pol oscillator as well as CFD simulations of an oscillating circular cylinder to generate the training data. Then a discrete-time polynomial nonlinear state-space model is fit to the data. This model relates the oscillation of the cylinder to the force that the fluid exerts on the cylinder. The model is finally validated over a wide range of oscillation frequencies and amplitudes, both inside and outside the so-called lock-in region. We show that forces simulated by the model are in good agreement with the data obtained from CFD.

eess.SY↗

arXiv2018

A Rigorous Analysis of Least Squares Sine Fitting Using Quantized Data: the Random Phase Case

This paper considers least-square based estimation of the amplitude and square amplitude of a quantized sine wave, done by considering random initial record phase. Using amplitude- and frequency-domain modeling techniques, it is shown that the estimator is inconsistent, biased and has a variance that may be underestimated if the simple model of quantization is applied. The effects of both sine wave offset values and additive Gaussian noise are taken into account. General estimator properties are derived, without making simplifying assumptions on the role of the quantization process, to allow assessment of measurement uncertainty, when this least-square procedure is used.

eess.SP↗

arXiv2018

Extending the Best Linear Approximation Framework to the Process Noise Case

The Best Linear Approximation (BLA) framework has already proven to be a valuable tool to analyze nonlinear systems and to start the nonlinear modeling process. The existing BLA framework is limited to systems with additive (colored) noise at the output. Such a noise framework is a simplified representation of reality. Process noise can play an important role in many real-life applications. This paper generalizes the Best Linear Approximation framework to account also for the process noise, both for the open-loop and the closed-loop setting, and shows that the most important properties of the existing BLA framework remain valid. The impact of the process noise contributions on the robust BLA estimation method is also analyzed.

eess.SY↗

arXiv2018

Practical Issues in the Synthesis of Ternary Sequences

Several issues related to the practical synthesis of ternary sequences with specified spectra are addressed in this paper. Specifically, sequences with harmonic multiples of two and three suppressed are studied, given their relevance when testing and characterizing nonlinear systems. In particular, the effect of non-uniform Digital to Analog Converter (DAC) levels on the spectral properties of the generated signal is analyzed. It is analytically shown that the DAC non-uniform levels result in degraded harmonic suppression performance. Moreover, a new approach is proposed for designing ternary sequences, which is flexible and can be adapted to suit different requirements. The resulting sequences, denoted as randomized constrained sequences, are characterized theoretically by deriving an analytical expression of the power spectral density. Furthermore, they are extensively compared with three synthesis approaches proposed in the literature. The approach is validated by numerical simulations and experimental results, showing the potential to achieve harmonic suppression performance of approximately 100 dB.

eess.SP↗

arXiv2018

Comparison of several data-driven nonlinear system identification methods on a simplified glucoregulatory system example

In this paper, several advanced data-driven nonlinear identification techniques are compared on a specific problem: a simplified glucoregulatory system modeling example. This problem represents a challenge in the development of an artificial pancreas for T1DM treatment, since for this application good nonlinear models are needed to design accurate closed-loop controllers to regulate the glucose level in the blood. Block-oriented as well as state-space models are used to describe both the dynamics and the nonlinear behavior of the insulin-glucose system, and the advantages and drawbacks of each method are pointed out. The obtained nonlinear models are accurate in simulating the patient's behavior, and some of them are also sufficiently simple to be considered in the implementation of a model-based controller to develop the artificial pancreas.

eess.SY↗

arXiv2017

Parameter reduction in nonlinear state-space identification of hysteresis

Hysteresis is a highly nonlinear phenomenon, showing up in a wide variety of science and engineering problems. The identification of hysteretic systems from input-output data is a challenging task. Recent work on black-box polynomial nonlinear state-space modeling for hysteresis identification has provided promising results, but struggles with a large number of parameters due to the use of multivariate polynomials. This drawback is tackled in the current paper by applying a decoupling approach that results in a more parsimonious representation involving univariate polynomials. This work is carried out numerically on input-output data generated by a Bouc-Wen hysteretic model and follows up on earlier work of the authors. The current article discusses the polynomial decoupling approach and explores the selection of the number of univariate polynomials with the polynomial degree, as well as the connections with neural network modeling. We have found that the presented decoupling approach is able to reduce the number of parameters of the full nonlinear model up to about 50\%, while maintaining a comparable output error level.

eess.SY↗

arXiv2017

D-Optimal Input Design for Nonlinear FIR-type Systems:A Dispersion-based Approach

Optimal input design is an important step of the identification process in order to reduce the model variance. In this work a D-optimal input design method for finite-impulse-response-type nonlinear systems is presented. The optimization of the determinant of the Fisher information matrix is expressed as a convex optimization problem. This problem is then solved using a dispersion-based optimization scheme, which is easy to implement and converges monotonically to the optimal solution. Without constraints, the optimal design cannot be realized as a time sequence. By imposing that the design should lie in the subspace described by a symmetric and non-overlapping set, a realizable design is found. A graph-based method is used in order to find a time sequence that realizes this optimal constrained design. These methods are illustrated on a numerical example of which the results are thoroughly discussed. Additionally the computational speed of the algorithm is compared with the general convex optimizer cvx.

eess.SY↗

arXiv2016

Wiener system identification with generalized orthonormal basis functions

Many nonlinear systems can be described by a Wiener-Schetzen model. In this model, the linear dynamics are formulated in terms of orthonormal basis functions (OBFs). The nonlinearity is modeled by a multivariate polynomial. In general, an infinite number of OBFs is needed for an exact representation of the system. This paper considers the approximation of a Wiener system with finite-order infinite impulse response dynamics and a polynomial nonlinearity. We propose to use a limited number of generalized OBFs (GOBFs). The pole locations, needed to construct the GOBFs, are estimated via the best linear approximation of the system. The coefficients of the multivariate polynomial are determined with a linear regression. This paper provides a convergence analysis for the proposed identification scheme. It is shown that the estimated output converges in probability to the exact output. Fast convergence rates, in the order $O_p({N_F}^{-n_{rep}/2})$, can be achieved, with $N_F$ the number of excited frequencies and $n_{rep}$ the number of repetitions of the GOBFs.

eess.SY↗

arXiv2016

Initial estimates for Wiener-Hammerstein models using phase-coupled multisines

Block-oriented models are often used to model nonlinear systems. These models consist of linear dynamic (L) and nonlinear static (N) sub-blocks. This paper addresses the generation of initial estimates for a Wiener-Hammerstein model (LNL cascade). While it is easy to measure the product of the two linear blocks using a Gaussian excitation and linear identification methods, it is difficult to split the global dynamics over the individual blocks. This paper first proposes a well-designed multisine excitation with pairwise coupled random phases. Next, a modified best linear approximation is estimated on a shifted frequency grid. It is shown that this procedure creates a shift of the input dynamics with a known frequency offset, while the output dynamics do not shift. The resulting transfer function, which has complex coefficients due to the frequency shift, is estimated with a modified frequency domain estimation method. The identified poles and zeros can be assigned to either the input or output dynamics. Once this is done, it is shown in the literature that the remaining initialization problem can be solved much easier than the original one. The method is illustrated on experimental data obtained from the Wiener-Hammerstein benchmark system.

eess.SY↗

arXiv2016

Grey-box nonlinear state-space modelling for mechanical vibrations identification

In the present paper, a flexible and parsimonious model of the vibrations of nonlinear mechanical systems is introduced in the form of state-space equations. It is shown that the nonlinear model terms can be formed using a limited number of output measurements. A two-step identification procedure is derived for this grey-box model, integrating nonlinear subspace initialisation and maximum likelihood optimisation. The complete procedure is demonstrated on the Silverbox benchmark, which is an electrical mimicry of a single-degree-of-freedom mechanical system with one displacement-dependent nonlinearity.

eess.SY↗

arXiv2016

A nonlinear state-space approach to hysteresis identification

Most studies tackling hysteresis identification in the technical literature follow white-box approaches, i.e. they rely on the assumption that measured data obey a specific hysteretic model. Such an assumption may be a hard requirement to handle in real applications, since hysteresis is a highly individualistic nonlinear behaviour. The present paper adopts a black-box approach based on nonlinear state-space models to identify hysteresis dynamics. This approach is shown to provide a general framework to hysteresis identification, featuring flexibility and parsimony of representation. Nonlinear model terms are constructed as a multivariate polynomial in the state variables, and parameter estimation is performed by minimising weighted least-squares cost functions. Technical issues, including the selection of the model order and the polynomial degree, are discussed, and model validation is achieved in both broadband and sine conditions. The study is carried out numerically by exploiting synthetic data generated via the Bouc-Wen equations.

eess.SY↗