Searcharxiv⌕ Search

arXiv subjects

Tamás Dózsa

Publications and source records attributed to Tamás Dózsa.

9 recordsLinked to original sources

$H_2$-optimal model order reduction using hyperbolic geometry

We revisit the problem of approximating a linear time-invariant LTI model by a reduced-order model (ROM) in an $H_2$-optimal sense. A widely used method for computing such ROMs is the iterative rational Krylov algorithm (IRKA). However, in practice, the stability of the resulting ROM is not generally guaranteed. In this work, we develop a novel framework that can be used to obtain $H_2$-optimal models of single-input single-output LTI systems while enforcing stability of the ROM. We use Malmquist-Takenaka orthogonal expansions in the corresponding $H_2$-spaces and their connection to hyperbolic geometry to develop an equilibrium function. We show that the poles of an $H_2$-optimal ROM transfer function are defined by the zeros of this equilibrium function. The resulting nonlinear root-finding problem is solved using a Newton-type method formulated on the products of Poincaré disk manifolds, where updates are performed along hyperbolic geodesics ensuring that the stability constraint is satisfied at every iteration. We present numerical experiments on benchmark systems for both discrete- and continuous-time LTI MOR problems, including examples where IRKA produces unstable reduced models while the proposed method preserves stability throughout the iteration.

eess.SY↗

Second-order optimization of variable projection SVM models and road abnormality detection

We introduce a novel second-order optimization framework for minimizing so-called variable projection functionals. We demonstrate that the proposed framework is especially usefulfor the training of variable projection based kernel methods. In particular, the problem of efficiently training variable projection support vector machines (VP-SVMs) is considered. We show the effectiveness of the proposed training methodology in a real-world application, namely we demonstrate how second-order trust region algorithms can be used to train VPSVM models to recognize road surface abnormalities based on 1D signals obtained from a tire sensor.

eess.SP↗

Impulse Response Estimation via Laguerre-Fourier Expansion

The empirical transfer function estimate (ETFE) is a widely used method for system identification of linear time-invariant (LTI) systems in engineering disciplines such as acoustics, audio engineering, seismography, and tomography. However, ETFE suffers from numerical limitations when the excitation signal is band-limited or vanishes at certain frequencies, which is a common physical constraint of the excitation in practice. In such cases, division in the frequency domain becomes heavily ill-conditioned, and small measurement disturbances or numerical inaccuracies can degrade the solution. This paper presents L-ETFE, a generalization of ETFE based on Laguerre-Fourier expansions that addresses these limitations. After a suitable transformation, the method can yield a well-conditioned circulant problem even when the original ETFE system is ill-conditioned. Solving this problem via classical ETFE yields the discrete Laguerre-Fourier coefficients of the system's transfer function. The desired impulse response (IR) of the system-to-be-identified can then be recovered by a subsequent transformation pipeline. We derive novel and efficient algorithms for performing these transformations and analyse the conditioning of the transformed problem, explicitly characterizing its dependence on the input and a parameter used in the Laguerre-Fourier expansion. We evaluate the method on two simulated discrete-time LTI systems of varying complexity. The experiments demonstrate accurate IR recovery for spectral-zero and band-limited excitation, where standard ETFE fails.

eess.SP↗

Classification and detection of multiple UAVs using rational Gaussian wavelet neural networks

The detection of unmanned aerial vehicles (UAVs) is important for the protection of civilian and military infrastructure. In this paper we propose a cost effective UAV detection system using sound signals obtained from microphones. The recorded signals are passed through a signal processing pipeline which employs interpretable adaptive feature extractors using so-called rational Gaussian wavelets. These adaptive wavelet transformations are embedded into and trained together with an underlying small neural network which detects and classifies UAVs based on the obtained features. This leads to a physically interpretable machine learning algorithm that in addition to classifying UAVs is also capable of detecting UAV swarms. We demonstrate our results using data collected in indoor studio and noisy outdoor environments. We conclude that the proposed method outperforms traditional machine learning approaches for detecting and classifying single UAVs as well as drone swarms, while retaining a high degree of interpretability. Our implementation of the proposed methods is made publicly available for reproducibility.

cs.LG↗

Adaptive Kernel Methods

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel Hilbert space (RKHS), determined solely by the chosen kernel and the dataset, whose elements identify the basis elements. Consequently, the projection operator underlying the kernel method depends on the loss function, the dataset, and the choice of ambient RKHS. In this study, we consider kernel methods whose solution spaces also depend on learnable parameters that are independent of the dataset. The resulting methods can be viewed as variable projection operators that depend on the loss function, the dataset, and the new learnable parameters instead of a fixed RKHS. This work has two main contributions. First, we propose an efficient approximation of kernels associated with infinite-dimensional RKHSs, commonly used to reduce the solution-space dimension for large datasets. Second, we construct fixed-dimensional, parameter-dependent solution spaces that enable highly efficient kernel models suitable for large-scale problems without the need to approximate kernels of infinite-dimensional RKHSs. Our novel family of adaptive kernel methods generalizes earlier approaches, including Random Fourier Features, and we demonstrate their effectiveness through several numerical experiments.

math.NA↗

Tube-Based Model Predictive Control with Random Fourier Features for Nonlinear Systems

This paper presents a computationally efficient approach for robust Model Predictive Control of nonlinear systems by combining Random Fourier Features with tube-based MPC. Tube-based Model Predictive Control provides robust constraint satisfaction under bounded model uncertainties arising from approximation errors and external disturbances. The Random Fourier Features method approximates nonlinear system dynamics by solving a numerically tractable least-squares problem, thereby reducing the approximation error. We develop the integration of RFF-based residual learning with tube MPC and demonstrate its application to an autonomous vehicle path-tracking problem using a nonlinear bicycle model. Compared to the linear baseline, the proposed method reduces the tube size by approximately 50%, leading to less conservative behavior and resulting in around 70% smaller errors in the test scenario. Furthermore, the proposed method achieves real-time performance while maintaining provable robustness guarantees.

eess.SY↗

Generalized rational Prony and Bernoulli methods

The generalized operator-based Prony method is an important tool for describing signals which can be written as finite linear combinations of eigenfunctions of certain linear operators. On the other hand, Bernoulli's algorithm and its generalizations can be used to recover the parameters of rational functions belonging to finite-dimensional subspaces of $H_2$ Hardy-Hilbert spaces. In this work, we discuss several results related to these methods. We discuss a rational variant of the generalized operator-based Prony method and show that in fact, any Prony problem can be treated this way. This realization establishes the connection between Prony and Bernoulli methods and allows us to address some well-known numerical pitfalls. Several numerical experiments are provided to showcase the usefulness of the introduced methods. These include problems related to the identification of time-delayed linear systems and parameter recovery problems in reproducing kernel Hilbert spaces.

math.NA↗

Rational Gaussian wavelets and corresponding model driven neural networks

In this paper we consider the continuous wavelet transform using Gaussian wavelets multiplied by an appropriate rational term. The zeros and poles of this rational modifier act as free parameters and their choice highly influences the shape of the mother wavelet. This allows the proposed construction to approximate signals with complex morphology using only a few wavelet coefficients. We show that the proposed rational Gaussian wavelets are admissible and provide numerical approximations of the wavelet coefficients using variable projection operators. In addition, we show how the proposed variable projection based rational Gaussian wavelet transform can be used in neural networks to obtain a highly interpretable feature learning layer. We demonstrate the effectiveness of the proposed scheme through a biomedical application, namely, the detection of ventricular ectopic beats (VEBs) in real ECG measurements.

stat.ML↗

Abnormal Road Surface Detection Using Wheel Sensor Data

Intelligent tires can be used for a wide array of applications ranging from tire pressure monitoring to analyzing tire/road interactions, wheel loading, and tread wear monitoring. In this article, we develop a measurement system for intelligent tires equipped with a 3-D piezoresistive force sensor. The output of the sensor is segmented into tire revolution cycles, which are then represented by a transformation relying on adaptive Hermite functions. The underlying idea behind this step is to extract relevant features which capture tire dynamics. Then we evaluate the proposed measurement system in a potential vehicle application, that is, abnormal road surface detection. We deal with the corresponding binary classification problem by developing both low-complexity analytical and data-driven machine learning algorithms, which are tested on real-world measurement data. Our experiments showed that the proposed methods are able to detect abnormalities on the road surface with a mean accuracy of over 97%.

eess.SY↗