Searcharxiv⌕ Search

arXiv subjects

Mohammad Ali Nekoui

Publications and source records attributed to Mohammad Ali Nekoui.

4 recordsLinked to original sources

Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation

Collision-free motion is essential for mobile robots. Most approaches to collision-free and efficient navigation with wheeled robots require parameter tuning by experts to obtain good navigation behavior. This study investigates the application of deep reinforcement learning to train a mobile robot for autonomous navigation in a complex environment. The robot utilizes LiDAR sensor data and a deep neural network to generate control signals guiding it toward a specified target while avoiding obstacles. We employ two reinforcement learning algorithms in the Gazebo simulation environment: Deep Deterministic Policy Gradient and proximal policy optimization. The study introduces an enhanced neural network structure in the Proximal Policy Optimization algorithm to boost performance, accompanied by a well-designed reward function to improve algorithm efficacy. Experimental results conducted in both obstacle and obstacle-free environments underscore the effectiveness of the proposed approach. This research significantly contributes to the advancement of autonomous robotics in complex environments through the application of deep reinforcement learning.

cs.RO↗

Adaptive control of the singularly perturbed chaotic systems based on the scale time estimation by keeping chaotic property

In this paper, a new approach to the problem of stabilizing a chaotic system is presented. In this regard, stabilization is done by sustaining chaotic properties of the system. Sustaining the chaotic properties has been mentioned to be of importance in some areas such as biological systems. The problem of stabilizing a chaotic singularly perturbed system will be addressed and a solution will be proposed based on the OGY (Ott, Grebogi and Yorke) methodology. For the OGY control, Poincare section of the system is defined on its slow manifold. The multi-time scale property of the singularly perturbed system is exploited to control the Poincare map with the slow scale time. Slow scale time is adaptively estimated using a parameter estimation technique. Control with slow time scale circumvents the need to observe the states. With this strategy, the system remains chaotic and chaos identification is possible with online calculation of lyapunov exponents. Using this strategy on ecological system improves their control in three aspects. First that for ecological systems sustaining the dynamical property is important to survival of them. Second it removes the necessity of insertion of control action in each sample time. And third it introduces the sufficient time for census.

nlin.CD↗

Analysis of Two Time Scale Property of Singularly Perturbed System on Chaotic Attractor

The idea that chaos could be a useful tool for analyze nonlinear systems considered in this paper and for the first time the two time scale property of singularly perturbed systems is analyzed on chaotic attractor. The general idea introduced here is that the chaotic systems have orderly strange attractors in phase space and this orderly of the chaotic systems in subscription with other classes of systems can be used in analyses. Here the singularly perturbed systems are subscripted with chaotic systems. Two time scale property of system is addressed. Orderly of the chaotic attractor is used to analyze two time scale behavior in phase plane.

nlin.CD↗

Adaptive Neuro-Fuzzy Extended Kalman Filtering for Robot Localization

Extended Kalman Filter (EKF) has been a popular approach to localization a mobile robot. However, the performance of the EKF and the quality of the estimation depends on the correct a priori knowledge of process and measurement noise covariance matrices (Qk and Rk, respectively). Imprecise knowledge of these statistics can cause significant degradation in performance. This paper proposed the development of an Adaptive Neuro- Fuzzy Extended Kalman Filtering (ANFEKF) for localization of robot. The Adaptive Neuro-Fuzzy attempts to estimate the elements of Qk and Rk matrices of the EKF algorithm, at each sampling instant when measurement update step is carried out. The ANFIS supervises the performance of the EKF with the aim of reducing the mismatch between the theoretical and actual covariance of the innovation sequences. The free parameters of ANFIS are trained using the steepest gradient descent (SD) to minimize the differences of the actual value of the covariance of the residual with its theoretical value as much possible. The simulation results show the effectiveness of the proposed algorithm.

cs.OH↗