Searcharxiv⌕ Search

arXiv subjects

Jan Steckel

Publications and source records attributed to Jan Steckel.

At least 19 recordsLinked to original sources

Full-sphere emission and reception directivities of seven echolocating bat species

Echolocating bats shape their calls and the returning echoes with their noseleaf or mouth, head and pinnae. Understanding these spectrospatial directivity patterns is central to bat echolocation. We describe a dataset of simulated far-field emission and reception directivities of seven echolocating bat species from three families (Phyllostomidae, Rhinolophidae and Vespertilionidae). For each species, the head of one preserved specimen was scanned with micro-computed tomography and converted into a closed surface mesh, on which the responses of both ears and of the emitter were computed with a boundary element method or, for the two mouth-emitting species, with an analytical piston model. The complex-valued responses cover the full sphere at 2.5 deg resolution from 20 to 160 kHz in 0.5 kHz steps. They come with the meshes, the landmarks of ears, nostrils and mouth, alternative source positions and skeletons for posing the pinnae and noseleaves, all in one frame, and with Python and MATLAB code. The technical validation covers solver verification, mesh convergence, comparisons with earlier simulations and measurements, and sensitivity analyses.

eess.AS↗

Hardware-Accelerated Geometrical Simulation of Biological and Engineered In-Air Ultrasonic Systems

The deployment of in-air acoustic sensors for industrial monitoring and autonomous robotics has grown significantly, often drawing inspiration from biological echolocation. However, developing and validating these systems in existing simulation frameworks remains challenging due to the computational cost of simulating high-frequency wave propagation in large, dynamic, and complex environments. While wave-based methods offer high accuracy, they scale poorly with frequency and volume. Conversely, existing geometric acoustic solvers often lack support for dynamic scenes, complex diffraction, or closed-loop robotic integration. In this work, we introduce SonoTraceUE, a high-fidelity acoustic simulation framework built as a plugin for Unreal Engine. By using a hardware-accelerated ray tracing-based specular reflection model, and a curvature-based Monte Carlo diffraction model, the system enables near real-time simulation of active and passive acoustic sensing in dynamic, multi-material environments. We validate the framework through two distinct experimental domains: a bioacoustic study and a robotics experiment. Our results demonstrate that SonoTraceUE achieves high correlation with real-world spectral and spatial data. The framework provides a versatile platform for synthetic data generation, hypothesis testing in bioacoustics, and the rapid prototyping of closed-loop robotic systems that use acoustic sensing.

eess.SP↗

RTISSLAM-3D: Full 6-DoF SLAM With an In-Air 3D Imaging Sonar

Echolocating bats navigate dense forests using sonar alone, and in-air 3D imaging sonars now capture the entire frontal hemisphere with every pulse. Sonar SLAM, however, has so far been planar: current systems estimate a 2D trajectory and discard the elevation information in the sonar images, an assumption that does not hold on rough and sloped terrain such as a forest floor. In this paper, we introduce RTISSLAM-3D, a novel 6-DoF SLAM system for a wheeled robot that carries an in-air 3D imaging sonar, an IMU and wheel encoders. A CFAR detector on the sphere reduces every sonar image to a sparse set of 3D detections, which we use for a 3D acoustic odometry that models the shape of the sonar beam, for place recognition with polar submap descriptors, and for the verification of loop closures by 3D registration, all combined in a 6-DoF pose graph with attitude factors. We evaluated RTISSLAM-3D on a 545m drive through a forest, with a 3D lidar SLAM as reference. The loop closures reduced the horizontal error of the acoustic odometry from 1.74m to 0.28m, with a height error of 0.12m, and 94.6% of the resulting 3D sonar map lies within 0.3 m of the lidar map.

cs.RO↗

RTISSLAM: In-air Imaging Sonar SLAM using a Robust Pose Graph and Occupancy Grid Mapping

Sonar was one of the first sensors with which mobile robots built maps, and in-air sonar keeps working where cameras and lidar fail, in darkness, smoke, dust and next to glass. Classical sonar SLAM, however, relied on geometric features or occupancy grids built from sparse range readings, and both struggle with the specular reflections that dominate indoor sonar. In this letter, we introduce RTISSLAM, a novel sonar-only SLAM system for an embedded 3D imaging sonar, which combines the robust pose graph of BatSLAM 2.0 as back-end with an occupancy grid as map. Energyscapes from delay-multiply-and-sum beamforming with a range-wise CFAR serve as place descriptors for sequence-verified loop closures, acoustic odometry calibrates the wheel odometry online, recognized revisits are registered metrically, and the grid is stored per keyframe and anchored to the pose-graph nodes, so that it follows every loop closure. In simulated worlds with specular walls, RTISSLAM reduces the trajectory error of the wheel odometry from \SI{8.2}{\meter} to \SI{0.31}{\meter} in an office, while lidar-style grid SLAM on the same sonar data fails.

cs.RO↗

Self-Supervised Deconvolution of In-Air Sonar Images Using Sensor Ego-Motion

Broadband in-air sonar sensors with a sparse microphone array form images through delay-and-sum beamforming, which leaves high sidelobes and an angular resolution that degrades strongly towards the sides of the field of view. Deconvolving these images requires access to the point-spread function of the complete imaging chain, including the emitter spectrum and directivity and the array imperfections. In practice, these aspects are hard to calibrate for. In this letter, we propose a self-supervised method that learns a deconvolution network together with a physics-structured model of the point-spread function, requiring only the sonar data itself and the odometry of a moving robot on which the sensor is mounted. Using acoustic flow warping, the internal representation of the model is warped and subsequently rendered through the learned point-spread function. This is then compared to the measured images under a speckle likelihood in accordance with the statistical model of image formation. In simulation, the learned model recovers the unknown emitter directivity, and the deconvolved images reach a constant angular resolution of 5 to 6 degrees over the full field of view, against 12 to 30 degrees for delay-and-sum and 7 to 23 degrees for delay-multiply-and-sum with coherence factor. The method outperforms classical deconvolution with the nominal point-spread function, and even outperforms CLEAN with the true one.

eess.SP↗

BatSLAM 2.0: Sequence-Verified Sonar Place Recognition in a Robust Pose Graph

Echolocating bats can navigate dark and cluttered spaces using echolocation. Over a decade ago, BatSLAM showed that a robot with a biomimetic binaural sonar can build a topological map of the environment, by recognizing places from the received acoustic signals. Sonar place recognition, however, is ambiguous by nature: corridors produce nearly identical echo trains, and wrong loop closure can collapse the topological map. In this paper, we introduce BatSLAM 2.0, a novel sonar-only SLAM system built from three elements: an updated acoustic front-end, a sequence verifier that tracks and verifies loop closure candidates and a pose graph implemented on a high performance factor graph framework. The system was thoroughly evaluated both in simulated as well as real world recordings. In both cases, the BatSLAM2.0 algorithm shows the capability of robust topological map creation, countering map collapse, and robust scaling of map size.

cs.RO↗

ASVSim (AirSim for Surface Vehicles): A High-Fidelity Simulation Framework for Autonomous Surface Vehicle Research

The transport industry has recently shown significant interest in unmanned surface vehicles (USVs), specifically for port and inland waterway transport. These systems can improve operational efficiency and safety, which is especially relevant in the European Union, where initiatives such as the Green Deal are driving a shift towards increased use of inland waterways. At the same time, a shortage of qualified personnel is accelerating the adoption of autonomous solutions. However, there is a notable lack of open-source, high-fidelity simulation frameworks and datasets for developing and evaluating such solutions. To address these challenges, we introduce AirSim for Surface Vehicles (ASVSim), an open-source simulation framework specifically designed for autonomous shipping research in inland and port environments. The framework combines simulated vessel dynamics with marine sensor simulation capabilities, including radar and camera systems and supports the generation of synthetic datasets for training computer vision models and reinforcement learning (RL) agents. Built upon Cosys-AirSim, ASVSim provides a comprehensive platform for developing autonomous navigation algorithms and generating synthetic datasets. The simulator supports research of both traditional control methods and deep learning-based approaches. Through experiments in waterway segmentation and autonomous navigation, we demonstrate the capabilities of the simulator in these research areas. ASVSim is provided as an open-source project under the MIT license, making autonomous navigation research accessible to a larger part of the ocean engineering community. See https://github.com/BavoLesy/ASVSim.

cs.RO↗

Intelligent Road Condition Monitoring using 3D In-Air SONAR Sensing

In this paper, we investigate the capabilities of in-air 3D SONAR sensors for the monitoring of road surface conditions. Concretely, we consider two applications: Road material classification and Road damage detection and classification. While such tasks can be performed with other sensor modalities, such as camera sensors and LiDAR sensors, these sensor modalities tend to fail in harsh sensing conditions, such as heavy rain, smoke or fog. By using a sensing modality that is robust to such interference, we enable the creation of opportunistic sensing applications, where vehicles performing other tasks (garbage collection, mail delivery, etc.) can also be used to monitor the condition of the road. For these tasks, we use a single dataset, in which different types of damages are annotated, with labels including the material of the road surface. In the material classification task, we differentiate between three different road materials: Asphalt, Concrete and Element roads. In the damage detection and classification task, we determine if there is damage, and what type of damage (independent of material type), without localizing the damage. We are succesful in determining the road surface type from SONAR sensor data, with F1 scores approaching 90% on the test set, but find that for the detection of damages performace lags, with F1 score around 75%. From this, we conclude that SONAR sensing is a promising modality to include in opportunistic sensing-based pavement management systems, but that further research is needed to reach the desired accuracy.

cs.CV↗

LLM-Driven 3D Scene Generation of Agricultural Simulation Environments

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise but often lack domain-specific reasoning, verification mechanisms, and modular design. These limitations lead to reduced control and poor scalability. This paper investigates the use of LLMs to generate agricultural synthetic simulation environments from natural language prompts, specifically to address the limitations of lacking domain-specific reasoning, verification mechanisms, and modular design. A modular multi-LLM pipeline was developed, integrating 3D asset retrieval, domain knowledge injection, and code generation for the Unreal rendering engine using its API. This results in a 3D environment with realistic planting layouts and environmental context, all based on the input prompt and the domain knowledge. To enhance accuracy and scalability, the system employs a hybrid strategy combining LLM optimization techniques such as few-shot prompting, Retrieval-Augmented Generation (RAG), finetuning, and validation. Unlike monolithic models, the modular architecture enables structured data handling, intermediate verification, and flexible expansion. The system was evaluated using structured prompts and semantic accuracy metrics. A user study assessed realism and familiarity against real-world images, while an expert comparison demonstrated significant time savings over manual scene design. The results confirm the effectiveness of multi-LLM pipelines in automating domain-specific 3D scene generation with improved reliability and precision. Future work will explore expanding the asset hierarchy, incorporating real-time generation, and adapting the pipeline to other simulation domains beyond agriculture.

cs.CV↗

Delay-Multiply-And-Sum Beamforming for Real-Time In-Air Acoustic Imaging

In-air acoustic imaging systems demand beamforming techniques that offer a high dynamic range and spatial resolution while also remaining robust. Conventional Delay-and-Sum (DAS) beamforming fails to meet these quality demands due to high sidelobes, a wide main lobe and the resulting low contrast, whereas advanced adaptive methods are typically precluded by the computational cost and the single-snapshot constraint of real-time field operation. To overcome this trade-off, we propose and detail the implementation of higher-order non-linear beamforming methods using the Delay-Multiply-and-Sum technique, coupled with Coherence Factor weighting, specifically adapted for ultrasonic in-air microphone arrays. Our efficient implementation allows for enabling GPU-accelerated, real-time performance on embedded computing platforms. Through validation against the DAS baseline using simulated and real-world acoustic data, we demonstrate that the proposed method provides significant improvements in image contrast, establishing higher-order non-linear beamforming as a practical, high-performance solution for in-air acoustic imaging.

eess.SP↗

Ruggedized Ultrasound Sensing in Harsh Conditions: eRTIS in the wild

We present eRTIS, a rugged, embedded ultrasound sensing system for use in harsh industrial environments. The system features a broadband capacitive transducer and a 32-element MEMS microphone array capable of 2D and 3D beamforming. A modular hardware architecture separates sensing and processing tasks: a high-performance microcontroller handles excitation signal generation and data acquisition, while an NVIDIA Jetson module performs GPU-accelerated signal processing. eRTIS supports external synchronization via a custom controller that powers and coordinates up to six devices, either simultaneously or in a defined sequence. Additional synchronization options include bidirectional triggering and in-band signal injection. A sealed, anodized aluminum enclosure with passive cooling and IP-rated connectors ensures reliability in challenging conditions. Performance is demonstrated in three field scenarios: harbor mooring, off-road robotics, and autonomous navigation in cluttered environments, demonstrates that eRTIS provides robust sensing in situations where optical systems degrade.

eess.SY↗

Predictive Modeling of Maritime Radar Data Using Transformer Architecture

Maritime autonomous systems require robust predictive capabilities to anticipate vessel motion and environmental dynamics. While transformer architectures have revolutionized AIS-based trajectory prediction and demonstrated feasibility for sonar frame forecasting, their application to maritime radar frame prediction remains unexplored, creating a critical gap given radar's all-weather reliability for navigation. This survey systematically reviews predictive modeling approaches relevant to maritime radar, with emphasis on transformer architectures for spatiotemporal sequence forecasting, where existing representative methods are analyzed according to data type, architecture, and prediction horizon. Our review shows that, while the literature has demonstrated transformer-based frame prediction for sonar sensing, no prior work addresses transformer-based maritime radar frame prediction, thereby defining a clear research gap and motivating a concrete research direction for future work in this area.

cs.CV↗

LiDAR-BIND-T: Improved and Temporally Consistent Sensor Modality Translation and Fusion for Robotic Applications

This paper extends LiDAR-BIND, a modular multi-modal fusion framework that binds heterogeneous sensors (radar, sonar) to a LiDAR-defined latent space, with mechanisms that explicitly enforce temporal consistency. We introduce three contributions: (i) temporal embedding similarity that aligns consecutive latent representations, (ii) a motion-aligned transformation loss that matches displacement between predictions and ground truth LiDAR, and (iii) windowed temporal fusion using a specialised temporal module. We further update the model architecture to better preserve spatial structure. Evaluations on radar/sonar-to-LiDAR translation demonstrate improved temporal and spatial coherence, yielding lower absolute trajectory error and better occupancy map accuracy in Cartographer-based SLAM (Simultaneous Localisation and Mapping). We propose different metrics based on the Fréchet Video Motion Distance (FVMD) and a correlation-peak distance metric providing practical temporal quality indicators to evaluate SLAM performance. The proposed temporal LiDAR-BIND, or LiDAR-BIND-T, maintains modular modality fusion while substantially enhancing temporal stability, resulting in improved robustness and performance for downstream SLAM.

cs.CV↗

Towards In-Air Ultrasonic QR Codes: Deep Learning for Classification of Passive Reflector Constellations

In environments where visual sensors falter, in-air sonar provides a reliable alternative for autonomous systems. While previous research has successfully classified individual acoustic landmarks, this paper takes a step towards increasing information capacity by introducing reflector constellations as encoded tags. Our primary contribution is a multi-label Convolutional Neural Network (CNN) designed to simultaneously identify multiple, closely spaced reflectors from a single in-air 3D sonar measurement. Our initial findings on a small dataset confirm the feasibility of this approach, validating the ability to decode these complex acoustic patterns. Secondly, we investigated using adaptive beamforming with null-steering to isolate individual reflectors for single-label classification. Finally, we discuss the experimental results and limitations, offering key insights and future directions for developing acoustic landmark systems with significantly increased information entropy and their accurate and robust detection and classification.

eess.SP↗

Resource-Aware Neural Network Pruning Using Graph-based Reinforcement Learning

This paper presents a novel approach to neural network pruning by integrating a graph-based observation space into an AutoML framework to address the limitations of existing methods. Traditional pruning approaches often depend on hand-crafted heuristics and local optimization perspectives, which can lead to suboptimal performance and inefficient pruning strategies. Our framework transforms the pruning process by introducing a graph representation of the target neural network that captures complete topological relationships between layers and channels, replacing the limited layer-wise observation space with a global view of network structure. The core innovations include a Graph Attention Network (GAT) encoder that processes the network's graph representation and generates a rich embedding. Additionally, for the action space we transition from continuous pruning ratios to fine-grained binary action spaces which enables the agent to learn optimal channel importance criteria directly from data, moving away from predefined scoring functions. These contributions are modelled within a Constrained Markov Decision Process (CMDP) framework, allowing the agent to make informed pruning decisions while adhering to resource constraints such as target compression rates. For this, we design a self-competition reward system that encourages the agent to outperform its previous best performance while satisfying the defined constraints. We demonstrate the effectiveness of our approach through extensive experiments on benchmark datasets including CIFAR-10, CIFAR-100, and ImageNet. The experiments show that our method consistently outperforms traditional pruning techniques, showing state-of-the-art results while learning task-specific pruning strategies that identify functionally redundant connections beyond simple weight magnitude considerations.

cs.LG↗

High-Density MIMO Localization Using a 32x64 Ultrasonic Transducer-Microphone Array with Real-Time Data Streaming

In this work, we present a novel ultrasonic array system designed for high-precision localization using a large-scale MIMO (Multiple-Input Multiple-Output) architecture. The system combines 32 transmitters with 62 microphones, creating an extended virtual aperture that improves channel separability and spatial resolution. Each transmitter is excited by a random-phase multisine within the ultrasonic band, which reduces inter-channel correlation and increases robustness against multipath. The feasibility of the approach is demonstrated through simulations of reflector imaging and analysis of channel separation under realistic transducer bandwidth constraints. Results show that MIMO processing enables improved separation of reflectors compared to single-emitter configurations, although practical limitations such as transducer bandwidth reduce the achievable channel isolation.

eess.SP↗

nRTIS: Low-Cost Real-Time 3D Sonar Imaging Circular Array Supporting Beamforming for Industrial Applications

Conventional ultrasonic inspection systems rely on phased arrays and high-performance computing hardware, making them costly, bulky, and unsuitable for portable or embedded use. In this work, we present nRTIS (nano Real-Time 3D Imaging Sonar), a compact ultrasonic sensing platform built around a circular array of MEMS microphones and a central ultrasonic transducer. The device achieves real-time acquisition through an RP2350 microcontroller and high-speed USB transfer. We validate the system using both simulations and controlled experiments: point spread function (PSF) simulations demonstrate beamforming resolution and sidelobe suppression, while reflector measurements confirm robust data acquisition. These results highlight the potential of nRTIS for scalable industrial applications such as weld inspection, pipe mapping, and robotic navigation.

eess.SP↗

ConamArray: A 32-Element Broadband MEMS Ultrasound Transducer Array

This paper presents the ConamArray, a compact broadband ultrasound transducer array composed of 32 MEMS loudspeakers. Unlike conventional broadband transducers, which are typically large and require high driving voltages, the proposed array combines small form factor MEMS devices in a staggered two-row configuration to enable beam steering across a wide ultrasonic band. A dual-microcontroller back-end with synchronized multi-DAC outputs provides flexible waveform generation and runtime steering control. Both simulations and anechoic chamber measurements demonstrate that the ConamArray achieves stable beam steering, while also revealing the onset of grating lobes when steering to larger angles. These results confirm the feasibility of broadband beam steering using MEMS technology, opening new opportunities for applications in ultrasonic imaging, localization, and bio-inspired robotics.

eess.SY↗