SearcharxivSearch

arXiv subjects

Valerio Franchi

Publications and source records attributed to Valerio Franchi.

4 recordsLinked to original sources

Multi-Robot Scanner for Automated Full-Body Dermoscopic Imaging

This paper outlines the specifications and design approach used to construct a full body imaging scanner capable of capturing skin lesions at a dermatoscopic level using cameras mounted on the end-effectors of four UR10 manipulators. The system possesses a view-planning algorithm capable of appropriately selecting the best camera position to acquire images of moles, a high-level controller to allow the manipulators to work simultaneously and a collision-detector that halts the manipulators when they make contact with an object or a person. We evaluate the system through real-patient full-body scans, comparing acquired images against contact dermoscopy and an existing total-body photography system (Vectra) across clinically relevant lesion features, and quantify true optical resolving power using a USAF 1951 resolution target, yielding a smallest resolvable feature size of 22.1 microns for our scanner compared to 8.8 microns for contact dermoscopy. Results show the scanner consistently outperforms Vectra across most clinically relevant features and achieves comparable performance to contact dermoscopy for the majority of features assessed. By acquiring dermatoscopic-quality images automatically and without contact, and without requiring a separate manual dermoscopic examination, the scanner closes part of the gap between total-body photography and handheld dermoscopy, suggesting potential for future integration into screening workflows.

cs.RO

Geometric Correction of Side-Scan Sonar Images with Image-Consistent Attitude Refinement

Side-scan sonar (SSS) images are susceptible to motion-induced geometric distortion, which degrades their reliability for seabed interpretation and downstream tasks. Existing correction methods either exploit image-domain consistency without adequately preserving global geometric referencing, or rely on navigation-based geocoding whose effectiveness is limited when recorded attitude and motion fail to capture ping-scale perturbations. To address this issue, we propose a geometric correction method for SSS images with image-consistent attitude refinement. The core idea is to refine the yaw-pitch sequence used in geocoding by explicitly linking stripe-wise distortion patterns in dual-sided waterfall images to geometric deformation modes. Specifically, a navigation-derived macro-scale attitude baseline is fused with image-inferred microscopic perturbations, where port-starboard symmetry is used to separate pitch-related common-mode responses from yaw-related differential-mode responses. The refined attitude is then incorporated into a physically geocoding framework with track-aligned gridding and normalized-convolution-based hole completion to generate the corrected image. Experiments on real SSS datasets from different sonar platforms and environments show that the proposed method reduces inter-ping misalignment, local stretching, and structural discontinuity, and improves local geometric consistency under both degraded-attitude and cross-dataset evaluation settings, demonstrating its effectiveness for geometrically consistent SSS correction.

physics.ao-ph

Physically Motivated Knowledge Distillation for Blind Geometric Correction of Side-Scan Sonar Imagery

Side-scan sonar (SSS) imagery is susceptible to geometric distortions caused by platform motion instability, which degrade geometric consistency and limit downstream analyses such as mosaicking and perception. Conventional correction methods typically rely on navigation and attitude measurements, which are often unreliable in real ocean conditions. This unreliability necessitates blind geometric correction from a single distorted image, a highly ill-posed problem. To address this issue, we propose a physically motivated knowledge distillation framework for blind geometric correction of SSS imagery. Specifically, a teacher network is trained using paired distorted and geocoded reference images to learn distortion-related geometric differences, and this knowledge is transferred to a student network that performs correction using only a single distorted image during blind inference. To ensure physically plausible deformation estimation, we design a parametric decoder that represents distortions as row-wise affine transformations consistent with the SSS line-scanning imaging mechanism. To compensate for the absence of reference information during blind inference, a hallucination context module is introduced to approximate the teachers geometric reasoning from distorted features under a multi-level distillation scheme. In addition, a differentiable forward warping strategy is adopted to handle the non-bijective deformation characteristics of SSS imagery in an end-to-end manner. Extensive experiments on multiple datasets show that the proposed method outperforms state-of-the-art baselines and generalizes well across different platforms and acquisition conditions.

physics.ao-ph

BenthiCat: An opti-acoustic dataset for advancing benthic classification and habitat mapping

Benthic habitat mapping is fundamental for understanding marine ecosystems, guiding conservation efforts, and supporting sustainable resource management. Yet, the scarcity of large, annotated datasets limits the development and benchmarking of machine learning models in this domain. This paper introduces a thorough multi-modal dataset, comprising about a million side-scan sonar (SSS) tiles collected along the coast of Catalonia (Spain), complemented by bathymetric maps and a set of co-registered optical images from targeted surveys using an autonomous underwater vehicle (AUV). Approximately 36000 of the SSS tiles have been manually annotated with segmentation masks to enable supervised fine-tuning of classification models. All the raw sensor data, together with mosaics, are also released to support further exploration and algorithm development. To address challenges in multi-sensor data fusion for AUVs, we spatially associate optical images with corresponding SSS tiles, facilitating self-supervised, cross-modal representation learning. Accompanying open-source preprocessing and annotation tools are provided to enhance accessibility and encourage research. This resource aims to establish a standardized benchmark for underwater habitat mapping, promoting advancements in autonomous seafloor classification and multi-sensor integration.

cs.CV