Searcharxiv⌕ Search

arXiv · 2611.10516

An Overview on Multimodal Wireless and Visual Sensing for Environment Reconstruction: Opportunities and Challenges

Abstract

Physical-scene reconstruction through visual sensing and channel knowledge map (CKM) reconstruction through wireless sensing have attracted growing research interest but have largely evolved independently within the computer vision and wireless communications communities, respectively. When applied to the same physical environment, the two sensing modalities provide complementary observations. Visual sensing captures detailed scene geometry and appearance but is constrained by occlusion and poor lighting. Wireless sensing can provide information beyond visual line of sight regardless of lighting conditions, but its measurements are often sparse and difficult to associate with scene structures. These complementary strengths motivate a unified multimodal approach to physical-scene and CKM reconstruction. This paper provides an overview of such unified environment reconstruction through wireless and visual sensing. We first compare the capabilities and limitations of the two modalities and discuss potential applications that benefit from jointly reconstructing both targets. We then review two complementary research directions, namely wireless-assisted physical-scene reconstruction and vision-assisted CKM reconstruction, highlighting how each modality supports the reconstruction task associated with the other. Building on these perspectives, we discuss design principles for a joint representation that supports both targets and identify mutual refinement, in which each modality helps improve the reconstruction associated with the other. Finally, we discuss open challenges and future research directions, offering insights into developing site-specific environment models for sixth-generation (6G) and beyond networks.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Guanlin Wu, Chao Hu, Yilong Chen, Yudong Guo, Rongfei Fan, Juyong Zhang, Han Hu, Jie Xu. 2026-11-07. An Overview on Multimodal Wireless and Visual Sensing for Environment Reconstruction: Opportunities and Challenges. https://searcharxiv.com/abs/2611.10516

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Joint BS Deployment and Power Optimization for Minimum EMF Exposure with RL in Real-World Based Urban Scenario

Base station (BS) deployment remains a critical task with successive wireless communication generations and increasing data rates demands, while the electromagnetic field (EMF) exposure is often underrated. Therefore, this paper proposes a workflow that adjusts BS deployment and radiated power in a 3D urban scenario to jointly consider EMF exposure and coverage. To achieve this ambition, firstly, a novel least-time shoot-and-bounce ray (SBR) ray-launching (RL) tool is developed to improve computational efficiency, and simultaneously enhance diffraction modeling for accurate EMF exposure calculation, validated with real-world measurements. To efficiently extend the computation across the target urban area, the adaptive grid refinement (AGR) algorithm is designed based on the spatial stability of the effective channel while accounting for BS beamforming. Subsequently, to provide a more comprehensive evaluation of EMF exposure under practical network operations, a system-level abstraction further accounts for the actual maximum transmit power, intercell interference, and channel state information imperfection on the BS side, while capturing mobility over the EMF exposure averaging interval on the user equipment side. Upon the aforementioned aspects, the coverage-guaranteed EMF exposure minimization problem is formulated in a realistic and accurate manner, and solved by a geometry-aware algorithm that enables joint BS deployment and power optimization based on deterministic channel simulations under practical deployment constraints, completing the proposed workflow. Simulation results illustrate the application of the workflow in the considered urban scenario, while comparison with an empirical baseline highlights that the workflow mitigates EMF exposure underestimation and yields BS deployment configurations better aligned with real-world conditions.

eess.SP↗

From High-Level Communication Requirements to KPIs via Conformal Signal Temporal Logic Learning

Softwarized radio access networks (RANs), such as those based on the Open RAN (O-RAN) architecture, generate rich streams of key performance indicators (KPIs) that can be leveraged to extract actionable intelligence for network optimization. However, bridging the gap between low-level KPI measurements and high-level requirements, such as quality of experience (QoE), requires methods that are both relevant, capturing temporal patterns predictive of user-level outcomes, and interpretable, providing human-readable insights that operators can validate and act upon. This paper introduces conformal signal temporal logic learning (C-STLL), a framework that addresses both requirements. C-STLL leverages signal temporal logic (STL), a formal language for specifying temporal properties of time series, to learn from data interpretable formulas that characterize key properties of KPI traces satisfying high-level requirements. We first formulate the problem of reliably identifying an accurate STL formula as a risk-averse inference problem. We show that the optimal solution requires the construction of a set of STL formulas with formal coverage guarantees. Based on this theoretical insight, the proposed C-STLL extracts from calibration data a set of STL formulas with such guarantees via Learn Then Test, while also filtering for formula complexity and diversity. Experiments on a mobile gaming scenario in ns-3 and on KPI traces measured on a softwarized RAN testbed demonstrate that C-STLL effectively controls risk below target levels, while returning interpretable temporal specifications that relate KPI behavior to QoE outcomes.

eess.SP↗

Joint Synchronization and Radar Parameter Estimation for OFDM-based DISAC Systems

We propose a novel approach to the synchronization paradigm in distributed ISAC (DISAC) systems in doubly-dispersive (DD) channel environments via a joint synchronization and radar parameter estimation framework. The proposed method exploits the structure of the system model, which can be linearized in order to apply a bivariate Gaussian belief propagation (GaBP) algorithm that jointly estimates the time offset (TO) and carrier frequency offset (CFO) of each base station (BS), as well as the delay and Doppler parameters of the DD channel in conventional orthogonal frequency division multiplexing (OFDM) systems. Simulation results demonstrate the effectiveness of the proposed algorithm, showing that the radar parameter estimates (i.e., range and velocity) and synchronization parameter estimates (i.e., TO and CFO) approach the Cramér Rao lower bound (CRLB) even at moderate-to-high signal-to-noise ratio (SNR) regimes.

eess.SP↗