SearcharxivSearch

arXiv subjects

Joerg Widmer

Publications and source records attributed to Joerg Widmer.

At least 19 recordsLinked to original sources

Beyond Point Targets: Experimental Analysis of Frequency Anisotropy for Multi-band ISAC in FR3

As Integrated Sensing And Communication (ISAC) systems push toward higher sensing resolution, multi-band processing has emerged as a key enabler, with Frequency Range 3 (FR3) (7-24 GHz) standing out for its combination of wide bandwidth and favorable propagation. A common assumption underlying existing multi-band ISAC techniques is that targets behave as frequency-invariant point scatterers, enabling coherent combination of measurements across widely spaced subbands. However, this assumption does not hold over wide fractional bandwidths, since real objects exhibit frequency-dependent scattering mechanisms and migrating scattering centers. This paper provides the first systematic experimental characterization of the frequency anisotropy of everyday objects for ISAC, using channel measurements collected with a calibrated vector network analyzer over the 6-24 GHz band, across 10 objects and 120 viewpoints. We process bistatic channel impulse responses and synthetic aperture radar images to quantify multi-band coherence, extracting the real part of the cross-band correlation coefficient. Our results reveal complex, non-trivial coherence structures that vary substantially with object type and viewing angle, highlighting the need to account for frequency anisotropy in multi-band ISAC system design.

eess.SP

Hierarchical Coherent Imaging of Composite Anisotropic Moving Targets in ISAC

In Integrated Sensing and Communication (ISAC) networks, distributed devices can cooperate to produce radio images of the surrounding environment by exploiting phase-coherent signal processing. However, existing imaging methods are not well-suited for composite moving targets with multiple independently moving extended parts. This is due to simplistic isotropic scattering models and the lack of methods to compensate for distinct Doppler shifts from each component, which leads to image defocusing. We propose MOSAIC, the first hierarchical imaging method for composite moving targets using distributed User Equipments (UEs) and a single ISAC Base Station (BS). MOSAIC generates high-resolution images of each target part and estimates its velocity vector. Coherent imaging is performed within selected clusters of UEs observing a locally isotropic scattering from each part, while cluster-specific images are combined non-coherently across wide angles to improve the reconstruction. To mitigate Doppler-induced defocusing, Doppler components are pre-compensated before coherent imaging, turning a limitation into an additional means of resolving multiple target parts. This also enables low-complexity velocity estimation by associating Doppler frequencies across UEs. Simulations show over 50% improvement in image quality compared to existing methods, in terms of Wasserstein distance, and dm/s-level velocity estimation accuracy.

eess.SP

Estimating Target Doppler in Unsynchronized Multistatic ISAC Deployments with Mobile Nodes

Integrated Sensing And Communication (ISAC) is recognized as a key enabler for future 6th Generation (6G) networks, combining communication capabilities with pervasive sensing. In such systems, the estimation of the Doppler shift plays a crucial role for target characterization. However, typical real-world ISAC scenarios largely involve bistatic or multistatic configurations and mobile ISAC nodes. Under these conditions, Doppler estimation becomes particularly challenging, as clock asynchrony between the Transmitter (TX) and the Receivers (RXs), combined with their mobility, introduces additional Doppler components and phase offsets that distort or disrupt the target-induced frequency shift. Existing works have considered these challenges separately or relied on external reference reflectors. In this paper, we present the first method to estimate the Doppler frequency of a target with mobile and asynchronous ISAC nodes in a multistatic configuration, considering the case of a mobile TX and multiple static RXs, and without leveraging any external reflector. By leveraging the invariance of the phase offsets across multipath components and exploiting geometrical relationships, we show that the problem is solvable if at least 4 RXs are present. We evaluate the proposed solution through numerical simulations in various scenarios, showing that it is a valid approach for estimating target Doppler shifts in unsynchronized multistatic ISAC deployments with mobile nodes.

eess.SP

EgoLife: Towards Egocentric Life Assistant

We introduce EgoLife, a project to develop an egocentric life assistant that accompanies and enhances personal efficiency through AI-powered wearable glasses. To lay the foundation for this assistant, we conducted a comprehensive data collection study where six participants lived together for one week, continuously recording their daily activities - including discussions, shopping, cooking, socializing, and entertainment - using AI glasses for multimodal egocentric video capture, along with synchronized third-person-view video references. This effort resulted in the EgoLife Dataset, a comprehensive 300-hour egocentric, interpersonal, multiview, and multimodal daily life dataset with intensive annotation. Leveraging this dataset, we introduce EgoLifeQA, a suite of long-context, life-oriented question-answering tasks designed to provide meaningful assistance in daily life by addressing practical questions such as recalling past relevant events, monitoring health habits, and offering personalized recommendations. To address the key technical challenges of (1) developing robust visual-audio models for egocentric data, (2) enabling identity recognition, and (3) facilitating long-context question answering over extensive temporal information, we introduce EgoButler, an integrated system comprising EgoGPT and EgoRAG. EgoGPT is an omni-modal model trained on egocentric datasets, achieving state-of-the-art performance on egocentric video understanding. EgoRAG is a retrieval-based component that supports answering ultra-long-context questions. Our experimental studies verify their working mechanisms and reveal critical factors and bottlenecks, guiding future improvements. By releasing our datasets, models, and benchmarks, we aim to stimulate further research in egocentric AI assistants.

cs.CV

Compressed Sensing-Driven Near-Field Localization Exploiting Array of Subarrays

Near-field localization for ISAC requires large-aperture arrays, making fully-digital implementations prohibitively complex and costly. While sparse subarray architectures can reduce cost, they introduce severe estimation ambiguity from grating lobes. To address both issues, we propose SHARE (Sparse Hierarchical Angle-Range Estimation), a novel two-stage sparse recovery algorithm. SHARE operates in two stages. It first performs coarse, unambiguous angle estimation using individual subarrays to resolve the grating lobe ambiguity. It then leverages the full sparse aperture to perform a localized joint angle-range search. This hierarchical approach avoids an exhaustive and computationally intensive two-dimensional grid search while preserving the high resolution of the large aperture. Simulation results show that SHARE significantly outperforms conventional one-shot sparse recovery methods, such as Orthogonal Matching Pursuit (OMP), in both localization accuracy and robustness. Furthermore, we show that SHARE's overall localization accuracy is comparable to or even surpasses that of the fully-digital 2D-MUSIC algorithm, despite MUSIC having access to the complete, uncompressed data from every antenna element. SHARE therefore provides a practical path for high-resolution near-field ISAC systems.

eess.SP

SymbXRL: Symbolic Explainable Deep Reinforcement Learning for Mobile Networks

The operation of future 6th-generation (6G) mobile networks will increasingly rely on the ability of deep reinforcement learning (DRL) to optimize network decisions in real-time. DRL yields demonstrated efficacy in various resource allocation problems, such as joint decisions on user scheduling and antenna allocation or simultaneous control of computing resources and modulation. However, trained DRL agents are closed-boxes and inherently difficult to explain, which hinders their adoption in production settings. In this paper, we make a step towards removing this critical barrier by presenting SymbXRL, a novel technique for explainable reinforcement learning (XRL) that synthesizes human-interpretable explanations for DRL agents. SymbXRL leverages symbolic AI to produce explanations where key concepts and their relationships are described via intuitive symbols and rules; coupling such a representation with logical reasoning exposes the decision process of DRL agents and offers more comprehensible descriptions of their behaviors compared to existing approaches. We validate SymbXRL in practical network management use cases supported by DRL, proving that it not only improves the semantics of the explanations but also paves the way for explicit agent control: for instance, it enables intent-based programmatic action steering that improves by 12% the median cumulative reward over a pure DRL solution.

cs.NI

Spectrum & RAN Sharing: A Measurement-based Case Study of Commercial 5G Networks in Spain

Radio Access Network (RAN) sharing, which often also includes spectrum sharing, is a strategic cooperative agreement among two or more mobile operators, where one operator may use another's RAN infrastructure to provide mobile services to its users. By mutually sharing physical sites, radio elements, licensed spectrum and other parts of the RAN infrastructure, participating operators can significantly reduce the capital (and operational) expenditure in deploying and operating cellular networks, while accelerating coverage expansion -- thereby addressing the spectrum scarcity and infrastructure cost challenges in the 5G era and beyond. While the economic benefits of RAN sharing are well understood, the impact of such resource pooling on user-perceived performance remains underexplored, especially in real-world commercial deployments. We present, to the best of our knowledge, the first empirical measurement study of commercial 5G spectrum and RAN sharing. Our measurement study is unique in that, beyond identifying real-world instances of shared 5G spectrum and RAN deployment "in the wild", we also analyze users' perceived performance and its implication on Quality of Experience (QoE). Our study provides critical insights into resource management (i.e., pooling) and spectrum efficiency, offering a blueprint (and implications) for network evolution in 5G, 6G and beyond.

cs.NI

Millimeter-Scale Absolute Carrier Phase-Based Localization in Multi-Band Systems

Localization is a key feature of future Sixth Generation (6G) net-works with foreseen accuracy requirements down to the millimeter level, to enable novel applications in the fields of telesurgery, high-precision manufacturing, and others. Currently, such accuracy requirements are only achievable with specialized or highly resource-demanding systems, rendering them impractical for more wide-spread deployment. In this paper, we present the first system that enables low-complexity and low-bandwidth absolute 3D localization with millimeter-level accuracy in generic wireless networks. It performs a carrier phase-based wireless localization refinement of an initial location estimate based on successive location-likelihood optimization across multiple bands. Unlike previous phase unwrapping methods, our solution is one-shot. We evaluate its performance collecting ~350, 000 measurements, showing an improvement of more than one order of magnitude over classical localization techniques. Finally, we will open-source the low-cost, modular FR3 front-end that we developed for the experimental campaign.

eess.SP

Toward Multiband Sensing in FR3: Frequency Anisotropy Characterization and Non-Contiguous Bands Aggregation Algorithms

Frequency Range 3 (FR3) in the 7-24 GHz band will be the new spectrum for 6G wireless networks. The bandwidth availability and diversity of FR3 offer unprecedented opportunities for coherent multiband Integrated Sensing and Communications (ISAC), which aggregates the carrier phase information from multiple frequency bands to increase the sensing resolution to the cm-level. However, the frequency anisotropy of sensing targets over GHz-wide bands and the non-contiguity of the 6G spectrum, pose critical challenges to the application of existing multiband ISAC techniques. We present the first study on coherent multiband sensing in FR3. We experimentally characterize the frequency anisotropy of targets and propose new phase coherence metrics for multiband processing. Then, we analyze the impact of non-contiguous FR3 bands considered by 3GPP, and design a new algorithm to mitigate the resulting sensing artifacts, outperforming existing techniques. Our results represent a first step toward fully developing multiband ISAC for FR3.

eess.SP

mmHSense: Multi-Modal and Distributed mmWave ISAC Datasets for Human Sensing

This article presents mmHSense, a set of open labeled mmWave datasets to support human sensing research within Integrated Sensing and Communication (ISAC) systems. The datasets can be used to explore mmWave ISAC for various end applications such as gesture recognition, person identification, pose estimation, and localization. Moreover, the datasets can be used to develop and advance signal processing and deep learning research on mmWave ISAC. This article describes the testbed, experimental settings, and signal features for each dataset. Furthermore, the utility of the datasets is demonstrated through validation on a specific downstream task. In addition, we demonstrate the use of parameter-efficient fine-tuning to adapt ISAC models to different tasks, significantly reducing computational complexity while maintaining performance on prior tasks.

cs.CV

Exploring the Boundaries of On-Device Inference: When Tiny Falls Short, Go Hierarchical

On-device inference holds great potential for increased energy efficiency, responsiveness, and privacy in edge ML systems. However, due to less capable ML models that can be embedded in resource-limited devices, use cases are limited to simple inference tasks such as visual keyword spotting, gesture recognition, and predictive analytics. In this context, the Hierarchical Inference (HI) system has emerged as a promising solution that augments the capabilities of the local ML by offloading selected samples to an edge server or cloud for remote ML inference. Existing works demonstrate through simulation that HI improves accuracy. However, they do not account for the latency and energy consumption on the device, nor do they consider three key heterogeneous dimensions that characterize ML systems: hardware, network connectivity, and models. In contrast, this paper systematically compares the performance of HI with on-device inference based on measurements of accuracy, latency, and energy for running embedded ML models on five devices with different capabilities and three image classification datasets. For a given accuracy requirement, the HI systems we designed achieved up to 73% lower latency and up to 77% lower device energy consumption than an on-device inference system. The key to building an efficient HI system is the availability of small-size, reasonably accurate on-device models whose outputs can be effectively differentiated for samples that require remote inference. Despite the performance gains, HI requires on-device inference for all samples, which adds a fixed overhead to its latency and energy consumption. Therefore, we design a hybrid system, Early Exit with HI (EE-HI), and demonstrate that compared to HI, EE-HI reduces the latency by up to 59.7% and lowers the device's energy consumption by up to 60.4%.

cs.LG

DISC: a Dataset for Integrated Sensing and Communication in mmWave Systems

This paper presents DISC, a dataset of millimeter-wave channel impulse response measurements for integrated human activity sensing and communication. This is the first dataset collected with a software-defined radio testbed that transmits 60 GHz IEEE 802-11ay-compliant packets and estimates the channel response including scattered signals off the moving body parts of subjects moving in an indoor environment. The provided data consists of three parts, for more than 2 hours of channel measurements with high temporal resolution (0.27 ms inter-packet time). DISC contains the contribution of 7 subjects performing 5 different activities, and includes data collected from two distinct environments. Unlike available radar-based millimeter-wave sensing datasets, our measurements are collected using uniform packet transmission times and sparse traffic patterns from real Wi-Fi deployments. We develop, train, and release open-source baseline algorithms based on DISC to perform human sensing tasks. Our results demonstrate that DISC can serve as a multi-purpose benchmarking tool for machine learning-based human activity recognition, radio frequency gait analysis, and sparse sensing algorithms for next-generation integrated sensing and communications.

eess.SP

Opportunities and Challenges for Virtual Reality Streaming over Millimeter-Wave: An Experimental Analysis

Achieving extremely high-quality and truly immersive interactive Virtual Reality (VR) is expected to require a wireless link to the cloud, providing multi-gigabit throughput and extremely low latency. A prime candidate for fulfilling these requirements is millimeter-wave (mmWave) communications, operating in the 30 to 300 GHz bands, rather than the traditional sub-6 GHz. Evaluations with first-generation mmWave Wi-Fi hardware, based on the IEEE 802.11ad standard, have so far largely remained limited to lower-layer metrics. In this work, we present the first experimental analysis of the capabilities of mmWave for streaming VR content, using a novel testbed capable of repeatably creating blockage through mobility. Using this testbed, we show that (a) motion may briefly interrupt transmission, (b) a broken line of sight may degrade throughput unpredictably, and (c) TCP-based streaming frameworks need careful tuning to behave well over mmWave.

cs.NI

2D-AoI: Age-of-Information of Distributed Sensors for Spatio-Temporal Processes

The freshness of sensor data is critical for all types of cyber-physical systems. An established measure for quantifying data freshness is the Age-of-Information (AoI), which has been the subject of extensive research. Recently, there has been increased interest in multi-sensor systems: redundant sensors producing samples of the same physical process, sensors such as cameras producing overlapping views, or distributed sensors producing correlated samples. When the information from a particular sensor is outdated, fresh samples from other correlated sensors can be helpful. To quantify the utility of distant but correlated samples, we put forth a two-dimensional (2D) model of AoI that takes into account the sensor distance in an age-equivalent representation. Since we define 2D-AoI as equivalent to AoI, it can be readily linked to existing AoI research, especially on parallel systems. We consider physical phenomena modeled as spatio-temporal processes and derive the 2D-AoI for different Gaussian correlation kernels. For a basic exponential product kernel, we find that spatial distance causes an additive offset of the AoI, while for other kernels the effects of spatial distance are more complex and vary with time. Using our methodology, we evaluate the 2D-AoI of different spatial topologies and sensor densities.

cs.NI

HiSAC: High-Resolution Sensing with Multiband Communication Signals

Integrated Sensing And Communication (ISAC ) systems are expected to perform accurate radar sensing while having minimal impact on communication. Ideally, sensing should only reuse communication resources, especially for spectrum which is contended by many applications. However, this poses a great challenge in that communication systems often operate on narrow subbands with low sensing resolution. Combining contiguous subbands has shown significant resolution gain in active localization. However, multiband ISAC remains unexplored due to communication subbands being highly sparse (non-contiguous) and affected by phase offsets that prevent their aggregation (incoherent). To tackle these problems, we design HiSAC, the first multiband ISAC system that combines diverse subbands across a wide frequency range to achieve super-resolved passive ranging. To solve the non-contiguity and incoherence of subbands, HiSAC combines them progressively, exploiting an anchor propagation path between transmitter and receiver in an optimization problem to achieve phase coherence. HiSAC fully reuses pilot signals in communication systems, it applies to different frequencies and can combine diverse technologies, e.g., 5G-NR and WiGig. We implement HiSAC on an experimental platform in the millimeter-wave unlicensed band and test it on objects and humans. Our results show it enhances the sensing resolution by up to 20 times compared to single-band processing while occupying the same spectrum.

eess.SP

Fundamental Trade-Offs in Monostatic ISAC: A Holistic Investigation Towards 6G

This paper undertakes a holistic investigation of two fundamental trade-offs in monostatic OFDM integrated sensing and communication (ISAC) systems-namely, the time-frequency trade-off and the spatial trade-off, originating from the choice of modulation order for random data and the design of beamforming strategies, respectively. To counteract the elevated side-lobe levels induced by varying-amplitude data in high-order QAM signaling, we propose a novel linear minimum mean-squared-error (LMMSE) estimator, capable of maintaining robust sensing performance across a wide range of SNRs. Moreover, we explore spatial domain trade-offs through two ISAC transmission strategies: concurrent, employing joint beams, and time-sharing, using separate, time-non-overlapping beams for sensing and communications. Simulations demonstrate superior performance of the LMMSE estimator, especially in detecting weak targets in the presence of strong ones with high-order QAM, consistently yielding more favorable ISAC trade-offs than existing baselines under various modulation schemes, SNR conditions, RCS levels and transmission strategies. We also provide experimental results to validate the effectiveness of the LMMSE estimator in reducing side-lobe levels, based on real-world measurements.

eess.SP

RAPID: Retrofitting IEEE 802.11ay Access Points for Indoor Human Detection and Sensing

In this work we present RAPID, the first joint communication and radar system based on next-generation IEEE 802.11ay WiFi networks operating in the 60 GHz band. Unlike existing approaches for human sensing at millimeter-wave frequencies, which rely on special-purpose radars, RAPID achieves radar-level sensing accuracy with IEEE 802.11ay access points, thus avoiding the burden of installing ad-hoc sensors. RAPID enables contactless human sensing applications, such as people tracking, Human Activity Recognition (HAR), and person identification without requiring modifications to the standard packet structure. Specifically, we leverage IEEE 802.11ay beam training to accurately localize and track multiple individuals within the same environment. Then, we propose a new way of using beam tracking to extract micro-Doppler signatures from the time-varying Channel Impulse Response (CIR) estimated from reflected packets. Such signatures are fed to a deep learning classifier to perform HAR and person identification. RAPID is implemented on a cutting-edge IEEE 802.11ay-compatible FPGA platform with phased antenna arrays, and evaluated on a large dataset of CIR measurements. It is robust across different environments and subjects, and outperforms state-of-the-art sub-6 GHz WiFi sensing techniques. Using two access points, RAPID reliably tracks multiple subjects, reaching HAR and person identification accuracies of 94% and 90%, respectively.

eess.SP

Sensing in Bi-Static ISAC Systems with Clock Asynchronism: A Signal Processing Perspective

Integrated Sensing and Communication (ISAC) has been identified as a pillar usage scenario for the impending 6G era. Bi-static sensing, a major type of sensing in ISAC, is promising to expedite ISAC in the near future, as it requires minimal changes to the existing network infrastructure. However, a critical challenge for bi-static sensing is clock asynchronism due to the use of different clocks at far-separated transmitters and receivers. This causes the received signal to be affected by time-varying random phase offsets, severely degrading, or even failing, direct sensing. Hence, to effectively enable ISAC, considerable research has been directed toward addressing the clock asynchronism issue in bi-static sensing. This paper provides an overview of the issue and existing techniques developed in an ISAC background. Based on the review and comparison, we also draw insights into the future research directions and open problems, aiming to nurture the maturation of bi-static sensing in ISAC.

eess.SP