SearcharxivSearch

arXiv subjects

Shengli Zhou

Publications and source records attributed to Shengli Zhou.

At least 19 recordsLinked to original sources

CAPruner: Conceptual-Adjacent Scene Graph Pruner for Enhancing 3D Spatial Reasoning of Large Language Models

Large language models (LLMs) have recently been applied to 3D vision-language (3D-VL) tasks, which require spatial reasoning to identify target objects relative to anchors. Scene graphs are commonly employed to represent such relations, but reasoning over complete graphs incurs high token costs and computational inefficiencies, motivating the need for pruning. Existing pruning methods primarily rely on spatial proximity and often remove task-relevant relations, thereby undermining reliable spatial reasoning. To address these limitations, we derive a key requirement for scene graph pruning: preserving spatial relations that are most pertinent to the specific 3D-VL task. Guided by this insight, we propose the Conceptual-Adjacent Scene Graph Pruner (CAPruner). CAPruner integrates fuzzy semantic relevance with spatial proximity to estimate the importance of relations, enabling the selection of critical relations in a task-specific context. Moreover, to avoid costly relation-level annotations, CAPruner is trained by supervising the aggregated scores of each node's incident edges. Extensive experiments demonstrate that CAPruner effectively preserves relations essential for spatial reasoning, leading to substantial performance improvements of LLMs on 3D-VL tasks. Code is available at https://github.com/fz-zsl/CAPruner.

cs.CL

Scalable Object Relation Encoding for Better 3D Spatial Reasoning in Large Language Models

Spatial reasoning focuses on locating target objects based on spatial relations in 3D scenes, which plays a crucial role in developing intelligent embodied agents. Due to the limited availability of 3D scene-language paired data, it is challenging to train models with strong reasoning ability from scratch. Previous approaches have attempted to inject 3D scene representations into the input space of Large Language Models (LLMs) and leverage the pretrained comprehension and reasoning abilities for spatial reasoning. However, models encoding absolute positions struggle to extract spatial relations from prematurely fused features, while methods explicitly encoding all spatial relations (which is quadratic in the number of objects) as input tokens suffer from poor scalability. To address these limitations, we propose QuatRoPE, a novel positional embedding method with an input length that is linear to the number of objects, and explicitly calculates pairwise spatial relations through the dot product in attention layers. QuatRoPE's holistic vector encoding of 3D coordinates guarantees a high degree of spatial consistency, maintaining fidelity to the scene's geometric integrity. Additionally, we introduce the Isolated Gated RoPE Extension (IGRE), which effectively limits QuatRoPE's influence to object-related tokens, thereby minimizing interference with the LLM's existing positional embeddings and maintaining the LLM's original capabilities. Extensive experiments demonstrate the effectiveness of our approaches. The code and data are available at https://github.com/oceanflowlab/QuatRoPE.

cs.CV

$\mathcal{P}^3$: Toward Versatile Embodied Agents

Embodied agents have demonstrated promising capabilities in interacting with physical environments. Yet, versatile embodied agents face three core bottlenecks: dynamic environmental perception, open tool access, and complex multi-task planning. Prior methods depend entirely on tool feedback to track scene changes and task progress, leading to poor real-time adaptability, error accumulation, and limited tool compatibility; multi-task scheduling is also understudied due to the difficulty of handling task dependencies and conflicting priorities. To address these limitations, we propose $\mathcal P^3$, a unified framework integrating real-time perception and dynamic scheduling, which perceives task-relevant information actively from the environment, plugs and utilizes tools without feedback requirements, and plans multi-task execution by prioritizing urgent tasks and dynamically adjusting task order based on dependencies. We additionally build the Active Task Perception (ATP) benchmark to quantitatively measure VLMs' capacity for active scene understanding and task proposal. Evaluations on the ATP benchmark verify that multiple VLMs can detect and propose active tasks, and comprehensive real-world robot experiments prove our method bridges the gap between benchmarks and practical deployment, yielding transferable general-purpose embodied agents. Code and data are available at https://github.com/fz-zsl/P3.

cs.RO

Learn 3D VQA Better with Active Selection and Reannotation

3D Visual Question Answering (3D VQA) is crucial for enabling models to perceive the physical world and perform spatial reasoning. In 3D VQA, the free-form nature of answers often leads to improper annotations that can confuse or mislead models when training on the entire dataset. While other text generation tasks can mitigate this issue by learning on large-scale datasets, the scarcity of 3D scene data enlarges the negative effect of misleading annotations. Although active learning strategies can select valuable instances for training, they fail to identify and resolve misleading labels, which the oracle inevitably provides in practice. To address this issue, we propose a multi-turn interactive active learning strategy. This strategy selects data based on models' semantic uncertainty to form a solid knowledge foundation more effectively and actively requests reannotation from an oracle to resolve potentially misleading labels. For uncertainty assessment, we utilize a variance-based metric that takes semantic relationships between terms into consideration, thus avoiding the uniform inter-class similarity assumption of previous assessment metrics. Extensive experiments exhibit better model performance and a substantial reduction in training costs, with a halving of training costs for achieving relatively high accuracy. The code is available at https://github.com/fz-zsl/AQuA.

cs.CV

HCNQA: Enhancing 3D VQA with Hierarchical Concentration Narrowing Supervision

3D Visual Question-Answering (3D VQA) is pivotal for models to perceive the physical world and perform spatial reasoning. Answer-centric supervision is a commonly used training method for 3D VQA models. Many models that utilize this strategy have achieved promising results in 3D VQA tasks. However, the answer-centric approach only supervises the final output of models and allows models to develop reasoning pathways freely. The absence of supervision on the reasoning pathway enables the potential for developing superficial shortcuts through common patterns in question-answer pairs. Moreover, although slow-thinking methods advance large language models, they suffer from underthinking. To address these issues, we propose \textbf{HCNQA}, a 3D VQA model leveraging a hierarchical concentration narrowing supervision method. By mimicking the human process of gradually focusing from a broad area to specific objects while searching for answers, our method guides the model to perform three phases of concentration narrowing through hierarchical supervision. By supervising key checkpoints on a general reasoning pathway, our method can ensure the development of a rational and effective reasoning pathway. Extensive experimental results demonstrate that our method can effectively ensure that the model develops a rational reasoning pathway and performs better. The code is available at https://github.com/JianuoZhu/HCNQA.

cs.CV

Parallax QAMA: Novel Downlink Multiple Access for MISO Systems with Simple Receivers

In this paper, we propose a novel downlink multiple access system with a multi-antenna transmitter and two single-antenna receivers, inspired by the underlying principles of hierarchical quadrature amplitude modulation (H-QAM) based multiple access (QAMA) and space-division multiple access (SDMA). In the proposed scheme, coded bits from two users are split and assigned to one shared symbol and two private symbols carried by different beams. Based on joint symbol mapping of H-QAM constellations and phase-aligned precoding at the transmitter, each receiver observes a different H-QAM constellation with Gray mapping, a unique parallax feature not shared by existing schemes. In addition to avoiding successive interference cancellation (SIC), each user independently demodulates its own bits on separate I and Q branches with calculations based on closed-form expressions. Hence the receiver complexity is on par with that of orthogonal multiple access (OMA), which is much lower than that in other competing alternatives such as non-orthogonal multiple access (NOMA) and rate-splitting multiple access (RSMA). We carry out system optimization and determine the achievable rate region. Numerical results show that the proposed system has a larger rate region relative to other benchmark schemes with receivers not using SIC, and even achieves a comparable rate region to those benchmark schemes with SIC receivers.

cs.IT

GR-WiFi: A GNU Radio based WiFi Platform with Single-User and Multi-User MIMO Capability

Since its first release, WiFi has been highly successful in providing wireless local area networks. The ever-evolving IEEE 802.11 standards continue to add new features to keep up with the trend of increasing numbers of mobile devices and the growth of Internet of Things (IoT) applications. Unfortunately, the lack of open-source IEEE 802.11 testbeds in the community limits the development and performance evaluation of those new features. Motivated by an existing popular open-source software-defined radio (SDR) package for single-user single-stream transmission based on the IEEE 802.11/a/g/p standard, in this paper we present GR-WiFi, an open-source package for single-user and multi-user multi-input multi-output (MIMO) transmissions based on 802.11n and 802.11ac standards. The distinct features of GR-WiFi include the support of parallel data streams to single or multiple users, and the compatible preamble processing to allow the co-existence of conventional, high-throughput (HT) and very-high-throughput (VHT) traffics. The performance of GR-WiFi is evaluated through both extensive simulation and real-world experiments.

cs.NI

Single-Frequency Self-Alignment RF Resonant Beam for Information and Power Transfer

Due to power attenuation, improving transmission efficiency in the radio-frequency (RF) band remains a significant challenge, which hinders advancements in various fields of the Internet of Things (IoT), such as wireless power transfer (WPT) and wireless communication. Array design and retro-directive beamforming (RD-BF) techniques offer simple and effective ways to enhance transmission efficiency. However, when the target is an array or in the near field, the RD-BF system (RD-BFS) cannot radiate more energy to the target due to phase irregularities in the target region, resulting in challenges in achieving higher efficiency. To address this issue, we propose the RF-based resonant beam system (RF-RBS), which adaptively optimizes phase and power distribution between transmitting and receiving arrays by leveraging the resonance mechanism to achieve higher transmission efficiency. We analyze the system structure and develop an analytical model to evaluate power flow and resonance establishment. Numerical analysis demonstrates that the proposed RF-RBS achieves self-alignment without beam control and provides higher transmission efficiency compared to RD-BFS, with improvements of up to 16%. This self-alignment capability allows the system to effectively transfer power and information across varying distances and offsets. The numerical results indicate the capability to transmit watt-level power and achieve 21 bps/Hz of downlink spectral efficiency in indoor settings, highlighting the advantages of RF-RBS in information and power transfer for mobile applications.

math.NA

Design and Performance of Resonant Beam Communications -- Part I: Quasi-Static Scenario

This two-part paper studies a point-to-point resonant beam communication (RBCom) system, where two separately deployed retroreflectors are adopted to generate the resonant beam between the transmitter and the receiver, and analyzes the transmission rate of the considered system under both the quasi-static and mobile scenarios. Part I of this paper focuses on the quasi-static scenario where the locations of the transmitter and the receiver are relatively fixed. Specifically, we propose a new information-bearing scheme which adopts a synchronization-based amplitude modulation method to mitigate the echo interference caused by the reflected resonant beam. With this scheme, we show that the quasi-static RBCom channel is equivalent to a Markov channel and can be further simplified as an amplitude-constrained additive white Gaussian noise channel. Moreover, we develop an algorithm that jointly employs the bisection and exhaustive search to maximize its capacity upper and lower bounds. Finally, numerical results validate our analysis. Part II of this paper discusses the performance of the RBCom system under the mobile scenario.

cs.IT

Design and Performance of Resonant Beam Communications -- Part II: Mobile Scenario

This two-part paper focuses on the system design and performance analysis for a point-to-point resonant beam communication (RBCom) system under both the quasi-static and mobile scenarios. Part I of this paper proposes a synchronization-based information transmission scheme and derives the capacity upper and lower bounds for the quasi-static channel case. In Part II, we address the mobile scenario, where the receiver is in relative motion to the transmitter, and derive a mobile RBCom channel model that jointly considers the Doppler effect, channel variation, and echo interference. With the obtained channel model, we prove that the channel gain of the mobile RBCom decreases as the number of transmitted frames increases, and thus show that the considered mobile RBCom terminates after the transmitter sends a certain number of frames without frequency compensation. By deriving an upper bound on the number of successfully transmitted frames, we formulate the throughput maximization problem for the considered mobile RBCom system, and solve it via a sequential parametric convex approximation (SPCA) method. Finally, simulation results validate the analysis of our proposed method in some typical scenarios.

cs.IT

Resonant Beam Communications: A New Design Paradigm and Challenges

Resonant beam communications (RBCom), which adopt oscillating photons between two separate retroreflectors for information transmission, exhibit potential advantages over other types of wireless optical communications (WOC). However, echo interference generated by the modulated beam reflected from the receiver affects the transmission of the desired information. To tackle this challenge, a synchronization-based point-to-point RBCom system is proposed to eliminate the echo interference, and the design for the transmitter and receiver is discussed. Subsequently, the performance of the proposed RBCom is evaluated and compared with that of visible light communications (VLC) and free space optical communications (FOC). Finally, future research directions are outlined and several implementation challenges of RBCom systems are highlighted.

cs.IT

Binocular Localization Using Resonant Beam

Locating mobile devices precisely in indoor scenarios is a challenging task because of the signal diffraction and reflection in complicated environments. One vital cause deteriorating the localization performance is the inevitable power dissipation along the propagation path of localization signals. In this paper, we propose a high-accuracy localization scheme based on the resonant beam system (RBS) and the binocular vision, i.e., binocular based resonant beam localization (BRBL). The BRBL system utilizes the energy-concentrated and self-aligned transmission of RBS to realize high-efficiency signal propagation and self-positioning for the target. The binocular method is combined with RBS to obtain the three-dimensional (3-D) coordinates of the target for the first time. To exhibit the localization mechanism, we first elaborate on the binocular localization model, including the resonant beam transmission analysis and the geometric derivation of the binocular method with RBS. Then, we establish the power model of RBS, and the signal and noise models of beam spot imaging, respectively, to analyse the performance of the BRBL system. Finally, the numerical results show an outstanding performance of centimeter level accuracy (i.e., $<5\mathrm{cm}$ in $0.4\mathrm{m}$ width and $0.4\mathrm{m}$ length effective range at $1\mathrm{m}$ vertical distance, $<13\mathrm{cm}$ in $0.6\mathrm{m}$ width and $0.6\mathrm{m}$ length effective range at $2\mathrm{m}$ vertical distance), which applies to indoor scenarios.

eess.SP

Transmission Model for Resonant Beam SWIPT with Telescope Internal Modulator

To satisfy the long-range and energy self-sustaining communication needs of electronic devices in the Internet of Things (IoT), we introduce a simultaneous wireless information and power transfer (SWIPT) system using the resonant beam that incorporates a telescope modulator inside a cavity for suppressing diffraction losses. We theoretically analyze power transfer in the resonant beam system with telescope internal modulator (TIM-RBS) considering the electromagnetic field propagation, the end-to-end (E2E) power transfer, and power and information reception. The numerical evaluation demonstrates that the TIM can effectively compress the beam spot, which allows the TIM-RBS to transmit energy twice as far as the RBS without TIM at higher power. Additionally, the largest transmission distance and maximum output power are proportional to the input power, and about 34m transmission distance, 4W electric power, and 12bps/Hz spectral efficiency can be achieved in the TIM-RBS with 200W input power. Hence, TIM-RBS can be considered as a promising option for realizing long-range, high-power, and high-rate SWIPT.

eess.SY

Performance of a High Power and Capacity Mobile SLIPT Scheme

The increasing demands of power supply and data rate for mobile devices promote the research of simultaneous wireless information and power transfer (SWIPT). Optical SWIPT, as known as simultaneous light information and power transfer (SLIPT), has the potential for providing high-capacity communication and high-power wireless charging. However, SLIPT technologies based on light-emitting diodes have low efficiency due to energy dissipation over the air. Laser-based SLIPT technologies need strict positioning accuracy and scanning resolution, which may lead to the increase of costs and complexity. In this paper, we propose a mobile SLIPT scheme based on spatially separated laser resonator (SSLR) and intra-cavity second harmonic generation. The power and data are transferred via separated frequencies, while they share the same self-aligned resonant beam path, without the needs of receiver positioning and beam steering. We establish the analysis model of the resonant beam power and its second harmonic power. Numerical results show that the proposed system can achieve watt-level battery charging power and above 10-bit/s/Hz achievable rate at 6-m distance, which satisfies the requirements of most indoor mobile devices.

eess.SP

Optimization of A Mobile Optical SWIPT System With Asymmetric Spatially Separated Laser Resonator

High-power and high-rate simultaneous wireless information and power transfer (SWIPT) becomes more and more important with the development of Internet of Things technologies. Optical SWIPT, also known as simultaneous light information and power transfer (SLIPT), has unique advantages such as abundant spectrum resources and low propagation divergence, compared with radio-frequency (RF) SWIPT. However, optical SWIPT faces many challenges in beam steering and receiver positioning/tracking. Resonant beams generated by spatially separated laser resonators (SSLR) have many advantages, including high power, self-aligned mobility, and intrinsic safety. It has been proposed as the carrier of wireless charging and communication. Using resonant beams, mobile electronic devices can be remotely charged and supported with high-rate data transfer. In this paper, we propose a mobile optical SWIPT system based on asymmetric SSLR and present the system optimization procedure. We also determine the boundary of the charging power and communication rate, and discuss the trade-off between power transfer and information transfer. Numerical results show that both the charging power and the communication rate of the optimized asymmetric system are much higher than those of the symmetric system in the previous work.

eess.SP

RT-WiFi on Software-Defined Radio: Design and Implementation

Applying high-speed real-time wireless technologies in industrial applications has the great potential to reduce the deployment and maintenance costs compared to their wired counterparts. Wireless technologies enhance the mobility and reduce the communication jitter and delay for mobile industrial equipment, such as mobile collaborative robots. Unfortunately, most existing wireless solutions employed in industrial fields either cannot support the desired high-speed communications or cannot guarantee deterministic, real-time performance. A more recent wireless technology, RT-WiFi, achieves a good balance between high-speed data rates and deterministic communication performance. It is however developed on commercial-of-the-shelf (COTS) hardware, and takes considerable effort and hardware expertise to maintain and upgrade. To address these problems, this paper introduces the software-defined radio (SDR)-based RT-WiFi solution which we call SRT-WiFi. SRT-WiFi provides full-stack configurability for high-speed real-time wireless communications. We present the overall system architecture of SRT-WiFi and discuss its key functions which achieve better timing performance and solve the queue management and rate adaptation issues compared to COTS hardware-based RT-WiFi. To achieve effective network management with rate adaptation in multi-cluster SRT-WiFi, a novel scheduling problem is formulated and an effective algorithm is proposed to solve the problem. A multi-cluster SRT-WiFi testbed is developed to validate the design, and extensive experiments are performed to evaluate the performance at both device and system levels.

cs.NI

Time-Domain Analysis for Resonant Beam Charging and Communications With Delay-Divide Demodulation

Laser has unique advantages such as abundant spectrum resources and low propagation divergence in wireless charging and wireless communications, compared with radio frequency. Resonant beams, as a kind of intra-cavity laser beams, have been proposed as the carrier of wireless charging and communication, as it has unique features including high power, intrinsic safety, and self-aligned mobility. However, this system has problems such as intra-cavity echo interference and power fluctuation. To study the time-domain behavior of the resonant beam system, we create a simulation algorithm by discretizing the laser rate equations which model the dynamics of the excited atom density in the gain medium and the photon density in the cavity. The simulation results are in good agreement with theoretical calculation. We also propose a delay-divide demodulation method to address the echo interference issue, and use the simulation algorithm to verify its feasibility. The results show that the resonant beam charging and communication system with the proposed demodulator is feasible and performs well. The analysis in this work also helps researchers to deeply understand the behavior of the resonant beam system.

eess.SP

Mobile Optical Communications Using Second Harmonic of Intra-Cavity Laser

Optical wireless communication (OWC) meets the demands of the future six-generation mobile network (6G) as it operates at several hundreds of Terahertz and has the potential to enable data rate in the order of Tbps. However, most beam steering OWC technologies require high-accuracy positioning and high-speed control. Resonant beam communication (RBCom), as one kind of non-positioning OWC technologies, has been proposed for high-rate mobile communications. The mobility of RBCom relies on its self-alignment characteristic where no positioning is required. In a previous study, an external-cavity second-harmonic-generation (SHG) RBCom system has been proposed for eliminating the echo interference inside the resonator. However, its energy conversion efficiency and complexity are of concern. In this paper, we propose an intra-cavity SHG RBCom system to simplify the system design and improve the energy conversion efficiency. We elaborate the system structure and establish an analytical model. Numerical results show that the energy consumption of the proposed intra-cavity design is reduced to reach the same level of channel capacity at the receiver compared with the external-cavity one.

eess.SP