SearcharxivSearch

arXiv subjects

Songye Zhu

Publications and source records attributed to Songye Zhu.

3 recordsLinked to original sources

S$^2$GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devices

Streaming reconstruction of Free-Viewpoint Videos (FVVs) supports immersive Internet of Things (IoT) services, such as telepresence and digital twin visualization. Existing methods suffer from high per-frame optimization time and large storage footprints, limiting deployment on resource-constrained Edge-IoT devices. To address these challenges, we propose Structured Sparse Gaussian Streaming (S$^2$GS), an FVV reconstruction framework that exploits structure-aware temporal sparsity to selectively update Gaussian residuals, enabling efficient streaming without compromising visual fidelity. In the spatial domain, a streaming octree hierarchically organizes Gaussian residuals, capturing spatial correlations that guide residual updates. In the temporal domain, a structured gating mechanism, comprising hierarchical feature propagation (HFP) and Gumbel-Sigmoid sampling, converts hierarchical dynamic cues into sparse residual update decisions under differentiable optimization. A multi-level discrete scheme is further adopted to provide fine-grained control over residual updates while preserving intricate dynamic details. Extensive experiments across consumer GPUs, industrial edge IoT devices, and a physical telepresence testbed demonstrate that S$^2$GS consistently reduces per-frame optimization time and storage footprint while maintaining competitive visual quality. Compared with QUEEN, S$^2$GS reduces per-frame optimization time by 59% and storage costs by 85% on an RTX 4090 GPU. On the Jetson AGX Orin, S$^2$GS delivers the highest rendering throughput (60+ FPS) and the lowest energy consumption among the evaluated methods, demonstrating its potential for deployment in resource-constrained systems.

cs.CV

EMetaNode: Electromechanical Metamaterial Node for Broadband Vibration Attenuation and Self-powered Sensing

Recent advances in mechanical metamaterials and piezoelectric energy harvesting provide exciting opportunities to guide and convert the mechanical energy in electromechanical systems for autonomous sensing and vibration control. However, practical realizations remain rare due to the lack of advanced modeling methods and interdisciplinary barriers. By integrating mechanical metamaterials with power electronics-based interface circuits, this paper makes a breakthrough with an electromechanical friction-induced metamaterial node, which realizes self-powered sensing and broadband vibration attenuation in the same time. A reduced-order modeling-based numerical harmonic balance method has been established for general nonlinear metamaterials with local nonlinearities, significantly enhancing computational efficiency. The electromechanical friction induced by synchronized switching interface circuits has been revealed for the first time, leading to energy harvesting abilities and the broader nonlinear bandgap and higher harmonics induced vibration attenuation. Experimentally, an electromechanical metamaterial node is realized for self-powered sensing of temperature and acceleration data, highlighting its potential for structural health monitoring and Internet of Things applications. This study provides a practical path to digitalizing structures and systems for autonomous sensing and vibration control by combining advanced interface circuits with mechanical metamaterials.

physics.app-ph

Geometry-Consistent 4D Gaussian Splatting for Sparse-Input Dynamic View Synthesis

Gaussian Splatting has been considered as a novel way for view synthesis of dynamic scenes, which shows great potential in AIoT applications such as digital twins. However, recent dynamic Gaussian Splatting methods significantly degrade when only sparse input views are available, limiting their applicability in practice. The issue arises from the incoherent learning of 4D geometry as input views decrease. This paper presents GC-4DGS, a novel framework that infuses geometric consistency into 4D Gaussian Splatting (4DGS), offering real-time and high-quality dynamic scene rendering from sparse input views. While learning-based Multi-View Stereo (MVS) and monocular depth estimators (MDEs) provide geometry priors, directly integrating these with 4DGS yields suboptimal results due to the ill-posed nature of sparse-input 4D geometric optimization. To address these problems, we introduce a dynamic consistency checking strategy to reduce estimation uncertainties of MVS across spacetime. Furthermore, we propose a global-local depth regularization approach to distill spatiotemporal-consistent geometric information from monocular depths, thereby enhancing the coherent geometry and appearance learning within the 4D volume. Extensive experiments on the popular N3DV and Technicolor datasets validate the effectiveness of GC-4DGS in rendering quality without sacrificing efficiency. Notably, our method outperforms RF-DeRF, the latest dynamic radiance field tailored for sparse-input dynamic view synthesis, and the original 4DGS by 2.62dB and 1.58dB in PSNR, respectively, with seamless deployability on resource-constrained IoT edge devices.

cs.CV