SearcharxivSearch

arXiv subjects

Shuai Wan

Publications and source records attributed to Shuai Wan.

At least 19 recordsLinked to original sources

SPARE-GS: Structural Parsimony and Resource Efficiency for 3D Gaussian Splatting

3D Gaussian Splatting (3DGS) achieves high-fidelity novel view synthesis in real-time; however its training efficiency and representation compactness are hindered by excessive primitive proliferation. To address this challenge, we formulate the structural evolution of 3DGS as a global budget-constrained optimization problem and derive an optimality condition, which requires the marginal utility of structural resources to be balanced across spatial regions under a finite primitive budget. Based on this formulation, we propose SPARE-GS, a general plug-and-play framework that dynamically aligns the distribution of 3D Gaussian primitives with regional representational demand. SPARE-GS estimates capacity-normalized regional demand, assigns adaptive target quotas, and uses regional budget deviations to coordinate densification, pruning and adaptive termination toward a more balanced structural allocation. Extensive experiments across standard, accelerated, and structure-enhanced 3DGS pipelines demonstrate that SPARE-GS reduces the Gaussian count and training time by an average of 30.38% and 23.81%, respectively, while improving the average PSNR. Moreover, the resulting compact representations reduce downstream processing time and improve the rate-distortion performance of diverse compression and pruning methods, demonstrating the broad applicability of global structural budget regulation.

cs.CV

REFINE: Super-efficient 3D Gaussian Splatting Pruning via Rendering-Free Primitive Importance

Existing pruning methods for 3D Gaussian splatting (3DGS) suffer from either severe quality degradation or prohibitive computational overhead. In this paper, we propose REFINE, a highly accelerated 3DGS pruning framework centered on a novel rendering-free primitive importance metric. Our approach leverages an analytically approximated, rendering-aware Hessian field to quantify the expected perceptual error induced by the removal of individual primitives. By modeling the joint modulation of visibility, projection geometry and the content adaptive hyperparameter, we entirely bypass costly forward rendering passes and derive an anisotropic perceptual weight field that serves as a high-fidelity proxy for primitive importance. Extensive experiments across multiple benchmark datasets demonstrate that REFINE maintains highly competitive rendering quality while achieving a $3,000\times$ reduction in pruning-related computational complexity, translating to a practical $\sim 20\times$ speedup in device latency compared to state-of-the-art pruning methods.

cs.CV

An Object-Centered Data Acquisition Method for 3D Gaussian Splatting using Mobile Phones

Data acquisition through mobile phones remains a challenge for 3D Gaussian Splatting (3DGS). In this work we target the object-centered scenario and enable reliable mobile acquisition by providing on-device capture guidance and recording onboard sensor signals for offline reconstruction. After the calibration step, the device orientations are aligned to a baseline frame to obtain relative poses, and the optical axis of the camera is mapped to an object-centered spherical grid for uniform viewpoint indexing. To curb polar sampling bias, we compute area-weighted spherical coverage in real-time and guide the user's motion accordingly. We compare the proposed method with RealityScan and the free-capture strategy. Our method achieves superior reconstruction quality using fewer input images compared to free capture and RealityScan. Further analysis shows that the proposed method is able to obtain more comprehensive and uniform viewpoint coverage during object-centered acquisition.

cs.CV

Nonlinear Nanophotonic Chip-space Interfaces: On-chip Generation of Structured, Topological and Spatiotemporal Lights Via Nonlinear \v{C}erenkov Radiation

Miniaturized and reconfigurable interfaces between confined optical modes within integrated photonic chips and structured light propagating in free space would serve as a cornerstone for fundamental optical science and modern photonic technology. In this work, we exploit the anisotropic nonlinear susceptibility tensors associated with thin-film lithium niobate to construct nanophotonic chip-space interfaces capable of flexibly generating and multi-dimensionally engineering structured light via injections of photons to on-chip waveguides. By harnessing the nonlinear \v{C}erenkov radiation in integrated nonlinear microring resonators, we successfully tailor the spatial profile, polarization state, emission wavelength, topological charge and temporal wave packet of structured optical vortices, exhibiting reconfigurabilities and tuning ranges far beyond the state-of-the-art. To further showcase the capabilities of our platform, we use a single pump to generate tunable optical skyrmions via the spin-orbit coupling and multi-state integrated vortex microcombs in the visible range via synergistic $\chi^{(2)}$ and $\chi^{(3)}$ nonlinear optical processes. Our work bridges the research fields of structured light and integrated nonlinear optics, providing unprecedented opportunities for spatiotemporal light generation and on-chip multidimensional nonlinear optics.

physics.optics

Objective Quality Assessment of Point Clouds Using Multi-scale Implicit Structural Similarity

The unstructured and irregular nature of points poses a significant challenge for accurate point cloud quality assessment (PCQA), particularly in establishing accurate perceptual feature correspondence. To tackle this, we propose the Multi-scale Implicit Structural Similarity Measurement (MS-ISSM). Unlike traditional point-to-point matching, MS-ISSM utilizes radial basis function (RBF) to represent local features continuously, transforming distortion measurement into a comparison of implicit function coefficients. This approach effectively circumvents matching errors inherent in irregular data. Additionally, we propose a ResGrouped-MLP quality assessment network, which robustly maps multi-scale feature differences to perceptual scores. The network architecture departs from traditional flat multi-layer perceptron (MLP) by adopting a grouped encoding strategy integrated with residual blocks and channel-wise attention mechanisms. This hierarchical design allows the model to preserve the distinct physical semantics of luma, chroma, and geometry while adaptively focusing on the most salient distortion features across High, Medium, and Low scales. Experimental results on multiple benchmarks demonstrate that MS-ISSM outperforms state-of-the-art metrics in both reliability and generalization. The source code is available at: https://github.com/ZhangChen2022/MS-ISSM.

cs.CV

Nonclassical phonon pair

Quantum-correlated photon pairs are crucial resources for modern quantum information science. Similarly, the reliable generation of nonclassical phonon pairs is vital for advancing engineerable solid-state quantum devices and hybrid quantum networks based on phonons. Here, we present a novel approach to generate quantum-correlated phonon pairs in a suspended silicon microstructure initialized in its motional ground state. By simultaneously implementing red- and blue-detuned laser pulses, equivalent high-order optomechanical nonlinearity -- specifically, an effective optomechanical four-wave mixing process -- is achieved for generating a nonclassical phonon pair, which is then read out via a subsequent red-detuned pulse. We demonstrate the nonclassical nature of the generated phonon pair through the violation of the Cauchy-Schwarz inequality. Our experimentally observed phonon pair violates the classical bound by more than 5 standard deviations and maintains a decoherence time of 132 ns. This work reveals novel quantum manipulation of phonon states enabled by equivalent high-order optomechanical nonlinearity within a pulse scheme and provides a valuable quantum resource for mechanical quantum computing.

quant-ph

Rate-distortion Optimized Point Cloud Preprocessing for Geometry-based Point Cloud Compression

Geometry-based point cloud compression (G-PCC), an international standard designed by MPEG, provides a generic framework for compressing diverse types of point clouds while ensuring interoperability across applications and devices. However, G-PCC underperforms compared to recent deep learning-based PCC methods despite its lower computational power consumption. To enhance the efficiency of G-PCC without sacrificing its interoperability or computational flexibility, we propose a novel preprocessing framework that integrates a compression-oriented voxelization network with a differentiable G-PCC surrogate model, jointly optimized in the training phase. The surrogate model mimics the rate-distortion behaviour of the non-differentiable G-PCC codec, enabling end-to-end gradient propagation. The versatile voxelization network adaptively transforms input point clouds using learning-based voxelization and effectively manipulates point clouds via global scaling, fine-grained pruning, and point-level editing for rate-distortion trade-offs. During inference, only the lightweight voxelization network is appended to the G-PCC encoder, requiring no modifications to the decoder, thus introducing no computational overhead for end users. Extensive experiments demonstrate a 38.84% average BD-rate reduction over G-PCC. By bridging classical codecs with deep learning, this work offers a practical pathway to enhance legacy compression standards while preserving their backward compatibility, making it ideal for real-world deployment.

cs.CV

Photonic chip-based high-efficiency soliton microcombs via electroopitc-Kerr synergy

Temporal soliton mode-locking in coherently pumped microcavities provides a promising platform for miniaturized frequency comb systems. While significant progress has been made, achieving high conversion efficiency in such microcombs remains a critical challenge. Soliton generation through pulse pumping has emerged as an effective strategy to improve conversion efficiency. However, the on-chip integration of pulse generation with dissipative Kerr soliton (DKS) formation within the photonic chip has not yet been realized. In this work, we demonstrate a photonic chip-based soliton microcomb with high conversion efficiency, achieved by integrating on-chip pulse generation and DKS generation. The pulsed laser, fabricated on a lithium niobate-on-insulator (LNOI) platform, delivers a 35.5GHz repetition rate with broadly tunable center frequencies. By coupling these on-chip pulses to a silicon nitride microresonator, we achieve stable DKS generation with a pump-to-soliton conversion efficiency of 43.9% under steady-state conditions. This integrated architecture establishes a viable pathway toward chip-scale soliton microcombs with unprecedented efficiency, opening up new possibilities for optical communications, precision spectroscopy, and photonic sensing.

physics.optics

RBFIM: Perceptual Quality Assessment for Compressed Point Clouds Using Radial Basis Function Interpolation

One of the main challenges in point cloud compression (PCC) is how to evaluate the perceived distortion so that the codec can be optimized for perceptual quality. Current standard practices in PCC highlight a primary issue: while single-feature metrics are widely used to assess compression distortion, the classic method of searching point-to-point nearest neighbors frequently fails to adequately build precise correspondences between point clouds, resulting in an ineffective capture of human perceptual features. To overcome the related limitations, we propose a novel assessment method called RBFIM, utilizing radial basis function (RBF) interpolation to convert discrete point features into a continuous feature function for the distorted point cloud. By substituting the geometry coordinates of the original point cloud into the feature function, we obtain the bijective sets of point features. This enables an establishment of precise corresponding features between distorted and original point clouds and significantly improves the accuracy of quality assessments. Moreover, this method avoids the complexity caused by bidirectional searches. Extensive experiments on multiple subjective quality datasets of compressed point clouds demonstrate that our RBFIM excels in addressing human perception tasks, thereby providing robust support for PCC optimization efforts.

cs.CV

Stable Soliton Microcomb Generation in X-cut Lithium Tantalate via Thermal-Assisted Photorefractive Suppression

Chip-based soliton frequency microcombs combine compact size, broad bandwidth, and high coherence, presenting a promising solution for integrated optical telecommunications, precision sensing, and spectroscopy. Recent progress in ferroelectric thin films, particularly thin-film Lithium niobate (LN) and thin-film Lithium tantalate (LT), has significantly advanced electro-optic (EO) modulation and soliton microcombs generation, leveraging their strong third-order nonlinearity and high Pockels coefficients. However, achieving soliton frequency combs in X-cut ferroelectric materials remains challenging due to the competing effects of thermo-optic and photorefractive phenomena. These issues hinder the simultaneous realization of soliton generation and high-speed EO modulation. Here, following the thermal-regulated carrier behaviour and auxiliary-laser-assisted approach, we propose a convenient mechanism to suppress both photorefractive and thermal dragging effect at once, and implement a facile method for soliton formation and its long-term stabilization in integrated X-cut LT microresonators for the first time. The resulting mode-locked states exhibit robust stability against perturbations, enabling new pathways for fully integrated photonic circuits that combine Kerr nonlinearity with high-speed EO functionality.

physics.optics

Rendering-Oriented 3D Point Cloud Attribute Compression using Sparse Tensor-based Transformer

The evolution of 3D visualization techniques has fundamentally transformed how we interact with digital content. At the forefront of this change is point cloud technology, offering an immersive experience that surpasses traditional 2D representations. However, the massive data size of point clouds presents significant challenges in data compression. Current methods for lossy point cloud attribute compression (PCAC) generally focus on reconstructing the original point clouds with minimal error. However, for point cloud visualization scenarios, the reconstructed point clouds with distortion still need to undergo a complex rendering process, which affects the final user-perceived quality. In this paper, we propose an end-to-end deep learning framework that seamlessly integrates PCAC with differentiable rendering, denoted as rendering-oriented PCAC (RO-PCAC), directly targeting the quality of rendered multiview images for viewing. In a differentiable manner, the impact of the rendering process on the reconstructed point clouds is taken into account. Moreover, we characterize point clouds as sparse tensors and propose a sparse tensor-based transformer, called SP-Trans. By aligning with the local density of the point cloud and utilizing an enhanced local attention mechanism, SP-Trans captures the intricate relationships within the point cloud, further improving feature analysis and synthesis within the framework. Extensive experiments demonstrate that the proposed RO-PCAC achieves state-of-the-art compression performance, compared to existing reconstruction-oriented methods, including traditional, learning-based, and hybrid methods.

cs.MM

Construction of various time-dependent Hamiltonians on a single photonic chip

Integrated photonics provides an important platform for simulating physical models with high-performance chip-scale devices, where the lattice size and the time-dependence of a model are key ingredients for further enriching the functionality of a photonic chip. Here, we propose and demonstrate the construction of various time-dependent Hamiltonian models using a single microresonator on thin-film lithium niobate chip. Such an integrated microresonator holds high quality factor to 10^6, and supports the construction of the synthetic frequency lattice with effective lattice sites up to 152 under the electro-optic modulation. By further applying a bichromatic modulation composed of two radio-frequency signals oppositely detuned from the resonant frequency in the microresonator, we build different time-dependent Hamiltonians with the time-varying nearest-neighbor coupling strength in synthetic frequency lattice. We measure the temporal features from capturing the dynamic band structures of the lattice and demonstrate a variety of time-dependent synthetic lattice models by engineering the driven pattern of the modulation, highlighting great flexibility of the microresonator. Our work shows a photonic chip for simulating versatile time-dependent Hamiltonians, which pushes forward quantum simulations in integrated photonics with great experimental tunability and reconfigurability.

physics.optics

Self-locked broadband Raman-electro-optic microcomb

Optical frequency combs (OFCs), composed of equally spaced frequency tones, have spurred advancements in communications, spectroscopy, precision measurement and fundamental physics research. A prevalent method for generating OFCs involves the electro-optic (EO) effect, i.e., EO comb, renowned for its rapid tunability via precise microwave field control. Recent advances in integrated lithium niobate (LN) photonics have greatly enhanced the efficiency of EO effect, enabling the generation of broadband combs with reduced microwave power. However, parasitic nonlinear effects, such as Raman scattering and four-wave mixing, often emerge in high quality nonlinear devices, impeding the expansion of comb bandwidth and the minimization of frequency noise. Here, we tame these nonlinear effects and present a novel type of OFC, i.e., the self-locked Raman-electro-optic (REO) microcomb by leveraging the collaboration of EO, Kerr and Raman scattering processes. The spectral width of the REO microcomb benefits from the Raman gain and Kerr effect, encompassing nearly 1400 comb lines spanning over 300 nm with a fine repetition rate of 26.03 GHz, much larger than the pure EO combs. Remarkably, the system can maintain a self-locked low-noise state in the presence of multiple nonlinearities without the need for external active feedback. Our approach points to a direction for improving the performance of microcombs and paves the way for exploring new nonlinear physics, such as new laser locking techniques, through the collaboration of inevitable multiple nonlinear effects in integrated photonics.

physics.optics

Atom-referenced on-chip soliton microcomb

For the applications of the frequency comb in microresonators, it is essential to obtain a fully frequency-stabilized microcomb laser source. Here, we demonstrate an atom-referenced stabilized soliton microcomb generation system based on the integrated microring resonator. The pump light around $1560.48\,\mathrm{nm}$ locked to an ultra-low-expansion (ULE) cavity, is frequency-doubled and referenced to the atomic transition of $^{87}\mathrm{Rb}$. The repetition rate of the soliton microcomb is injection-locked to an atomic-clock-stabilized radio frequency (RF) source, leading to mHz stabilization at $1$ seconds. As a result, all comb lines have been frequency-stabilized based on the atomic reference and could be determined with very high precision reaching $\sim18\,\mathrm{Hz}$ at 1 second, corresponding to the frequency stability of $9.5\times10^{-14}$. Our approach provides an integrated and fully stabilized microcomb experiment scheme with no requirement of $f-2f$ technique, which could be easily implemented and generalized to various photonic platforms, thus paving the way towards the portable and ultraprecise optical sources for high precision spectroscopy.

physics.optics

Photorefraction-assisted self-emergence of dissipative Kerr solitons

Generated in high-Q optical microresonators, dissipative Kerr soliton microcombs constitute broadband optical frequency combs with chip sizes and repetition rates in the microwave to millimeter-wave range. For frequency metrology applications such as spectroscopy, optical atomic clocks and frequency synthesizers, octave-spanning soliton microcombs generated in dispersion optimized microresonator are required, which allow self-referencing for full frequency stabilization. In addition, field-deployable applications require the generation of such soliton microcombs simple, deterministic, and reproducible. Here, we demonstrate a novel scheme to generate self-emerging solitons in integrated lithium niobate microresonators. The single soliton features a broadband spectral bandwidth with dual dispersive waves, allowing 2f-3f self-referencing. Via harnessing the photorefractive effect of lithium niobate to significantly extend the soliton existence range, we observe a spontaneous yet deterministic single-soliton formation. The soliton is immune to external perturbation and can operate continuously over 13 hours without active feedback control. Finally, via integration with a pre-programed DFB laser, we demonstrate turnkey soliton generation. With further improvement of microresonator Q and hybrid integration with chip-scale laser chips, compact soliton microcomb devices with electronic actuation can be created, which can become central elements for future LiDAR, microwave photonics and optical telecommunications.

physics.optics

PeQuENet: Perceptual Quality Enhancement of Compressed Video with Adaptation- and Attention-based Network

In this paper we propose a generative adversarial network (GAN) framework to enhance the perceptual quality of compressed videos. Our framework includes attention and adaptation to different quantization parameters (QPs) in a single model. The attention module exploits global receptive fields that can capture and align long-range correlations between consecutive frames, which can be beneficial for enhancing perceptual quality of videos. The frame to be enhanced is fed into the deep network together with its neighboring frames, and in the first stage features at different depths are extracted. Then extracted features are fed into attention blocks to explore global temporal correlations, followed by a series of upsampling and convolution layers. Finally, the resulting features are processed by the QP-conditional adaptation module which leverages the corresponding QP information. In this way, a single model can be used to enhance adaptively to various QPs without requiring multiple models specific for every QP value, while having similar performance. Experimental results demonstrate the superior performance of the proposed PeQuENet compared with the state-of-the-art compressed video quality enhancement algorithms.

cs.CV

Slimmable Video Codec

Neural video compression has emerged as a novel paradigm combining trainable multilayer neural networks and machine learning, achieving competitive rate-distortion (RD) performances, but still remaining impractical due to heavy neural architectures, with large memory and computational demands. In addition, models are usually optimized for a single RD tradeoff. Recent slimmable image codecs can dynamically adjust their model capacity to gracefully reduce the memory and computation requirements, without harming RD performance. In this paper we propose a slimmable video codec (SlimVC), by integrating a slimmable temporal entropy model in a slimmable autoencoder. Despite a significantly more complex architecture, we show that slimming remains a powerful mechanism to control rate, memory footprint, computational cost and latency, all being important requirements for practical video compression.

eess.IV

DCNGAN: A Deformable Convolutional-Based GAN with QP Adaptation for Perceptual Quality Enhancement of Compressed Video

In this paper, we propose a deformable convolution-based generative adversarial network (DCNGAN) for perceptual quality enhancement of compressed videos. DCNGAN is also adaptive to the quantization parameters (QPs). Compared with optical flows, deformable convolutions are more effective and efficient to align frames. Deformable convolutions can operate on multiple frames, thus leveraging more temporal information, which is beneficial for enhancing the perceptual quality of compressed videos. Instead of aligning frames in a pairwise manner, the deformable convolution can process multiple frames simultaneously, which leads to lower computational complexity. Experimental results demonstrate that the proposed DCNGAN outperforms other state-of-the-art compressed video quality enhancement algorithms.

eess.IV