Searcharxiv⌕ Search

arXiv subjects

Yuan Ren

Publications and source records attributed to Yuan Ren.

At least 37 records · Page 2Linked to original sources
arXiv2025

A Time- and Energy-Efficient CNN with Dense Connections on Memristor-Based Chips

Designing lightweight convolutional neural network (CNN) models is an active research area in edge AI. Compute-in-memory (CIM) provides a new computing paradigm to alleviate time and energy consumption caused by data transfer in von Neumann architecture. Among competing alternatives, resistive random-access memory (RRAM) is a promising CIM device owing to its reliability and multi-bit programmability. However, classical lightweight designs such as depthwise convolution incurs under-utilization of RRAM crossbars restricted by their inherently dense weight-to-RRAM cell mapping. To build an RRAM-friendly yet efficient CNN, we evaluate the hardware cost of DenseNet which maintains a high accuracy vs other CNNs at a small parameter count. Observing the linearly increasing channels in DenseNet leads to a low crossbar utilization and causes large latency and energy consumption, we propose a scheme that concatenates feature maps of front layers to form the input of the last layer in each stage. Experiments show that our proposed model consumes less time and energy than conventional ResNet and DenseNet, while producing competitive accuracy on CIFAR and ImageNet datasets.

cs.AR↗
arXiv2025

Monolithically Integrated Optical Convolutional Processors on Thin Film Lithium Niobate

Photonic neural networks (PNNs) of sufficiently large physical dimensions and high operation accuracies are envisaged as an ideal candidate for breaking the major bottlenecks in the current artificial intelligence architectures in terms of latency, energy efficiency and computational power. To achieve this vision, it is of vital importance to scale up the PNNs and in the meantime reduce the high demand on the dimensions required by the PNNs. The underlying cause of this strategy is the enormous gap between the scales of photonic and electronic integrated circuits. Here, we demonstrate monolithically integrated optical convolutional processors on thin film lithium niobate (TFLN) to enable large-scale programmable convolution kernels and in turn greatly reduce the dimensions required by the subsequent fully connected layers. Experimental validation achieves high classification accuracies of 96%/86% on the MNIST/Fashion-MNIST datasets and 84.6% on the AG News dataset, while dramatically reducing the required subsequent fully connected layer dimensions to 196x10 (from 784x10) and 175x4 (from 800x4), respectively. Furthermore, our devices can be driven by commercial field-programmable gate array (FPGA) systems, a unique advantage in addition to their scalable channel number and kernel size, our architecture provides a solution to build practical machine learning photonic devices.

physics.optics↗
arXiv2025

On the Hulls of Group Codes

Let $\mathbb {F}_q$ be a finite field and $G$ a finte group with $(|G|,q)=1$. By a group code in $\mathbb {F}_q[G]$ we mean a two-sided ideal in $\mathbb {F}_q[G]$. We will prove a general criterion for the existence of group codes with given hull dimension, and then apply it to deduce explicit criterions for existence of group codes with hull dimension $\leq3$. In particular our criterion for the existence of $1$-dimensional hulls generalizes that of privious work which consider only abelian groups $G$.

cs.IT↗
arXiv2025

One-time measurement to characterize complex amplitude single component in symmetry superposed optical vortices

Complex amplitude measurement is an essential prerequisite for light field characterization. In this work, we propose a one-time measurement method to characterize the complex amplitude of symmetry superposed optical vortices (SSOVs) with only one picture registered by CCD. This method includes two strategies we proposed. One is the ring extraction strategy for amplitude measurement, and another is the rotational measurement strategy for phase measurement. In the proof-of-concept experiment, the complex amplitude is characterized, and the mode purity is well measured. This method has excellent flexibility, rapidity, and robustness, which can be applied to various occasions and harsh conditions. Careful alignment and optimized error analysis allow us to generate and measure a single component with mode purity as high as 99.99%.

physics.optics↗
arXiv2025

Response to recent comments on Phys. Rev. B 107, 245423 (2023) and Subsection S4.3 of the Supp. Info. for Nature 638, 651-655 (2025)

The topological gap protocol (TGP) is a statistical test designed to identify a topological phase with high confidence and without human bias. It is used to determine a promising parameter regime for operating topological qubits. The protocol's key metric is the probability of incorrectly identifying a trivial region as topological, referred to as the false discovery rate (FDR). Two recent manuscripts [arXiv:2502.19560, arXiv:2503.08944] engage with the topological gap protocol and its use in Phys. Rev. B 107, 245423 (2023) and Subsection S4.3 of the Supplementary Information for Nature 638, 651-655 (2025), although they do not explicitly dispute the main results of either one. We demonstrate that the objections in arXiv:2502.19560 and arXiv:2503.08944 are unfounded, and we uphold the conclusions of Phys. Rev. B 107, 245423 (2023) and Nature 638, 651-655 (2025). Specifically, we show that no flaws have been identified in our estimate of the false discovery rate (FDR). We provide a point-by-point rebuttal of the comments in arXiv:2502.19560 and arXiv:2503.08944.

cond-mat.mes-hall↗
arXiv2025

3DArticCyclists: Generating Synthetic Articulated 8D Pose-Controllable Cyclist Data for Computer Vision Applications

In Autonomous Driving (AD) Perception, cyclists are considered safety-critical scene objects. Commonly used publicly-available AD datasets typically contain large amounts of car and vehicle object instances but a low number of cyclist instances, usually with limited appearance and pose diversity. This cyclist training data scarcity problem not only limits the generalization of deep-learning perception models for cyclist semantic segmentation, pose estimation, and cyclist crossing intention prediction, but also limits research on new cyclist-related tasks such as fine-grained cyclist pose estimation and spatio-temporal analysis under complex interactions between humans and articulated objects. To address this data scarcity problem, in this paper we propose a framework to generate synthetic dynamic 3D cyclist data assets that can be used to generate training data for different tasks. In our framework, we designed a methodology for creating a new part-based multi-view articulated synthetic 3D bicycle dataset that we call 3DArticBikes that we use to train a 3D Gaussian Splatting (3DGS)-based reconstruction and image rendering method. We then propose a parametric bicycle 3DGS composition model to assemble 8-DoF pose-controllable 3D bicycles. Finally, using dynamic information from cyclist videos, we build a complete synthetic dynamic 3D cyclist (rider pedaling a bicycle) by re-posing a selectable synthetic 3D person, while automatically placing the rider onto one of our new articulated 3D bicycles using a proposed 3D Keypoint optimization-based Inverse Kinematics pose refinement. We present both, qualitative and quantitative results where we compare our generated cyclists against those from a recent stable diffusion-based method.

cs.CV↗
arXiv2025

HIPPo: Harnessing Image-to-3D Priors for Model-free Zero-shot 6D Pose Estimation

This work focuses on model-free zero-shot 6D object pose estimation for robotics applications. While existing methods can estimate the precise 6D pose of objects, they heavily rely on curated CAD models or reference images, the preparation of which is a time-consuming and labor-intensive process. Moreover, in real-world scenarios, 3D models or reference images may not be available in advance and instant robot reaction is desired. In this work, we propose a novel framework named HIPPo, which eliminates the need for curated CAD models and reference images by harnessing image-to-3D priors from Diffusion Models, enabling model-free zero-shot 6D pose estimation. Specifically, we construct HIPPo Dreamer, a rapid image-to-mesh model built on a multiview Diffusion Model and a 3D reconstruction foundation model. Our HIPPo Dreamer can generate a 3D mesh of any unseen objects from a single glance in just a few seconds. Then, as more observations are acquired, we propose to continuously refine the diffusion prior mesh model by joint optimization of object geometry and appearance. This is achieved by a measurement-guided scheme that gradually replaces the plausible diffusion priors with more reliable online observations. Consequently, HIPPo can instantly estimate and track the 6D pose of a novel object and maintain a complete mesh for immediate robotic applications. Thorough experiments on various benchmarks show that HIPPo outperforms state-of-the-art methods in 6D object pose estimation when prior reference images are limited.

cs.CV↗
arXiv2025

Learning Effective NeRFs and SDFs Representations with 3D Generative Adversarial Networks for 3D Object Generation

We present a solution for 3D object generation of ICCV 2023 OmniObject3D Challenge. In recent years, 3D object generation has made great process and achieved promising results, but it remains a challenging task due to the difficulty of generating complex, textured, and high-fidelity results. To resolve this problem, we study learning effective NeRFs and SDFs representations with 3D Generative Adversarial Networks (GANs) for 3D object generation. Specifically, inspired by recent works, we use the efficient geometry-aware 3D GANs as the backbone incorporating with label embedding and color mapping, which enables to train the model on different taxonomies simultaneously. Then, through a decoder, we aggregate the resulting features to generate Neural Radiance Fields (NeRFs) based representations for rendering high-fidelity synthetic images. Meanwhile, we optimize Signed Distance Functions (SDFs) to effectively represent objects with 3D meshes. Besides, we observe that this model can be effectively trained with only a few images of each object from a variety of classes, instead of using a great number of images per object or training one model per class. With this pipeline, we can optimize an effective model for 3D object generation. This solution is among the top 3 in the ICCV 2023 OmniObject3D Challenge.

cs.CV↗
arXiv2025

Observation of condensed moire exciton polaritons in twisted photonic lattices at room temperature

Moire lattices attract significant attention in double-layer graphene and TMD layer heterostructures as well as in photonic crystals due to the interesting exotic physics that emerges within these structures. However, direct measurement of the moiré ground, excited states and Bloch bands in twisted photonic lattices is still illusive. In this work we report strong coupling between excitons in CsPbBr3 microplates and moire photonic modes at room temperature. Depending on the coupling strength between the nearest potential sites, we observe staggered moire polariton ground states, excited states and moire polariton bands. Phase locked moire zero (in-phase) states and moire pi (antiphase) states with different spatial distributions are measured. The moire polariton distribution can be tuned into the shape of a parallelogram by controlling the depth and width of the potential in one photonic lattice with another superimposed one fixed. In addition, moire polaritons in twisted 2D honeycomb lattices are also observed. Increasing the pumping density, we realize exciton polariton condensation in the moire potential sites of the 1D/2D twisted lattices with the coherence time of around 1.4 ps. Our work lays the foundation to study coherent moire polariton condensation in twisted photonic lattices at room temperature.

physics.optics↗
arXiv2025

Oblique rotational axis detection using elliptical optical vortex based on rotational Doppler effect

The rotational Doppler effect (RDE) of structured light carrying orbital angular momentum (OAM) has attracted widespread attention for applications in optical sensors and OAM spectrum detection. These studies, however, based on RDE, are mostly focused on the motion parameters of rotating objects; other equally important attitude characteristics, e.g., the tilt angle of the axis of rotation, have rarely been considered. We observed an interesting phenomenon in the experiments: the rotational Doppler spectral distribution varies with the ellipticity of the elliptical optical vortex (EOV) and the tilt angle between the rotational axis and optical axis, which inspired us to wonder if it is possible to detect oblique rotational axis or compensate the rotational Doppler broadening effect induced by oblique incidence by utilizing the EOV. Here, we reveal the RDE quantitative relationship with tilt angle and ellipticity for the first time and report a novel approach for tilt angle measurement. By employing a series of EOV with periodically varying ellipticity to illuminate a rotating object and analyze the time-frequency spectral distribution of scattered light associated with ellipticity and tilt angle, the tilt angle can be acquired accurately based on the specific relationship between the tilt angle and ellipticity of the EOV. Furthermore, the spectrum broadening effect arising from oblique incidence in the actual scenario may be addressed through our scheme. The method may find applications in industrial manufacturing and target attitude measurement, and our results provide new insights for obtaining more information about objects.

physics.optics↗
arXiv2024

Uplifting Range-View-based 3D Semantic Segmentation in Real-Time with Multi-Sensor Fusion

Range-View(RV)-based 3D point cloud segmentation is widely adopted due to its compact data form. However, RV-based methods fall short in providing robust segmentation for the occluded points and suffer from distortion of projected RGB images due to the sparse nature of 3D point clouds. To alleviate these problems, we propose a new LiDAR and Camera Range-view-based 3D point cloud semantic segmentation method (LaCRange). Specifically, a distortion-compensating knowledge distillation (DCKD) strategy is designed to remedy the adverse effect of RV projection of RGB images. Moreover, a context-based feature fusion module is introduced for robust and preservative sensor fusion. Finally, in order to address the limited resolution of RV and its insufficiency of 3D topology, a new point refinement scheme is devised for proper aggregation of features in 2D and augmentation of point features in 3D. We evaluated the proposed method on large-scale autonomous driving datasets \ie SemanticKITTI and nuScenes. In addition to being real-time, the proposed method achieves state-of-the-art results on nuScenes benchmark

cs.CV↗
arXiv2024

VQA-Diff: Exploiting VQA and Diffusion for Zero-Shot Image-to-3D Vehicle Asset Generation in Autonomous Driving

Generating 3D vehicle assets from in-the-wild observations is crucial to autonomous driving. Existing image-to-3D methods cannot well address this problem because they learn generation merely from image RGB information without a deeper understanding of in-the-wild vehicles (such as car models, manufacturers, etc.). This leads to their poor zero-shot prediction capability to handle real-world observations with occlusion or tricky viewing angles. To solve this problem, in this work, we propose VQA-Diff, a novel framework that leverages in-the-wild vehicle images to create photorealistic 3D vehicle assets for autonomous driving. VQA-Diff exploits the real-world knowledge inherited from the Large Language Model in the Visual Question Answering (VQA) model for robust zero-shot prediction and the rich image prior knowledge in the Diffusion model for structure and appearance generation. In particular, we utilize a multi-expert Diffusion Models strategy to generate the structure information and employ a subject-driven structure-controlled generation mechanism to model appearance information. As a result, without the necessity to learn from a large-scale image-to-3D vehicle dataset collected from the real world, VQA-Diff still has a robust zero-shot image-to-novel-view generation ability. We conduct experiments on various datasets, including Pascal 3D+, Waymo, and Objaverse, to demonstrate that VQA-Diff outperforms existing state-of-the-art methods both qualitatively and quantitatively.

cs.CV↗
arXiv2024

AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstruction

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but struggles with modeling driving scenarios due to complex backgrounds, dynamic objects, and sparse views. We propose AutoSplat, a framework employing Gaussian splatting to achieve highly realistic reconstructions of autonomous driving scenes. By imposing geometric constraints on Gaussians representing the road and sky regions, our method enables multi-view consistent simulation of challenging scenarios including lane changes. Leveraging 3D templates, we introduce a reflected Gaussian consistency constraint to supervise both the visible and unseen side of foreground objects. Moreover, to model the dynamic appearance of foreground objects, we estimate residual spherical harmonics for each foreground Gaussian. Extensive experiments on Pandaset and KITTI demonstrate that AutoSplat outperforms state-of-the-art methods in scene reconstruction and novel view synthesis across diverse driving scenarios. Visit our project page at https://autosplat.github.io/.

cs.CV↗
arXiv2024

Photonic Neural Network Fabricated on Thin Film Lithium Niobate for High-Fidelity and Power-Efficient Matrix Computation

Photonic neural networks (PNNs) have emerged as a promising platform to address the energy consumption issue that comes with the advancement of artificial intelligence technology, and thin film lithium niobate (TFLN) offers an attractive solution as a material platform mainly for its combined characteristics of low optical loss and large electro-optic (EO) coefficients. Here, we present the first implementation of an EO tunable PNN based on the TFLN platform. Our device features ultra-high fidelity, high computation speed, and exceptional power efficiency. We benchmark the performance of our device with several deep learning missions including in-situ training of Circle and Moons nonlinear datasets classification, Iris flower species recognition, and handwriting digits recognition. Our work paves the way for sustainable up-scaling of high-speed, energy-efficient PNNs.

physics.optics↗
arXiv2024

Outlier-Aware Training for Low-Bit Quantization of Structural Re-Parameterized Networks

Lightweight design of Convolutional Neural Networks (CNNs) requires co-design efforts in the model architectures and compression techniques. As a novel design paradigm that separates training and inference, a structural re-parameterized (SR) network such as the representative RepVGG revitalizes the simple VGG-like network with a high accuracy comparable to advanced and often more complicated networks. However, the merging process in SR networks introduces outliers into weights, making their distribution distinct from conventional networks and thus heightening difficulties in quantization. To address this, we propose an operator-level improvement for training called Outlier Aware Batch Normalization (OABN). Additionally, to meet the demands of limited bitwidths while upkeeping the inference accuracy, we develop a clustering-based non-uniform quantization framework for Quantization-Aware Training (QAT) named ClusterQAT. Integrating OABN with ClusterQAT, the quantized performance of RepVGG is largely enhanced, particularly when the bitwidth falls below 8.

cs.CV↗
arXiv2023

MV-DeepSDF: Implicit Modeling with Multi-Sweep Point Clouds for 3D Vehicle Reconstruction in Autonomous Driving

Reconstructing 3D vehicles from noisy and sparse partial point clouds is of great significance to autonomous driving. Most existing 3D reconstruction methods cannot be directly applied to this problem because they are elaborately designed to deal with dense inputs with trivial noise. In this work, we propose a novel framework, dubbed MV-DeepSDF, which estimates the optimal Signed Distance Function (SDF) shape representation from multi-sweep point clouds to reconstruct vehicles in the wild. Although there have been some SDF-based implicit modeling methods, they only focus on single-view-based reconstruction, resulting in low fidelity. In contrast, we first analyze multi-sweep consistency and complementarity in the latent feature space and propose to transform the implicit space shape estimation problem into an element-to-set feature extraction problem. Then, we devise a new architecture to extract individual element-level representations and aggregate them to generate a set-level predicted latent code. This set-level latent code is an expression of the optimal 3D shape in the implicit space, and can be subsequently decoded to a continuous SDF of the vehicle. In this way, our approach learns consistent and complementary information among multi-sweeps for 3D vehicle reconstruction. We conduct thorough experiments on two real-world autonomous driving datasets (Waymo and KITTI) to demonstrate the superiority of our approach over state-of-the-art alternative methods both qualitatively and quantitatively.

cs.CV↗
arXiv2023

Single-shot spatial instability and electric control of polariton condensates at room temperature

In planar microcavities, the transverse-electric and transverse-magnetic (TE-TM) mode splitting of cavity photons arises due to their different penetration into the Bragg mirrors and can result in optical spin-orbit coupling (SOC). In this work, we find that in a liquid crystal (LC) microcavity filled with perovskite microplates, the pronounced TE-TM splitting gives rise to a strong SOC that leads to the spatial instability of microcavity polariton condensates under single-shot excitation. Spatially varying hole burning and mode competition occurs between polarization components leading to different condensate profiles from shot to shot. The single-shot polariton condensates become stable when the SOC vanishes as the TE and TM modes are spectrally well separated from each other, which can be achieved by application of an electric field to our LC microcavity with electrically tunable anisotropy. Our findings are well reproduced and traced back to their physical origin by our detailed numerical simulations. With the electrical manipulation our work reveals how the shot-to-shot spatial instability of spatial polariton profiles can be engineered in anisotropic microcavities at room temperature, which will benefit the development of stable polariton-based optoeletronic and light-emitting devices.

physics.optics↗