Searcharxiv⌕ Search

arXiv subjects

Kaiwen Zheng

Publications and source records attributed to Kaiwen Zheng.

At least 73 records · Page 4Linked to original sources

High-quality Image Dehazing with Diffusion Model

Image dehazing is quite challenging in dense-haze scenarios, where quite less original information remains in the hazy image. Though previous methods have made marvelous progress, they still suffer from information loss in content and color in dense-haze scenarios. The recently emerged Denoising Diffusion Probabilistic Model (DDPM) exhibits strong generation ability, showing potential for solving this problem. However, DDPM fails to consider the physics property of dehazing task, limiting its information completion capacity. In this work, we propose DehazeDDPM: A DDPM-based and physics-aware image dehazing framework that applies to complex hazy scenarios. Specifically, DehazeDDPM works in two stages. The former stage physically models the dehazing task with the Atmospheric Scattering Model (ASM), pulling the distribution closer to the clear data and endowing DehazeDDPM with fog-aware ability. The latter stage exploits the strong generation ability of DDPM to compensate for the haze-induced huge information loss, by working in conjunction with the physical modelling. Extensive experiments demonstrate that our method attains state-of-the-art performance on both synthetic and real-world hazy datasets.

cs.CV↗

Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs

Diffusion models have exhibited excellent performance in various domains. The probability flow ordinary differential equation (ODE) of diffusion models (i.e., diffusion ODEs) is a particular case of continuous normalizing flows (CNFs), which enables deterministic inference and exact likelihood evaluation. However, the likelihood estimation results by diffusion ODEs are still far from those of the state-of-the-art likelihood-based generative models. In this work, we propose several improved techniques for maximum likelihood estimation for diffusion ODEs, including both training and evaluation perspectives. For training, we propose velocity parameterization and explore variance reduction techniques for faster convergence. We also derive an error-bounded high-order flow matching objective for finetuning, which improves the ODE likelihood and smooths its trajectory. For evaluation, we propose a novel training-free truncated-normal dequantization to fill the training-evaluation gap commonly existing in diffusion ODEs. Building upon these techniques, we achieve state-of-the-art likelihood estimation results on image datasets (2.56 on CIFAR-10, 3.43/3.69 on ImageNet-32) without variational dequantization or data augmentation, and 2.42 on CIFAR-10 with data augmentation. Code is available at \url{https://github.com/thu-ml/i-DODE}.

cs.LG↗

InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when handling natural language as editing instructions. Due to the lack of labeled human face 3D datasets and effective architectures, the area of human-instructed 3D-aware editing for open-world portraits in an end-to-end manner remains under-explored. To solve this problem, we propose an end-to-end diffusion-based framework termed InstructPix2NeRF, which enables instructed 3D-aware portrait editing from a single open-world image with human instructions. At its core lies a conditional latent 3D diffusion process that lifts 2D editing to 3D space by learning the correlation between the paired images' difference and the instructions via triplet data. With the help of our proposed token position randomization strategy, we could even achieve multi-semantic editing through one single pass with the portrait identity well-preserved. Besides, we further propose an identity consistency module that directly modulates the extracted identity signals into our diffusion process, which increases the multi-view 3D identity consistency. Extensive experiments verify the effectiveness of our method and show its superiority against strong baselines quantitatively and qualitatively. Source code and pre-trained models can be found on our project page: \url{https://mybabyyh.github.io/InstructPix2NeRF}.

cs.CV↗

The Simons Observatory: Large-Scale Characterization of 90/150 GHz TES Detector Modules

The Simons Observatory (SO) is a cosmic microwave background instrumentation suite being deployed in the Atacama Desert in northern Chile. The telescopes within SO use three types of dichroic transition-edge sensor (TES) detector arrays, with the 90 and 150 GHz Mid-Frequency (MF) arrays containing 65% of the approximately 68,000 detectors in the first phase of SO. All of the 26 required MF detector arrays have now been fabricated, packaged into detector modules, and tested in laboratory cryostats. Across all modules, we find an average operable detector yield of 84% and median saturation powers of (2.8, 8.0) pW with interquartile ranges of (1, 2) pW at (90, 150) GHz, respectively, falling within their targeted ranges. We measure TES normal resistances and superconducting transition temperatures on each detector wafer to be uniform within 3%, with overall central values of 7.5 mohm and 165 mK, respectively. Results on time constants, optical efficiency, and noise performance are also presented and are consistent with achieving instrument sensitivity forecasts.

astro-ph.IM↗

Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesis

In text-to-speech (TTS) synthesis, diffusion models have achieved promising generation quality. However, because of the pre-defined data-to-noise diffusion process, their prior distribution is restricted to a noisy representation, which provides little information of the generation target. In this work, we present a novel TTS system, Bridge-TTS, making the first attempt to substitute the noisy Gaussian prior in established diffusion-based TTS methods with a clean and deterministic one, which provides strong structural information of the target. Specifically, we leverage the latent representation obtained from text input as our prior, and build a fully tractable Schrodinger bridge between it and the ground-truth mel-spectrogram, leading to a data-to-data process. Moreover, the tractability and flexibility of our formulation allow us to empirically study the design spaces such as noise schedules, as well as to develop stochastic and deterministic samplers. Experimental results on the LJ-Speech dataset illustrate the effectiveness of our method in terms of both synthesis quality and sampling efficiency, significantly outperforming our diffusion counterpart Grad-TTS in 50-step/1000-step synthesis and strong fast TTS models in few-step scenarios. Project page: https://bridge-tts.github.io/

cs.LG↗

Precheck Sequence Based False Base Station Detection During Handover: A Physical Layer Security Scheme

False Base Station (FBS) attack has been a severe security problem for the cellular network since 2G era. During handover, the user equipment (UE) periodically receives state information from surrounding base stations (BSs) and uploads it to the source BS. The source BS compares the uploaded signal power and shifts UE to another BS that can provide the strongest signal. An FBS can transmit signal with the proper power and attract UE to connect to it. In this paper, based on the 3GPP standard, a Precheck Sequence-based Detection (PSD) Scheme is proposed to secure the transition of legal base station (LBS) for UE. This scheme first analyzes the structure of received signals in blocks and symbols. Several additional symbols are added to the current signal sequence for verification. By designing a long table of symbol sequence, every UE which needs handover will be allocated a specific sequence from this table. The simulation results show that the performance of this PSD Scheme is better than that of any existing ones, even when a specific transmit power is designed for FBS.

eess.SP↗

DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics

Diffusion probabilistic models (DPMs) have exhibited excellent performance for high-fidelity image generation while suffering from inefficient sampling. Recent works accelerate the sampling procedure by proposing fast ODE solvers that leverage the specific ODE form of DPMs. However, they highly rely on specific parameterization during inference (such as noise/data prediction), which might not be the optimal choice. In this work, we propose a novel formulation towards the optimal parameterization during sampling that minimizes the first-order discretization error of the ODE solution. Based on such formulation, we propose DPM-Solver-v3, a new fast ODE solver for DPMs by introducing several coefficients efficiently computed on the pretrained model, which we call empirical model statistics. We further incorporate multistep methods and a predictor-corrector framework, and propose some techniques for improving sample quality at small numbers of function evaluations (NFE) or large guidance scales. Experiments show that DPM-Solver-v3 achieves consistently better or comparable performance in both unconditional and conditional sampling with both pixel-space and latent-space DPMs, especially in 5$\sim$10 NFEs. We achieve FIDs of 12.21 (5 NFE), 2.51 (10 NFE) on unconditional CIFAR10, and MSE of 0.55 (5 NFE, 7.5 guidance scale) on Stable Diffusion, bringing a speed-up of 15%$\sim$30% compared to previous state-of-the-art training-free methods. Code is available at https://github.com/thu-ml/DPM-Solver-v3.

cs.CV↗

Revealing a 3D Fermi Surface Pocket and Electron-Hole Tunneling in UTe$_{2}$ with Quantum Oscillations

Spin triplet superconductor UTe$_{2}$ is widely believed to host a quasi-two-dimensional Fermi surface, revealed by first principal calculations, photoemission and quantum oscillation measurements. An outstanding question still remains as to the existence of a three-dimensional Fermi surface pocket, which is crucial for our understanding of the exotic superconducting and topological properties of UTe$_{2}$. This 3D Fermi surface pocket appears in various theoretical models with different physics origins but has not been detected experimentally. Here for the first time, we provide concrete evidence for a relatively isotropic, small Fermi surface pocket of UTe$_{2}$ via quantum oscillation measurements. In addition, we observed high frequency quantum oscillations corresponding to electron-hole tunneling between adjacent electron and hole pockets. The coexistence of 2D and 3D Fermi surface pockets, as well as the breakdown orbits, provides a test bed for theoretical models and aid the realization of a unified understanding of superconducting state of UTe$_{2}$ from the first-principles approach.

cond-mat.str-el↗

PREIM3D: 3D Consistent Precise Image Attribute Editing from a Single Image

We study the 3D-aware image attribute editing problem in this paper, which has wide applications in practice. Recent methods solved the problem by training a shared encoder to map images into a 3D generator's latent space or by per-image latent code optimization and then edited images in the latent space. Despite their promising results near the input view, they still suffer from the 3D inconsistency of produced images at large camera poses and imprecise image attribute editing, like affecting unspecified attributes during editing. For more efficient image inversion, we train a shared encoder for all images. To alleviate 3D inconsistency at large camera poses, we propose two novel methods, an alternating training scheme and a multi-view identity loss, to maintain 3D consistency and subject identity. As for imprecise image editing, we attribute the problem to the gap between the latent space of real images and that of generated images. We compare the latent space and inversion manifold of GAN models and demonstrate that editing in the inversion manifold can achieve better results in both quantitative and qualitative evaluations. Extensive experiments show that our method produces more 3D consistent images and achieves more precise image editing than previous work. Source code and pretrained models can be found on our project page: https://mybabyyh.github.io/Preim3D/

cs.CV↗

The Simons Observatory: Magnetic Shielding Measurements for the Universal Multiplexing Module

The Simons Observatory (SO) includes four telescopes that will measure the temperature and polarization of the cosmic microwave background using over 60,000 highly sensitive transition-edge bolometers (TES). These multichroic TES bolometers are read out by a microwave RF SQUID multiplexing system with a multiplexing factor of 910. Given that both TESes and SQUIDs are susceptible to magnetic field pickup and that it is hard to predict how they will respond to such fields, it is important to characterize the magnetic response of these systems empirically. This information can then be used to limit spurious signals by informing magnetic shielding designs for the detectors and readout. This paper focuses on measurements of magnetic pickup with different magnetic shielding configurations for the SO universal multiplexing module (UMM), which contains the SQUIDs, associated resonators, and TES bias circuit. The magnetic pickup of a prototype UMM was tested under three shielding configurations: no shielding (copper packaging), aluminum packaging for the UMM, and a tin/lead-plated shield surrounding the entire dilution refrigerator 100 mK cold stage. The measurements show that the aluminum packaging outperforms the copper packaging by a shielding factor of 8-10, and adding the tin/lead-plated 1K shield further increases the relative shielding factor in the aluminum configuration by 1-2 orders of magnitude.

astro-ph.IM↗

Simons Observatory Focal-Plane Module: Detector Re-biasing With Bias-step Measurements

The Simons Observatory is a ground-based cosmic microwave background survey experiment that consists of three 0.5 m small-aperture telescopes and one 6 m large-aperture telescope, sited at an elevation of 5200 m in the Atacama Desert in Chile. SO will deploy 60,000 transition-edge sensor (TES) bolometers in 49 separate focal-plane modules across a suite of four telescopes covering 30/40 GHz low frequency (LF), 90/150 GHz mid frequency (MF), and 220/280 GHz ultra-high frequency (UHF). Each MF and UHF focal-plane module packages 1720 optical detectors spreading across 12 detector bias lines that provide voltage biasing to the detectors. During observation, detectors are subject to varying atmospheric emission and hence need to be re-biased accordingly. The re-biasing process includes measuring the detector properties such as the TES resistance and responsivity in a fast manner. Based on the result, detectors within one bias line then are biased with suitable voltage. Here we describe a technique for re-biasing detectors in the modules using the result from bias-step measurement.

astro-ph.IM↗

Assembly development for the Simons Observatory focal plane readout module

The Simons Observatory (SO) is a suite of instruments sensitive to temperature and polarization of the cosmic microwave background (CMB) to be located at Cerro Toco in the Atacama Desert in Chile. Five telescopes, one large aperture telescope and four small aperture telescopes, will host roughly 70,000 highly multiplexed transition edge sensor (TES) detectors operated at 100 mK. Each SO focal plane module (UFM) couples 1,764 TESes to microwave resonators in a microwave multiplexing (uMux) readout circuit. Before detector integration, the 100 mK uMux components are packaged into multiplexing modules (UMMs), which are independently validated to ensure they meet SO performance specifications. Here we present the assembly developments of these UMM readout packages for mid frequency (90/150 GHz) and ultra high frequency (220/280 GHz) UFMs.

astro-ph.IM↗

The Simons Observatory: Complex Impedance Measurements for a Full Focal-Plane Module

The Simons Observatory (SO) is a ground based Cosmic Microwave Background experiment that will be deployed to the Atacama Desert in Chile. SO will field over 60,000 transition edge sensor (TES) bolometers that will observe in six spectral bands between 27 GHz and 280 GHz with the goal of revealing new information about the origin and evolution of the universe. SO detectors are grouped based on their observing frequency and packaged into Universal Focal Plane Modules, each containing up to 1720 detectors which are read out using microwave SQUID multiplexing and the SLAC Microresonator Radio Frequency Electronics (\smurf). By measuring the complex impedance of a TES we are able to access many thermoelectric properties of the detector that are difficult to determine using other calibration methods, however it has been difficult historically to measure complex impedance for many detectors at once due to high sample rate requirements. Here we present a method which uses \smurf\ to measure the complex impedance of hundreds of detectors simultaneously on hour-long timescales. We compare the measured effective thermal time constants to those estimated independently with bias steps. This new method opens up the possibility for using this characterization tool both in labs and at the site to better understand the full population of SO detectors.

astro-ph.IM↗

Simons Observatory Focal-Plane Module: In-lab Testing and Characterization Program

The Simons Observatory (SO) is a ground-based cosmic microwave background instrument to be sited in the Atacama Desert in Chile. SO will deploy 60,000 transition-edge sensor bolometers in 49 separate focal-plane modules across a suite of four telescopes covering three dichroic bands termed low frequency (LF), mid frequency (MF) and ultra-high frequency (UHF). Each MF and UHF focal-plane module packages 1720 optical detectors and corresponding 100 mK microwave SQUID multiplexing readout components. In this paper we describe the testing program we have developed for high-throughput validation of the modules after they are assembled. The validation requires measurements of the yield, saturation powers, time constants, noise properties and optical efficiencies. Additional measurements will be performed for further characterizations as needed. We describe the methods developed and demonstrate preliminary results from initial testing of prototype modules.

astro-ph.IM↗

Maximum Likelihood Training for Score-Based Diffusion ODEs by High-Order Denoising Score Matching

Score-based generative models have excellent performance in terms of generation quality and likelihood. They model the data distribution by matching a parameterized score network with first-order data score functions. The score network can be used to define an ODE ("score-based diffusion ODE") for exact likelihood evaluation. However, the relationship between the likelihood of the ODE and the score matching objective is unclear. In this work, we prove that matching the first-order score is not sufficient to maximize the likelihood of the ODE, by showing a gap between the maximum likelihood and score matching objectives. To fill up this gap, we show that the negative likelihood of the ODE can be bounded by controlling the first, second, and third-order score matching errors; and we further present a novel high-order denoising score matching method to enable maximum likelihood training of score-based diffusion ODEs. Our algorithm guarantees that the higher-order matching error is bounded by the training error and the lower-order errors. We empirically observe that by high-order score matching, score-based diffusion ODEs achieve better likelihood on both synthetic data and CIFAR-10, while retaining the high generation quality.

stat.ML↗

The Simons Observatory 220 and 280 GHz Focal-Plane Module: Design and Initial Characterization

The Simons Observatory (SO) will detect and map the temperature and polarization of the millimeter-wavelength sky from Cerro Toco, Chile across a range of angular scales, providing rich data sets for cosmological and astrophysical analysis. The SO focal planes will be tiled with compact hexagonal packages, called Universal Focal-plane Modules (UFMs), in which the transition-edge sensor (TES) detectors are coupled to 100 mK microwave-multiplexing electronics. Three different types of dichroic TES detector arrays with bands centered at 30/40, 90/150, and 220/280 GHz will be implemented across the 49 planned UFMs. The 90/150GHz and 220/280 GHz arrays each contain 1,764 TESes, which are read out with two 910x multiplexer circuits. The modules contain a series of densely routed silicon chips, which are packaged together in a controlled electromagnetic environment with robust heat-sinking to 100 mK. Following an overview of the module design, we report on early results from the first 220/280GHz UFM, including detector yield, as well as readout and detector noise levels.

astro-ph.IM↗

The 90 and 150 GHz universal focal-plane modules for the Simons Observatory

The Simons Observatory (SO) is a suite of telescopes located in the Atacama Desert in Chile that will make sensitive measurements of the cosmic microwave background. There are a host of cosmological and astrophysical questions that SO is forecasted to address. The universal focal-plane modules (UFMs) populate the four SO telescope receiver focal planes. There are three varieties of UFMs, each of which contains transition-edge-sensor bolometers observing in two spectral bands between 30 and 290~GHz. We describe the novel mid-frequency UFMs, which target two of the six spectral bands at 90 and 150~GHz and are central to the cosmological goals of SO.

astro-ph.IM↗

The Simons Observatory microwave SQUID multiplexing detector module design

Advances in cosmic microwave background (CMB) science depend on increasing the number of sensitive detectors observing the sky. New instruments deploy large arrays of superconducting transition-edge sensor (TES) bolometers tiled densely into ever larger focal planes. High multiplexing factors reduce the thermal loading on the cryogenic receivers and simplify their design. We present the design of focal-plane modules with an order of magnitude higher multiplexing factor than has previously been achieved with TES bolometers. We focus on the novel cold readout component, which employs microwave SQUID multiplexing ($μ$mux). Simons Observatory will use 49 modules containing 60,000 bolometers to make exquisitely sensitive measurements of the CMB. We validate the focal-plane module design, presenting measurements of the readout component with and without a prototype detector array of 1728 polarization-sensitive bolometers coupled to feedhorns. The readout component achieves a $95\%$ yield and a 910 multiplexing factor. The median white noise of each readout channel is 65 $\mathrm{pA/\sqrt{Hz}}$. This impacts the projected SO mapping speed by $< 8\%$, which is less than is assumed in the sensitivity projections. The results validate the full functionality of the module. We discuss the measured performance in the context of SO science requirements, which are exceeded.

astro-ph.IM↗