SearcharxivSearch

arXiv subjects

Chia-Hung Yuan

Publications and source records attributed to Chia-Hung Yuan.

3 recordsLinked to original sources

Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution

Pretrained diffusion models have revolutionized real-world image super-resolution (Real-ISR), but their iterative sampling is computationally prohibitive, driving efforts to distill it into a single step. General one-step methods fine-tune the generative prior into a deterministic mapping, restoring efficiency but discarding its stochastic nature. Conversely, recent attempts re-engage generation by shifting the timestep or injecting random noise, adjusting either the position or the state while the other stays fixed. Because only one side is controlled, the two align at isolated preset timesteps but drift apart once steered, leaving generation unstable. To address this, we present one-step diffusion via Inversion and Degradation-aware Sampling for Real-ISR (IDaS-SR), a one-step framework that bridges deterministic restoration and stochastic generation. At its core, Manifold Anchoring grounds the low-quality latent on the pretrained trajectory through two operations jointly estimated by the Manifold Inversion Noise Estimator (MINE): positioning declares where the latent lies and how it deviates from the clean state, while inversion aligns the latent to the declared position. Upon the anchor, CHARIOT reintroduces controlled stochasticity by jointly rescheduling the trajectory and interpolating the noise, enabling a single scalar to smoothly navigate the fidelity-realism trade-off. Extensive experiments demonstrate that IDaS-SR effectively unleashes the generative prior, achieving state-of-the-art performance under explicit control in a single inference step.

cs.CV

Learning Ordinal Degradation Representations with Textual Priors for Diffusion-Based Blind Image Super-Resolution

Blind image super-resolution (Blind SR) has achieved remarkable perceptual quality via generative priors. However, lacking clear degradation representations such as varying severity and mixtures, these methods fail to accurately reflect the actual degradation process. This limitation severely compromises restoration fidelity and leads to content inconsistencies, especially in diffusion-based blind SR models that rely on simple textual descriptions for contextual guidance. To bridge the gap between high-level semantics and low-level degradation artifacts, we introduce Ordinal Degradation CLIP (OD-CLIP), leveraging textual priors to enhance the learning of continuous degradation-level representations. Unlike standard CLIP text encoders, which struggle to represent numerical intensity, OD-CLIP moves beyond coarse labels by modeling unknown degradations as a continuous spectrum representing quality. By learning an ordinal embedding from low-quality inputs, our design captures both degradation types and their relative severity, explicitly modeling the degradation hierarchy and enabling interpolation across unseen levels. In our experiments, the OD-CLIP representation demonstrates stronger ordinal ranking and perceptual distance modeling compared to baseline methods. When applied to blind SR, we show that conditioning on OD-CLIP maintains fidelity and preserves content structures over existing methods in both unknown and mixed-degradation settings on real-world benchmarks.

cs.CV

Meta Adversarial Perturbations

A plethora of attack methods have been proposed to generate adversarial examples, among which the iterative methods have been demonstrated the ability to find a strong attack. However, the computation of an adversarial perturbation for a new data point requires solving a time-consuming optimization problem from scratch. To generate a stronger attack, it normally requires updating a data point with more iterations. In this paper, we show the existence of a meta adversarial perturbation (MAP), a better initialization that causes natural images to be misclassified with high probability after being updated through only a one-step gradient ascent update, and propose an algorithm for computing such perturbations. We conduct extensive experiments, and the empirical results demonstrate that state-of-the-art deep neural networks are vulnerable to meta perturbations. We further show that these perturbations are not only image-agnostic, but also model-agnostic, as a single perturbation generalizes well across unseen data points and different neural network architectures.

cs.LG