Searcharxiv⌕ Search

arXiv subjects

Ahmet Murat Tekalp

Publications and source records attributed to Ahmet Murat Tekalp.

2 recordsLinked to original sources

Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models

Image restoration has traditionally required training specialized models on thousands of paired examples per degradation type. Large pre-trained text-conditioned image editing models encode rich priors about image structure, quality, and degradation, yet we find that this knowledge does not, on its own, make them restorers: state-of-the-art editing models largely fail at restoration in the zero-shot regime. We show that what these priors lack is not capability but direction, and that a small amount of parameter-efficient adaptation supplies it. Fine-tuning LoRA adapters on FLUX.1 Kontext, a 12B-parameter flow matching model for image-to-image translation, with only 32--128 paired images per task and guided by simple text prompts, we turn a mediocre zero-shot editor into a competitive restorer. A single unified adapter, conditioned on task-specific prompts, handles five diverse degradations. Despite using three to four orders of magnitude less data, our few-shot model surpasses a recent restoration baseline trained on over a million curated pairs on the majority of perceptual and distribution-level metrics, on which we evaluate in keeping with our focus on perceptual rather than pixel-fidelity quality. Through comprehensive studies, we analyze the impact of training-set size, the trade-off between task-specific and unified multi-task adapters, the effect of text encoder adaptation, and zero-shot baseline performance, establishing pre-trained editing models as a compelling, data-efficient foundation for few-shot, prompt-guided image restoration.

eess.IV↗

Leveraging Vision-Language Models to Select Trustworthy Super-Resolution Samples Generated by Diffusion Models

Super-resolution (SR) is an ill-posed inverse problem with many feasible solutions consistent with a given low-resolution image. On one hand, regressive SR models aim to balance fidelity and perceptual quality to yield a single solution, but this trade-off often introduces artifacts that create ambiguity in information-critical applications such as recognizing digits or letters. On the other hand, diffusion models generate a diverse set of SR images, but selecting the most trustworthy solution from this set remains a challenge. This paper introduces a robust, automated framework for identifying the most trustworthy SR sample from a diffusion-generated set by leveraging the semantic reasoning capabilities of vision-language models (VLMs). Specifically, VLMs such as BLIP-2, GPT-4o, and their variants are prompted with structured queries to assess semantic correctness, visual quality, and artifact presence. The top-ranked SR candidates are then ensembled to yield a single trustworthy output in a cost-effective manner. To rigorously assess the validity of VLM-selected samples, we propose a novel Trustworthiness Score (TWS) a hybrid metric that quantifies SR reliability based on three complementary components: semantic similarity via CLIP embeddings, structural integrity using SSIM on edge maps, and artifact sensitivity through multi-level wavelet decomposition. We empirically show that TWS correlates strongly with human preference in both ambiguous and natural images, and that VLM-guided selections consistently yield high TWS values. Compared to conventional metrics like PSNR, LPIPS, which fail to reflect information fidelity, our approach offers a principled, scalable, and generalizable solution for navigating the uncertainty of the diffusion SR space. By aligning outputs with human expectations and semantic correctness, this work sets a new benchmark for trustworthiness in generative SR.

cs.CV↗