arXiv subjects

Yifan Deng

Publications and source records attributed to Yifan Deng.

16 recordsLinked to original sources

arXiv2026

The First Challenge on Remote Sensing Infrared Image Super-Resolution at NTIRE 2026: Benchmark Results and Method Overview

This paper presents the NTIRE 2026 Remote Sensing Infrared Image Super-Resolution (x4) Challenge, one of the associated challenges of NTIRE 2026. The challenge aims to recover high-resolution (HR) infrared images from low-resolution (LR) inputs generated through bicubic downsampling with a x4 scaling factor. The objective is to develop effective models or solutions that achieve state-of-the-art performance for infrared image SR in remote sensing scenarios. To reflect the characteristics of infrared data and practical application needs, the challenge adopts a single-track setting. A total of 115 participants registered for the competition, with 13 teams submitting valid entries. This report summarizes the challenge design, dataset, evaluation protocol, main results, and the representative methods of each team. The challenge serves as a benchmark to advance research in infrared image super-resolution and promote the development of effective solutions for real-world remote sensing applications.

cs.CV↗

arXiv2026

Dual-Branch Remote Sensing Infrared Image Super-Resolution

Remote sensing infrared image super-resolution aims to recover sharper thermal observations from low-resolution inputs while preserving target contours, scene layout, and radiometric stability. Unlike visible-image super-resolution, thermal imagery is weakly textured and more sensitive to unstable local sharpening, which makes complementary local and global modeling especially important. This paper presents our solution to the NTIRE 2026 Infrared Image Super-Resolution Challenge, a dual-branch system that combines a HAT-L branch and a MambaIRv2-L branch. The inference pipeline applies test-time local conversion on HAT, eight-way self-ensemble on MambaIRv2, and fixed equal-weight image-space fusion. We report both the official challenge score and a reproducible evaluation on 12 synthetic times-four thermal samples derived from Caltech Aerial RGB-Thermal, on which the fused output outperforms either single branch in PSNR, SSIM, and the overall Score. The results suggest that infrared super-resolution benefits from explicit complementarity between locally strong transformer restoration and globally stable state-space modeling.

cs.CV↗

arXiv2025

Anisotropy of linear magnetoresistance in Kagome metal ZrV$_6$Sn$_6$

The Kagome lattice has attracted extensive attention due to the diverse magnetic properties and non-trivial electronic states generated by its unique atomic arrangement, which provides an excellent system for exploring macroscopic quantum behavior. Here, we report the anomalous transport properties in 166-type Kagome metal ZrV$_6$Sn$_6$ single crystals. The quadratic and linear magnetoresistance (LMR) can be observed depending on the directions of the field and the current. Integrating Hall resistivity and quantum oscillation measurements, we found that the LMR could match well with the Abrikosov model. However, this model encounters difficulties in explaining the anisotropy of the magnetoresistance. To solve the issue, we extrapolate the Abrikosov model to the case of two-dimensional linear dispersion. It was found that when the field is parallel to the linear dependence momentum, the quantized energy is $\epsilon_n^{\pm}$ = $\pm v\sqrt{p^2+2eHn/c}$, resulting in LMR. By contrast, when it is parallel to the non-linear dependence momentum, the energy is $\epsilon_n^{\pm}$ = $\pm v\sqrt{2eHn/c}$, without yielding LMR. Through the combination of experiment and theory, the modified Abrikosov model could interpret the macroscopic quantum transport in ZrV$_6$Sn$_6$ crystal. The present research provides a new perspective for understanding the LMR behavior.

cond-mat.str-el↗

arXiv2025

VQualA 2025 Challenge on Face Image Quality Assessment: Methods and Results

Face images play a crucial role in numerous applications; however, real-world conditions frequently introduce degradations such as noise, blur, and compression artifacts, affecting overall image quality and hindering subsequent tasks. To address this challenge, we organized the VQualA 2025 Challenge on Face Image Quality Assessment (FIQA) as part of the ICCV 2025 Workshops. Participants created lightweight and efficient models (limited to 0.5 GFLOPs and 5 million parameters) for the prediction of Mean Opinion Scores (MOS) on face images with arbitrary resolutions and realistic degradations. Submissions underwent comprehensive evaluations through correlation metrics on a dataset of in-the-wild face images. This challenge attracted 127 participants, with 1519 final submissions. This report summarizes the methodologies and findings for advancing the development of practical FIQA approaches.

cs.CV↗

arXiv2025

Assay2Mol: large language model-based drug design using BioAssay context

Scientific databases aggregate vast amounts of quantitative data alongside descriptive text. In biochemistry, molecule screening assays evaluate candidate molecules' functional responses against disease targets. Unstructured text that describes the biological mechanisms through which these targets operate, experimental screening protocols, and other attributes of assays offer rich information for drug discovery campaigns but has been untapped because of that unstructured format. We present Assay2Mol, a large language model-based workflow that can capitalize on the vast existing biochemical screening assays for early-stage drug discovery. Assay2Mol retrieves existing assay records involving targets similar to the new target and generates candidate molecules using in-context learning with the retrieved assay screening data. Assay2Mol outperforms recent machine learning approaches that generate candidate ligand molecules for target protein structures, while also promoting more synthesizable molecule generation.

cs.LG↗

arXiv2025

The Tenth NTIRE 2025 Image Denoising Challenge Report

This paper presents an overview of the NTIRE 2025 Image Denoising Challenge ({\sigma} = 50), highlighting the proposed methodologies and corresponding results. The primary objective is to develop a network architecture capable of achieving high-quality denoising performance, quantitatively evaluated using PSNR, without constraints on computational complexity or model size. The task assumes independent additive white Gaussian noise (AWGN) with a fixed noise level of 50. A total of 290 participants registered for the challenge, with 20 teams successfully submitting valid results, providing insights into the current state-of-the-art in image denoising.

cs.CV↗

arXiv2025

The Tenth NTIRE 2025 Efficient Super-Resolution Challenge Report

This paper presents a comprehensive review of the NTIRE 2025 Challenge on Single-Image Efficient Super-Resolution (ESR). The challenge aimed to advance the development of deep models that optimize key computational metrics, i.e., runtime, parameters, and FLOPs, while achieving a PSNR of at least 26.90 dB on the $\operatorname{DIV2K\_LSDIR\_valid}$ dataset and 26.99 dB on the $\operatorname{DIV2K\_LSDIR\_test}$ dataset. A robust participation saw \textbf{244} registered entrants, with \textbf{43} teams submitting valid entries. This report meticulously analyzes these methods and results, emphasizing groundbreaking advancements in state-of-the-art single-image ESR techniques. The analysis highlights innovative approaches and establishes benchmarks for future research in the field.

cs.CV↗

arXiv2024

Purrfessor: A Fine-tuned Multimodal LLaVA Diet Health Chatbot

This study introduces Purrfessor, an innovative AI chatbot designed to provide personalized dietary guidance through interactive, multimodal engagement. Leveraging the Large Language-and-Vision Assistant (LLaVA) model fine-tuned with food and nutrition data and a human-in-the-loop approach, Purrfessor integrates visual meal analysis with contextual advice to enhance user experience and engagement. We conducted two studies to evaluate the chatbot's performance and user experience: (a) simulation assessments and human validation were conducted to examine the performance of the fine-tuned model; (b) a 2 (Profile: Bot vs. Pet) by 3 (Model: GPT-4 vs. LLaVA vs. Fine-tuned LLaVA) experiment revealed that Purrfessor significantly enhanced users' perceptions of care ($\beta = 1.59$, $p = 0.04$) and interest ($\beta = 2.26$, $p = 0.01$) compared to the GPT-4 bot. Additionally, user interviews highlighted the importance of interaction design details, emphasizing the need for responsiveness, personalization, and guidance to improve user engagement.

cs.HC↗

arXiv2024

Penumbra-Effect Induced Spectral Mixing in X-ray Computed Tomography: A Multi-Ray Spectrum Estimation Model and Subsampled Weighting Algorithm

Purpose: With the development of spectral CT, several novel spectral filters have been introduced to modulate the spectra, such as split filters and spectral modulators. However, due to the finite size of the focal spot of X-ray source, these filters cause spectral mixing in the penumbra region. Traditional spectrum estimation methods fail to account for it, resulting in reduced spectral accuracy. Methods: To address this challenge, we develop a multi-ray spectrum estimation model and propose an Adaptive Subsampled WeIghting of Filter Thickness (A-SWIFT) method. First, we estimate the unfiltered spectrum using traditional methods. Next, we model the final spectra as a weighted summation of spectra attenuated by multiple filters. The weights and equivalent lengths are obtained by X-ray transmission measurements taken with altered spectra using different kVp or flat filters. Finally, the spectra are approximated by using the multi-ray model. To mimic the penumbra effect, we used a spectral modulator (0.2 mm Mo, 0.6 mm Mo) and a split filter (0.07 mm Au, 0.7 mm Sn) in simulations, and used a copper modulator and a molybdenum modulator (0.2 mm, 0.6 mm) in experiments. Results: Simulation results show that the mean energy bias in the penumbra region decreased from 7.43 keV using the previous SCFM method (Spectral Compensation for Modulator) to 0.72 keV using the A-SWIFT method for the split filter, and from 1.98 keV to 0.61 keV for the spectral modulator. In experiments, the root mean square error of the selected ROIs was decreased from 77 to 7 Hounsfield units (HU) for the pure water phantom with a molybdenum modulator, and from 85 to 21 HU with a copper modulator. Conclusion: Based on a multi-ray spectrum estimation model, the A-SWIFT method provides an accurate and robust approach for spectrum estimation in penumbra region of CT systems utilizing spectral filters.

physics.med-ph↗

arXiv2024

Chemical Language Model Linker: blending text and molecules with modular adapters

The development of large language models and multi-modal models has enabled the appealing idea of generating novel molecules from text descriptions. Generative modeling would shift the paradigm from relying on large-scale chemical screening to find molecules with desired properties to directly generating those molecules. However, multi-modal models combining text and molecules are often trained from scratch, without leveraging existing high-quality pretrained models. Training from scratch consumes more computational resources and prohibits model scaling. In contrast, we propose a lightweight adapter-based strategy named Chemical Language Model Linker (ChemLML). ChemLML blends the two single domain models and obtains conditional molecular generation from text descriptions while still operating in the specialized embedding spaces of the molecular domain. ChemLML can tailor diverse pretrained text models for molecule generation by training relatively few adapter parameters. We find that the choice of molecular representation used within ChemLML, SMILES versus SELFIES, has a strong influence on conditional molecular generation performance. SMILES is often preferable despite not guaranteeing valid molecules. We raise issues in using the entire PubChem dataset of molecules and their associated descriptions for evaluating molecule generation and provide a filtered version of the dataset as a generation test set. To demonstrate how ChemLML could be used in practice, we generate candidate protein inhibitors and use docking to assess their quality and also generate candidate membrane permeable molecules.

cs.LG↗

arXiv2024

NTIRE 2024 Quality Assessment of AI-Generated Content Challenge

This paper reports on the NTIRE 2024 Quality Assessment of AI-Generated Content Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2024. This challenge is to address a major challenge in the field of image and video processing, namely, Image Quality Assessment (IQA) and Video Quality Assessment (VQA) for AI-Generated Content (AIGC). The challenge is divided into the image track and the video track. The image track uses the AIGIQA-20K, which contains 20,000 AI-Generated Images (AIGIs) generated by 15 popular generative models. The image track has a total of 318 registered participants. A total of 1,646 submissions are received in the development phase, and 221 submissions are received in the test phase. Finally, 16 participating teams submitted their models and fact sheets. The video track uses the T2VQA-DB, which contains 10,000 AI-Generated Videos (AIGVs) generated by 9 popular Text-to-Video (T2V) models. A total of 196 participants have registered in the video track. A total of 991 submissions are received in the development phase, and 185 submissions are received in the test phase. Finally, 12 participating teams submitted their models and fact sheets. Some methods have achieved better results than baseline methods, and the winning methods in both tracks have demonstrated superior prediction performance on AIGC.

cs.CV↗

arXiv2024

ConsPrompt: Exploiting Contrastive Samples for Fewshot Prompt Learning

The prompt has become an effective linguistic tool for utilizing pre-trained language models. However, in few-shot scenarios, subtle changes in the prompt design always make the result widely different, and the prompt learning methods also make it easy to overfit the limited samples. To alleviate this, we explore utilizing suitable contrastive samples and multi-degree contrastive learning methods to improve the robustness of the prompt representation. Therefore, the proposed Consprompt combined with the prompt encoding network, contrastive sampling modules, and contrastive scoring modules, is introduced to realize differential contrastive learning. Our results exhibit state-of-the-art performance in different few-shot settings, and the ablation experiments also certify the effectiveness of utilizing multi-degree contrastive learning in the prompt-based fine-tuning process.

cs.CL↗

arXiv2024

PepHarmony: A Multi-View Contrastive Learning Framework for Integrated Sequence and Structure-Based Peptide Encoding

Recent advances in protein language models have catalyzed significant progress in peptide sequence representation. Despite extensive exploration in this field, pre-trained models tailored for peptide-specific needs remain largely unaddressed due to the difficulty in capturing the complex and sometimes unstable structures of peptides. This study introduces a novel multi-view contrastive learning framework PepHarmony for the sequence-based peptide encoding task. PepHarmony innovatively combines both sequence- and structure-level information into a sequence-level encoding module through contrastive learning. We carefully select datasets from the Protein Data Bank (PDB) and AlphaFold database to encompass a broad spectrum of peptide sequences and structures. The experimental data highlights PepHarmony's exceptional capability in capturing the intricate relationship between peptide sequences and structures compared with the baseline and fine-tuned models. The robustness of our model is confirmed through extensive ablation studies, which emphasize the crucial roles of contrastive loss and strategic data sorting in enhancing predictive performance. The proposed PepHarmony framework serves as a notable contribution to peptide representations, and offers valuable insights for future applications in peptide drug discovery and peptide engineering. We have made all the source code utilized in this study publicly accessible via GitHub at https://github.com/zhangruochi/PepHarmony or http://www.healthinformaticslab.org/supp/.

cs.LG↗

arXiv2023

Structure-informed Language Models Are Protein Designers

This paper demonstrates that language models are strong structure-based protein designers. We present LM-Design, a generic approach to reprogramming sequence-based protein language models (pLMs), that have learned massive sequential evolutionary knowledge from the universe of natural protein sequences, to acquire an immediate capability to design preferable protein sequences for given folds. We conduct a structural surgery on pLMs, where a lightweight structural adapter is implanted into pLMs and endows it with structural awareness. During inference, iterative refinement is performed to effectively optimize the generated protein sequences. Experiments show that LM-Design improves the state-of-the-art results by a large margin, leading to up to 4% to 12% accuracy gains in sequence recovery (e.g., 55.65%/56.63% on CATH 4.2/4.3 single-chain benchmarks, and >60% when designing protein complexes). We provide extensive and in-depth analyses, which verify that LM-Design can (1) indeed leverage both structural and sequential knowledge to accurately handle structurally non-deterministic regions, (2) benefit from scaling data and model size, and (3) generalize to other proteins (e.g., antibodies and de novo proteins)

cs.LG↗

arXiv2022

Multi-Energy Blended CBCT Spectral Imaging Using a Spectral Modulator with Flying Focal Spot (SMFFS)

Conventional cone-beam CT (CBCT) can be easily compromised by scatter and beam hardening artifacts, and the entanglement of scatter and spectral effects introduces additional complexity. In this work, we present the first attempt to develop a stationary spectral modulator with flying focal spot (SMFFS) technology as a promising, low-cost approach to accurately solving the X-ray scattering problem and physically enabling spectral imaging in a unified framework. To deal with the intertwined scatter-spectral challenge, we propose a novel scatter-decoupled material decomposition (SDMD) method for SMFFS based on a hypothesis of scatter similarity. Monte Carlo simulations of a pure-water cylinder phantom with different focal spot deflections show that focal spot deflections within a range of ~2 mm share quite similar scatter distributions overall. Numerical simulations using a clinical abdominal CT dataset demonstrate that SMFFS with SDMD method can achieve better material decomposition and CT number accuracy with less artifacts. Physics experiments on a tabletop CBCT system using a Gammex multi-energy CT phantom an anthropomorphic chest phantom, are carried out to demonstrate the feasibility of CBCT spectral imaging with SMFFS. For the chest phantom, the root mean square error (RMSE) in selected regions of interest (ROIs) of virtual monochromatic image (VMI) at 70 keV is 11.8 HU for SMFFS CB scan, and 14.5 and 437.6 HU for sequential 80/140 kVp (DKV) CB scan with and without scatter correction, respectively. Also, the non-uniformity among selected regions is 14.1 HU for SMFFS CB scan, and 59.4 and 184.0 HU for the DKV CB scan with and without a traditional scatter correction method, respectively. Our preliminary results show that SMFFS can enable spectral imaging with simultaneous scatter correction for CBCT and effectively improve its quantitative imaging performance.

physics.med-ph↗

arXiv2021

Improved Drug-target Interaction Prediction with Intermolecular Graph Transformer

The identification of active binding drugs for target proteins (termed as drug-target interaction prediction) is the key challenge in virtual screening, which plays an essential role in drug discovery. Although recent deep learning-based approaches achieved better performance than molecular docking, existing models often neglect certain aspects of the intermolecular information, hindering the performance of prediction. We recognize this problem and propose a novel approach named Intermolecular Graph Transformer (IGT) that employs a dedicated attention mechanism to model intermolecular information with a three-way Transformer-based architecture. IGT outperforms state-of-the-art approaches by 9.1% and 20.5% over the second best for binding activity and binding pose prediction respectively, and shows superior generalization ability to unseen receptor proteins. Furthermore, IGT exhibits promising drug screening ability against SARS-CoV-2 by identifying 83.1% active drugs that have been validated by wet-lab experiments with near-native predicted binding poses.

cs.LG↗