arXiv subjects

David S. Yu

Publications and source records attributed to David S. Yu.

14 recordsLinked to original sources

arXiv2025

Generalizable 7T T1-map Synthesis from 1.5T and 3T T1 MRI with an Efficient Transformer Model

Purpose: Ultra-high-field 7T MRI offers improved resolution and contrast over standard clinical field strengths (1.5T, 3T). However, 7T scanners are costly, scarce, and introduce additional challenges such as susceptibility artifacts. We propose an efficient transformer-based model (7T-Restormer) to synthesize 7T-quality T1-maps from routine 1.5T or 3T T1-weighted (T1W) images. Methods: Our model was validated on 35 1.5T and 108 3T T1w MRI paired with corresponding 7T T1 maps of patients with confirmed MS. A total of 141 patient cases (32,128 slices) were randomly divided into 105 (25; 80) training cases (19,204 slices), 19 (5; 14) validation cases (3,476 slices), and 17 (5; 14) test cases (3,145 slices) where (X; Y) denotes the patients with 1.5T and 3T T1W scans, respectively. The synthetic 7T T1 maps were compared against the ResViT and ResShift models. Results: The 7T-Restormer model achieved a PSNR of 26.0 +/- 4.6 dB, SSIM of 0.861 +/- 0.072, and NMSE of 0.019 +/- 0.011 for 1.5T inputs, and 25.9 +/- 4.9 dB, and 0.866 +/- 0.077 for 3T inputs, respectively. Using 10.5 M parameters, our model reduced NMSE by 64 % relative to 56.7M parameter ResShift (0.019 vs 0.052, p = <.001 and by 41 % relative to 70.4M parameter ResViT (0.019 vs 0.032, p = <.001) at 1.5T, with similar advantages at 3T (0.021 vs 0.060 and 0.033; p < .001). Training with a mixed 1.5 T + 3 T corpus was superior to single-field strategies. Restricting the model to 1.5T increased the 1.5T NMSE from 0.019 to 0.021 (p = 1.1E-3) while training solely on 3T resulted in lower performance on input 1.5T T1W MRI. Conclusion: We propose a novel method for predicting quantitative 7T MP2RAGE maps from 1.5T and 3T T1W scans with higher quality than existing state-of-the-art methods. Our approach makes the benefits of 7T MRI more accessible to standard clinical workflows.

cs.CV↗

arXiv2025

Unifying Biomedical Vision-Language Expertise: Towards a Generalist Foundation Model via Multi-CLIP Knowledge Distillation

CLIP models pretrained on natural images with billion-scale image-text pairs have demonstrated impressive capabilities in zero-shot classification, cross-modal retrieval, and open-ended visual answering. However, transferring this success to biomedicine is hindered by the scarcity of large-scale biomedical image-text corpora, the heterogeneity of image modalities, and fragmented data standards across institutions. These limitations hinder the development of a unified and generalizable biomedical foundation model trained from scratch. To overcome this, we introduce MMKD-CLIP, a generalist biomedical foundation model developed via Multiple Medical CLIP Knowledge Distillation. Rather than relying on billion-scale raw data, MMKD-CLIP distills knowledge from nine state-of-the-art domain-specific or generalist biomedical CLIP models, each pretrained on millions of biomedical image-text pairs. Our two-stage training pipeline first performs CLIP-style pretraining on over 2.9 million biomedical image-text pairs from 26 image modalities, followed by feature-level distillation using over 19.2 million feature pairs extracted from teacher models. We evaluate MMKD-CLIP on 58 diverse biomedical datasets, encompassing over 10.8 million biomedical images across nine image modalities. The evaluation spans six core task types: zero-shot classification, linear probing, cross-modal retrieval, visual question answering, survival prediction, and cancer diagnosis. MMKD-CLIP consistently outperforms all teacher models while demonstrating remarkable robustness and generalization across image domains and task settings. These results underscore that multi-teacher knowledge distillation is a scalable and effective paradigm for building high-performing biomedical foundation models under the practical constraints of real-world data availability.

cs.CV↗

arXiv2025

Clinically Interpretable Survival Risk Stratification in Head and Neck Cancer Using Bayesian Networks and Markov Blankets

Purpose: To identify a clinically interpretable subset of survival-relevant features in HN cancer using Bayesian Network (BN) and evaluate its prognostic and causal utility. Methods and Materials: We used the RADCURE dataset, consisting of 3,346 patients with H&N cancer treated with definitive (chemo)radiotherapy. A probabilistic BN was constructed to model dependencies among clinical, anatomical, and treatment variables. The Markov Blanket (MB) of two-year survival (SVy2) was extracted and used to train a logistic regression model. After excluding incomplete cases, a temporal split yielded a train/test (2,174/820) dataset using 2007 as the cutoff year. Model performance was assessed using area under the ROC curve (AUC), C-index, and Kaplan-Meier (KM) survival stratification. Model fit was further evaluated using a log-likelihood ratio (LLR) test. Causal inference was performed using do-calculus interventions on MB variables. Results: The MB of SVy2 included 6 clinically relevant features: ECOG performance status, T-stage, HPV status, disease site, the primary gross tumor volume (GTVp), and treatment modality. The model achieved an AUC of 0.65 and C-index of 0.78 on the test dataset, significantly stratifying patients into high- and low-risk groups (log-rank p < 0.01). Model fit was further supported by a log-likelihood ratio of 70.32 (p < 0.01). Subgroup analyses revealed strong performance in HPV-negative (AUC = 0.69, C-index = 0.76), T4 (AUC = 0.69, C-index = 0.80), and large-GTV (AUC = 0.67, C-index = 0.75) cohorts, each showing significant KM separation. Causal analysis further supported the positive survival impact of ECOG 0, HPV-positive status, and chemoradiation. Conclusions: A compact, MB-derived BN model can robustly stratify survival risk in HN cancer. The model enables explainable prognostication and supports individualized decision-making across key clinical subgroups.

physics.med-ph↗

arXiv2025

Towards Universal Text-driven CT Image Segmentation

Computed tomography (CT) is extensively used for accurate visualization and segmentation of organs and lesions. While deep learning models such as convolutional neural networks (CNNs) and vision transformers (ViTs) have significantly improved CT image analysis, their performance often declines when applied to diverse, real-world clinical data. Although foundation models offer a broader and more adaptable solution, their potential is limited due to the challenge of obtaining large-scale, voxel-level annotations for medical images. In response to these challenges, prompting-based models using visual or text prompts have emerged. Visual-prompting methods, such as the Segment Anything Model (SAM), still require significant manual input and can introduce ambiguity when applied to clinical scenarios. Instead, foundation models that use text prompts offer a more versatile and clinically relevant approach. Notably, current text-prompt models, such as the CLIP-Driven Universal Model, are limited to text prompts already encountered during training and struggle to process the complex and diverse scenarios of real-world clinical applications. Instead of fine-tuning models trained from natural imaging, we propose OpenVocabCT, a vision-language model pretrained on large-scale 3D CT images for universal text-driven segmentation. Using the large-scale CT-RATE dataset, we decompose the diagnostic reports into fine-grained, organ-level descriptions using large language models for multi-granular contrastive learning. We evaluate our OpenVocabCT on downstream segmentation tasks across nine public datasets for organ and tumor segmentation, demonstrating the superior performance of our model compared to existing methods. All code, datasets, and models will be publicly released at https://github.com/ricklisz/OpenVocabCT.

cs.CV↗

arXiv2025

MRI super-resolution reconstruction using efficient diffusion probabilistic model with residual shifting

Objective:This study introduces a residual error-shifting mechanism that drastically reduces sampling steps while preserving critical anatomical details, thus accelerating MRI reconstruction. Approach:We propose a novel diffusion-based SR framework called Res-SRDiff, which integrates residual error shifting into the forward diffusion process. This enables efficient HR image reconstruction by aligning the degraded HR and LR distributions.We evaluated Res-SRDiff on ultra-high-field brain T1 MP2RAGE maps and T2-weighted prostate images, comparing it with Bicubic, Pix2pix, CycleGAN, and a conventional denoising diffusion probabilistic model with vision transformer backbone (TM-DDPM), using quantitative metrics such as peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), gradient magnitude similarity deviation (GMSD), and learned perceptual image patch similarity (LPIPS). Main results: Res-SRDiff significantly outperformed all comparative methods in terms of PSNR, SSIM, and GMSD across both datasets, with statistically significant improvements (p-values<<0.05). The model achieved high-fidelity image restoration with only four sampling steps, drastically reducing computational time to under one second per slice, which is substantially faster than conventional TM-DDPM with around 20 seconds per slice. Qualitative analyses further demonstrated that Res-SRDiff effectively preserved fine anatomical details and lesion morphology in both brain and pelvic MRI images. Significance: Our findings show that Res-SRDiff is an efficient and accurate MRI SR method, markedly improving computational efficiency and image quality. Integrating residual error shifting into the diffusion process allows for rapid and robust HR image reconstruction, enhancing clinical MRI workflows and advancing medical imaging research. The source at:https://github.com/mosaf/Res-SRDiff

cs.CV↗

arXiv2025

Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging

Vision foundation models (VFMs) are pre-trained on extensive image datasets to learn general representations for diverse types of data. These models can subsequently be fine-tuned for specific downstream tasks, significantly boosting performance across a broad range of applications. However, existing vision foundation models that claim to be applicable to various clinical tasks are mostly pre-trained on 3D computed tomography (CT), which benefits from the availability of extensive 3D CT databases. Significant differences between CT and magnetic resonance imaging (MRI) in imaging principles, signal characteristics, and data distribution may hinder their practical performance and versatility in MRI-specific applications. Here, we propose Triad, a vision foundation model for 3D MRI. Triad adopts a widely used autoencoder architecture to learn robust representations from 131,170 3D MRI volumes and uses organ-independent imaging descriptions to constrain the semantic distribution of the visual modality. The above pre-training dataset is called Triad-131K, which is currently the largest 3D MRI pre-training dataset. We evaluate Triad across three tasks, namely, organ/tumor segmentation, organ/cancer classification, and medical image registration, in two data modalities (within-domain and out-of-domain) settings using 25 downstream datasets. By initializing models with Triad's pre-trained weights, nnUNet-Triad improves segmentation performance by 2.51% compared to nnUNet-Scratch across 17 datasets. Swin-B-Triad achieves a 3.97% improvement over Swin-B-Scratch in classification tasks across five datasets. SwinUNETR-Triad improves by 4.00% compared to SwinUNETR-Scratch in registration tasks across two datasets. Our study demonstrates that pre-training can improve performance when the data modalities and organs of upstream and downstream tasks are consistent.

cs.CV↗

arXiv2025

A Physics-Informed Deep Learning Model for MRI Brain Motion Correction

Background: MRI is crucial for brain imaging but is highly susceptible to motion artifacts due to long acquisition times. This study introduces PI-MoCoNet, a physics-informed motion correction network that integrates spatial and k-space information to remove motion artifacts without explicit motion parameter estimation, enhancing image fidelity and diagnostic reliability. Materials and Methods: PI-MoCoNet consists of a motion detection network (U-net with spatial averaging) to identify corrupted k-space lines and a motion correction network (U-net with Swin Transformer blocks) to reconstruct motion-free images. The correction is guided by three loss functions: reconstruction (L1), perceptual (LPIPS), and data consistency (Ldc). Motion artifacts were simulated via rigid phase encoding perturbations and evaluated on IXI and MR-ART datasets against Pix2Pix, CycleGAN, and U-net using PSNR, SSIM, and NMSE. Results: PI-MoCoNet significantly improved image quality. On IXI, for minor artifacts, PSNR increased from 34.15 dB to 45.95 dB, SSIM from 0.87 to 1.00, and NMSE reduced from 0.55% to 0.04%. For moderate artifacts, PSNR improved from 30.23 dB to 42.16 dB, SSIM from 0.80 to 0.99, and NMSE from 1.32% to 0.09%. For heavy artifacts, PSNR rose from 27.99 dB to 36.01 dB, SSIM from 0.75 to 0.97, and NMSE decreased from 2.21% to 0.36%. On MR-ART, PI-MoCoNet achieved PSNR gains of ~10 dB and SSIM improvements of up to 0.20, with NMSE reductions of ~6%. Ablation studies confirmed the importance of data consistency and perceptual losses, yielding a 1 dB PSNR gain and 0.17% NMSE reduction. Conclusions: PI-MoCoNet effectively mitigates motion artifacts in brain MRI, outperforming existing methods. Its ability to integrate spatial and k-space information makes it a promising tool for clinical use in motion-prone settings. Code: https://github.com/mosaf/PI-MoCoNet.git.

cs.CV↗

arXiv2024

Optimization-Based Image Reconstruction Regularized with Inter-Spectral Structural Similarity for Limited-Angle Dual-Energy Cone-Beam CT

Background: Limited-angle (LA) dual-energy (DE) cone-beam CT (CBCT) is considered as a potential solution to achieve fast and low-dose DE imaging on current CBCT scanners without hardware modification. However, its clinical implementations are hindered by the challenging image reconstruction from LA projections. While optimization-based and deep learning-based methods have been proposed for image reconstruction, their utilization is limited by the requirement for X-ray spectra measurement or paired datasets for model training. Purpose: This work aims to facilitate the clinical applications of fast and low-dose DECBCT by developing a practical solution for image reconstruction in LA-DECBCT. Methods: An inter-spectral structural similarity-based regularization was integrated into the iterative image reconstruction in LA-DECBCT. By enforcing the similarity between the DE images, LA artifacts were efficiently reduced in the reconstructed DECBCT images. The proposed method was evaluated using four physical phantoms and three digital phantoms, demonstrating its efficacy in quantitative DECBCT imaging. Conclusions: The proposed method achieves accurate image reconstruction without the need for X-ray spectra measurement for optimization or paired datasets for model training, showing great practical value in clinical implementations of LA-DECBCT.

physics.med-ph↗

arXiv2024

T1-contrast Enhanced MRI Generation from Multi-parametric MRI for Glioma Patients with Latent Tumor Conditioning

Objective: Gadolinium-based contrast agents (GBCAs) are commonly used in MRI scans of patients with gliomas to enhance brain tumor characterization using T1-weighted (T1W) MRI. However, there is growing concern about GBCA toxicity. This study develops a deep-learning framework to generate T1-postcontrast (T1C) from pre-contrast multiparametric MRI. Approach: We propose the tumor-aware vision transformer (TA-ViT) model that predicts high-quality T1C images. The predicted tumor region is significantly improved (P < .001) by conditioning the transformer layers from predicted segmentation maps through adaptive layer norm zero mechanism. The predicted segmentation maps were generated with the multi-parametric residual (MPR) ViT model and transformed into a latent space to produce compressed, feature-rich representations. The TA-ViT model predicted T1C MRI images of 501 glioma cases. Selected patients were split into training (N=400), validation (N=50), and test (N=51) sets. Main Results: Both qualitative and quantitative results demonstrate that the TA-ViT model performs superior against the benchmark MRP-ViT model. Our method produces synthetic T1C MRI with high soft tissue contrast and more accurately reconstructs both the tumor and whole brain volumes. The synthesized T1C images achieved remarkable improvements in both tumor and healthy tissue regions compared to the MRP-ViT model. For healthy tissue and tumor regions, the results were as follows: NMSE: 8.53 +/- 4.61E-4; PSNR: 31.2 +/- 2.2; NCC: 0.908 +/- .041 and NMSE: 1.22 +/- 1.27E-4, PSNR: 41.3 +/- 4.7, and NCC: 0.879 +/- 0.042, respectively. Significance: The proposed method generates synthetic T1C images that closely resemble real T1C images. Future development and application of this approach may enable contrast-agent-free MRI for brain tumor patients, eliminating the risk of GBCA toxicity and simplifying the MRI scan protocol.

eess.IV↗

arXiv2024

Adaptive Proton Therapy Using CBCT-Guided Digital Twins

This study aims to develop a digital twin (DT) framework to enhance adaptive proton stereotactic body radiation therapy (SBRT) for prostate cancer. Prostate SBRT has emerged as a leading option for external beam radiotherapy due to its effectiveness and reduced treatment duration. However, interfractional anatomy variations can impact treatment outcomes. This study seeks to address these uncertainties using DT concept, with the goal of improving treatment quality, potentially revolutionizing prostate radiotherapy to offer personalized treatment solutions. Our study presented a pioneering approach that leverages DT technology to enhance adaptive proton SBRT. The framework improves treatment plans by utilizing patient-specific CTV setup uncertainty, which is usually smaller than conventional clinical setups. This research contributes to the ongoing efforts to enhance the efficiency and efficacy of prostate radiotherapy, with ultimate goals of improving patient outcomes and life quality.

physics.med-ph↗

arXiv2023

Streamlined Pin-Ridge-Filter Design for Single-energy Proton FLASH Planning

Purpose: This study explored the feasibility of a streamlined pin-shaped ridge filter (pin-RF) design for single-energy proton FLASH planning. Methods: An inverse planning framework integrated within a TPS was established for FLASH planning. The framework involves generating a IMPT plan based on downstream energy modulation strategy (IMPT-DS), followed by a nested spot reduction process to iteratively reduce the total number of pencil beam directions (PBDs) and energy layers along each PBD for the IMPT-DS plan. The IMPT-DS plan is then translated into the pin-RFs for a single-energy IMPT plan (IMPT-RF). The framework was validated on three lung cases, quantifying the FLASH dose of the IMPT-RF plan using the FLASH effectiveness model and comparing it with the reference dose of a conventional IMPT plan to assess the clinical benefit of the FLASH planning technique. Results: The IMPT-RF plans closely matched the corresponding IMPT-DS plans in high dose conformity, with minimal changes in V7Gy and V7.4Gy for the lung (< 5%) and small increases in Dmax for other OARs (< 3.2 Gy). Comparing the FLASH doses to the doses of corresponding IMPT-RF plans, drastic reductions of up to ~33% were observed in Dmax for OARs in the high-to-moderate-dose regions with negligible changes in Dmax for OARs in low-dose regions. Positive clinical benefits were observed with notable reductions of 18.4-33.0% in Dmax for OARs in the high-dose regions. However, in the moderate-to-low-dose regions, only marginal positive or even negative clinical benefit for OARs were observed, such as increased lung V7Gy and V7.4Gy (16.4-38.9%). Conclusions: A streamlined pin-RF design for single-energy proton FLASH planning was validated, revealing positive clinical benefits for OARs in the high dose regions. The coarsened design of the pin-RF demonstrates potential cost efficiency and efficient production.

physics.med-ph↗

arXiv2023

Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model

Magnetic resonance imaging (MRI)-based synthetic computed tomography (sCT) simplifies radiation therapy treatment planning by eliminating the need for CT simulation and error-prone image registration, ultimately reducing patient radiation dose and setup uncertainty. We propose an MRI-to-CT transformer-based denoising diffusion probabilistic model (MC-DDPM) to transform MRI into high-quality sCT to facilitate radiation treatment planning. MC-DDPM implements diffusion processes with a shifted-window transformer network to generate sCT from MRI. The proposed model consists of two processes: a forward process which adds Gaussian noise to real CT scans, and a reverse process in which a shifted-window transformer V-net (Swin-Vnet) denoises the noisy CT scans conditioned on the MRI from the same patient to produce noise-free CT scans. With an optimally trained Swin-Vnet, the reverse diffusion process was used to generate sCT scans matching MRI anatomy. We evaluated the proposed method by generating sCT from MRI on a brain dataset and a prostate dataset. Qualitative evaluation was performed using the mean absolute error (MAE) of Hounsfield unit (HU), peak signal to noise ratio (PSNR), multi-scale Structure Similarity index (MS-SSIM) and normalized cross correlation (NCC) indexes between ground truth CTs and sCTs. MC-DDPM generated brain sCTs with state-of-the-art quantitative results with MAE 43.317 HU, PSNR 27.046 dB, SSIM 0.965, and NCC 0.983. For the prostate dataset, MC-DDPM achieved MAE 59.953 HU, PSNR 26.920 dB, SSIM 0.849, and NCC 0.948. In conclusion, we have developed and validated a novel approach for generating CT images from routine MRIs using a transformer-based DDPM. This model effectively captures the complex relationship between CT and MRI images, allowing for robust and high-quality synthetic CT (sCT) images to be generated in minutes.

eess.IV↗

arXiv2023

CBCT-Based Synthetic CT Image Generation Using Conditional Denoising Diffusion Probabilistic Model

Background: Daily or weekly cone-beam computed tomography (CBCT) scans are commonly used for accurate patient positioning during the image-guided radiotherapy (IGRT) process, making it an ideal option for adaptive radiotherapy (ART) replanning. However, the presence of severe artifacts and inaccurate Hounsfield unit (HU) values prevent its use for quantitative applications such as organ segmentation and dose calculation. To enable the clinical practice of online ART, it is crucial to obtain CBCT scans with a quality comparable to that of a CT scan. Purpose: This work aims to develop a conditional diffusion model to perform image translation from the CBCT to the CT domain for the image quality improvement of CBCT. Methods: The proposed method is a conditional denoising diffusion probabilistic model (DDPM) that utilizes a time-embedded U-net architecture with residual and attention blocks to gradually transform standard Gaussian noise to the target CT distribution conditioned on the CBCT. The model was trained on deformed planning CT (dpCT) and CBCT image pairs, and its feasibility was verified in brain patient study and head-and-neck (H&N) patient study. The performance of the proposed algorithm was evaluated using mean absolute error (MAE), peak signal-to-noise ratio (PSNR) and normalized cross-correlation (NCC) metrics on generated synthetic CT (sCT) samples. The proposed method was also compared to four other diffusion model-based sCT generation methods. Conclusions: The proposed conditional DDPM method can generate sCT from CBCT with accurate HU numbers and reduced artifacts, enabling accurate CBCT-based organ segmentation and dose calculation for online ART.

physics.med-ph↗

arXiv2022

A Retrospective Study on the Investigation of Potential Clinical Benefits of Online Adaptive Proton Therapy for Head and Neck Cancer

Online adaptive proton therapy (APT) is an ideal solution theoretically, which however is challenging to proton clinics. Although multiple groups have been endeavoring to develop online APT technology, there is a concern in the radiotherapy community about the necessity of online APT because of its unknown impact on treatment outcomes. Hence, we have performed a retrospective study to investigate the potential clinical effects of online APT for HN cancer patients in relative to the current offline APT via simulations. To mimic an online APT treatment course, we have recalculated and evaluated the actual dose of the current treatment plan on patient actual treatment anatomy captured by cone beam CT for each fraction. The cumulative dose of simulated online APT courses was compared to actual offline APT courses and the initially designed treatment plan dose. For patients 1 and 2, the simulated online ART course maintained a relatively higher CTV dose coverages than the offline ART course, particularly for CTV-Low, which led to an improvement of 2.66% and 4.52% in TCP of CTV-Low. For patients 3 and 4, with clinically comparable CTV dose coverages, the simulated online ART course achieved better OAR sparing than the offline ART course. The mean doses of right parotid and oral cavity were decreased from 29.52 Gy relative biological effectiveness (RBE) and 41.89 Gy RBE to 22.16 Gy RBE and 34.61 Gy RBE for patient 3, leading to a reduce of 1.67% and 3.40% in NTCP for the two organs. Compared to the current clinical practice, the retrospective study indicated that online APT tended to spare more normal tissues by achieving the clinical goal with merely half of the positional uncertainty margin. Future studies are needed to help identify the patients with large potential benefits prior to treatment to conserve scarce clinical resources.

physics.med-ph↗