arXiv subjects

Paul E. Kinahan

Publications and source records attributed to Paul E. Kinahan.

7 recordsLinked to original sources

arXiv2026

Integration of Spectral CT with PET and SPECT: Bringing Tissue Composition Information to Molecular Imaging

Molecular imaging has been transformed by integrating positron emission tomography (PET) or single-photon emission computed tomography (SPECT) with x-ray computed tomography (CT). However, x-ray CT in hybrid imaging is used primarily for anatomical localization and for attenuation and scatter correction of emission data. Its ability to characterize tissue composition remains underutilized. Spectral CT, including dual-energy CT (DECT) and photon-counting CT (PCCT), can provide material-specific information, such as images of iodine concentration, bone or calcium fractions, electron-density, effective atomic number and other spatially-varying material properties. These capabilities create an opportunity to bring tissue-composition information into molecular imaging. In addition, spectral CT can also reduce CT artifacts and provide more accurate corrections for emission data. In this review, we discuss the technical basis, integration pathways, and translational opportunities for combining spectral CT with molecular imaging. We review sequential and integrated PET/DECT approaches, emerging PET/PCCT concepts, PET-enabled spectral CT, and extensions to SPECT/CT. We then examine how spectral CT information may improve attenuation correction, scatter correction, tissue-fraction correction, positron range correction, reconstruction priors, and dosimetry. Clinical and translational applications include contrast-enhanced molecular imaging, vascular and perfusion imaging, quantitative bone marrow imaging, musculoskeletal imaging, and theranostics. Overall, spectral CT integration may move hybrid molecular imaging toward tissue-composition-informed molecular imaging, in which radiotracer signals are interpreted within their material context.

physics.med-ph↗

arXiv2026

A multi-agent system for spine MRI report generation from multi-sequence imaging

Spinal pathology is a leading cause of pain and disability worldwide. Spine MRI is central to clinical evaluation, yet its interpretation remains complex and time-consuming, requiring integration of information across multiple imaging sequences and anatomical regions. Despite recent advances in automated MRI analysis, effectively combining multi-sequence data while preserving sequence-specific diagnostic information remains an open challenge. Here we present SpineAgent, a multi-agent framework for spine MRI report generation built upon a multi-sequence foundation model trained on routine clinical data from 32,047 patients and 453,683 MRI series, comprising a total of 13,441,191 MRI slices. To accommodate diverse modalities of sequences, we first pre-train two DINOv3-based encoders separately on T1- and T2-weighted sequences. We then introduce a continual training strategy that learns a synthesizer to embed images of other sequences using the T1 and T2 encoders, producing patient-level embedding that integrates various signals across MRI sequences. Using these embeddings, SpineAgent achieves state-of-the-art performance, and demonstrates strong generalizability under cross-manufacturer and cross-cohort evaluation. Beyond classification, SpineAgent enables pathology localization by identifying findings-relevant slices and segmenting pathological regions. It also supports multimodal image-report retrieval, providing a solid foundation for scalable and explainable MRI report generation. We further integrate these validated capabilities of SpineAgent into 37 specialized agents. Finally, we incorporate their outputs as structured tokens within a Medical Report Agent trained end-to-end for report generation. Through both automated metrics and expert evaluation by five radiologists, SpineAgent achieves leading performance in spine MRI report generation.

cs.CV↗

arXiv2026

Scale-aware Adaptive Supervised Network with Limited Medical Annotations

Medical image segmentation faces critical challenges in semi-supervised learning scenarios due to severe annotation scarcity requiring expert radiological knowledge, significant inter-annotator variability across different viewpoints and expertise levels, and inadequate multi-scale feature integration for precise boundary delineation in complex anatomical structures. Existing semi-supervised methods demonstrate substantial performance degradation compared to fully supervised approaches, particularly in small target segmentation and boundary refinement tasks. To address these fundamental challenges, we propose SASNet (Scale-aware Adaptive Supervised Network), a dual-branch architecture that leverages both low-level and high-level feature representations through novel scale-aware adaptive reweight mechanisms. Our approach introduces three key methodological innovations, including the Scale-aware Adaptive Reweight strategy that dynamically weights pixel-wise predictions using temporal confidence accumulation, the View Variance Enhancement mechanism employing 3D Fourier domain transformations to simulate annotation variability, and segmentation-regression consistency learning through signed distance map algorithms for enhanced boundary precision. These innovations collectively address the core limitations of existing semi-supervised approaches by integrating spatial, temporal, and geometric consistency principles within a unified optimization framework. Comprehensive evaluation across LA, Pancreas-CT, and BraTS datasets demonstrates that SASNet achieves superior performance with limited labeled data, surpassing state-of-the-art semi-supervised methods while approaching fully supervised performance levels. The source code for SASNet is available at https://github.com/HUANGLIZI/SASNet.

eess.IV↗

arXiv2025

VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledge

The need for improved diagnostic methods in ophthalmology is acute, especially in the underdeveloped regions with limited access to specialists and advanced equipment. Therefore, we introduce VisionUnite, a novel vision-language foundation model for ophthalmology enhanced with clinical knowledge. VisionUnite has been pretrained on an extensive dataset comprising 1.24 million image-text pairs, and further refined using our proposed MMFundus dataset, which includes 296,379 high-quality fundus image-text pairs and 889,137 simulated doctor-patient dialogue instances. Our experiments indicate that VisionUnite outperforms existing generative foundation models such as GPT-4V and Gemini Pro. It also demonstrates diagnostic capabilities comparable to junior ophthalmologists. VisionUnite performs well in various clinical scenarios including open-ended multi-disease diagnosis, clinical explanation, and patient interaction, making it a highly versatile tool for initial ophthalmic disease screening. VisionUnite can also serve as an educational aid for junior ophthalmologists, accelerating their acquisition of knowledge regarding both common and underrepresented ophthalmic conditions. VisionUnite represents a significant advancement in ophthalmology, with broad implications for diagnostics, medical education, and understanding of disease mechanisms. The source code is at https://github.com/HUANGLIZI/VisionUnite.

eess.IV↗

arXiv2022

Issues and Challenges in Applications of Artificial Intelligence to Nuclear Medicine -- The Bethesda Report (AI Summit 2022)

The SNMMI Artificial Intelligence (SNMMI-AI) Summit, organized by the SNMMI AI Task Force, took place in Bethesda, MD on March 21-22, 2022. It brought together various community members and stakeholders from academia, healthcare, industry, patient representatives, and government (NIH, FDA), and considered various key themes to envision and facilitate a bright future for routine, trustworthy use of AI in nuclear medicine. In what follows, essential issues, challenges, controversies and findings emphasized in the meeting are summarized.

physics.med-ph↗

arXiv2022

Synthetic PET via Domain Translation of 3D MRI

Historically, patient datasets have been used to develop and validate various reconstruction algorithms for PET/MRI and PET/CT. To enable such algorithm development, without the need for acquiring hundreds of patient exams, in this paper we demonstrate a deep learning technique to generate synthetic but realistic whole-body PET sinograms from abundantly-available whole-body MRI. Specifically, we use a dataset of 56 $^{18}$F-FDG-PET/MRI exams to train a 3D residual UNet to predict physiologic PET uptake from whole-body T1-weighted MRI. In training we implemented a balanced loss function to generate realistic uptake across a large dynamic range and computed losses along tomographic lines of response to mimic the PET acquisition. The predicted PET images are forward projected to produce synthetic PET time-of-flight (ToF) sinograms that can be used with vendor-provided PET reconstruction algorithms, including using CT-based attenuation correction (CTAC) and MR-based attenuation correction (MRAC). The resulting synthetic data recapitulates physiologic $^{18}$F-FDG uptake, e.g. high uptake localized to the brain and bladder, as well as uptake in liver, kidneys, heart and muscle. To simulate abnormalities with high uptake, we also insert synthetic lesions. We demonstrate that this synthetic PET data can be used interchangeably with real PET data for the PET quantification task of comparing CT and MR-based attenuation correction methods, achieving $\leq 7.6\%$ error in mean-SUV compared to using real data. These results together show that the proposed synthetic PET data pipeline can be reasonably used for development, evaluation, and validation of PET/MRI reconstruction methods.

physics.med-ph↗

arXiv2020

Bone Material Analogues for PET/MRI Phantoms

Purpose: To develop bone material analogues that can be used in construction of phantoms for simultaneous PET/MRI systems. Methods: Plaster was used as the basis for the bone material analogues tested in this study. It was mixed with varying concentrations of an iodinated CT contrast, a gadolinium-based MR contrast agent, and copper sulfate to modulate the attenuation properties and MRI properties (T1 and T2*). Attenuation was measured with CT and 68Ge transmission scans, and MRI properties were measured with quantitative ultrashort echo time pulse sequences. A proof-of-concept skull was created by plaster casting. Results: Undoped plaster has a 511 keV attenuation coefficient (~0.14 cm-1) similar to cortical bone (0.10-0.15 cm-1), but slightly longer T1 (~500 ms) and T2* (~1.2 ms) MR parameters compared to bone (T1 ~ 300 ms, T2* ~ 0.4 ms). Doping with the iodinated agent resulted in increased attenuation with minimal perturbation to the MR parameters. Doping with a gadolinium chelate greatly reduced T1 and T2*, resulting in extremely short T1 values when the target T2* values were reached, while the attenuation coefficient was unchanged. Doping with copper sulfate was more selective for T2* shortening and achieved comparable T1 and T2* values to bone (after 1 week of drying), while the attenuation coefficient was unchanged. Conclusions: Plaster doped with copper sulfate is a promising bone material analogue for a PET/MRI phantom, mimicking the MR properties (T1 and T2*) and 511 keV attenuation coefficient of human cortical bone.

physics.med-ph↗