SearcharxivSearch

arXiv subjects

Erich Schmitz

Publications and source records attributed to Erich Schmitz.

2 recordsLinked to original sources

Comparing the Performance of Foundation Model Derived Embeddings with Traditional Approaches for Distant Metastasis Prediction in Head and Neck Cancer

Background: Early prediction of distant metastasis (DM) risk in head and neck cancer (HNC) can enable timely interventions that may improve treatment outcomes. Many current machine learning methods rely on prior knowledge of the region of interest such as tumor segmentations, which require expert knowledge, is time-consuming and introduces user-dependent variability. Medical image-based foundation models have recently been developed for specific imaging modalities to streamline down-stream prediction tasks by extracting modality-relevant features. Purpose: In this study, we evaluate the effectiveness of using a foundation model as the feature extractor to predict DM risk in HNC patients and compare its performance with traditional approaches that require prior knowledge on the regions of interest. Methods: Preoperative CT images of 2327 patients from the RADCURE dataset were used. Three features-sets were created including radiomics, deep-learning based features, and CT Foundation derived features. The feature-sets were used individually in a multi-layer perceptron (MLP) to predict DM risk. Results: The model using CT Foundation embeddings outperformed the radiomics and deep learning-based models, achieving a Receiver Operating Characteristic Area Under the Curve (AUC) of 0.791, compared to AUC values of 0.772 and 0.753 for the radiomics and deep learning-based models, respectively. The CT Foundation based model had similar performance to a model that combined the use of radiomics and deep learning-based features that achieved an AUC of 0.794. Conclusions: Features based on foundation models offer a promising alternative to traditional radiomics while reducing the need for domain expertise and extensively annotated datasets. Their minimal preprocessing requirements also make them a more accessible and scalable option.

cs.CV

Adaptive Fine-tuning based Transfer Learning for the Identification of MGMT Promoter Methylation Status

Glioblastoma Multiforme (GBM) is an aggressive form of malignant brain tumor with a generally poor prognosis. Treatment usually includes a mix of surgical resection, radiation therapy, and akylating chemotherapy but, even with these intensive treatments, the 2-year survival rate is still very low. O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation has been shown to be a predictive bio-marker for resistance to chemotherapy, but it is invasive and time-consuming to determine the methylation status. Due to this, there has been effort to predict the MGMT methylation status through analyzing MRI scans using machine learning, which only requires pre-operative scans that are already part of standard-of-care for GBM patients. We developed a 3D SpotTune network with adaptive fine-tuning capability to improve the performance of conventional transfer learning in the identification of MGMT promoter methylation status. Using the pretrained weights of MedicalNet coupled with the SpotTune network, we compared its performance with two equivalent networks: one that is initialized with MedicalNet weights, but with no adaptive fine-tuning and one initialized with random weights. These three networks are trained and evaluated using the UPENN-GBM dataset, a public GBM dataset provided by the University of Pennsylvania. The SpotTune network enables transfer learning to be adaptive to individual patients, resulting in improved performance in predicting MGMT promoter methylation status in GBM using MRIs as compared to using a network with randomly initialized weights.

physics.med-ph