arXiv subjects

Orcun Goksel

Publications and source records attributed to Orcun Goksel.

At least 37 records · Page 2Linked to original sources

arXiv2022

Global Speed-of-Sound Prediction Using Transmission Geometry

Most ultrasound (US) imaging techniques use spatially-constant speed-of-sound (SoS) values for beamforming. Having a discrepancy between the actual and used SoS value leads to aberration artifacts, e.g., reducing the image resolution, which may affect diagnostic usability. Accuracy and quality of different US imaging modalities, such as tomographic reconstruction of local SoS maps, also depend on a good initial beamforming SoS. In this work, we develop an analytical method for estimating mean SoS in an imaged medium. We show that the relative shifts between beamformed frames depend on the SoS offset and the geometric disparities in transmission paths. Using this relation, we estimate a correction factor and hence a corrected mean SoS in the medium. We evaluated our proposed method on a set of numerical simulations, demonstrating its utility both for global SoS prediction and for local SoS tomographic reconstruction. For our evaluation dataset, for an initial SoS under- and over-assumption of 5% the medium SoS, our method is able to predict the actual mean SoS within 0.3% accuracy. For the tomographic reconstruction of local SoS maps, the reconstruction accuracy is improved on average by 78.5% and 87%, respectively, compared to an initial SoS under- and over-assumption of 5%.

physics.med-ph↗

arXiv2022

Unsupervised Domain Adaptation with Contrastive Learning for OCT Segmentation

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail for images that do not resemble labeled examples, e.g. for images acquired using different devices. We hereby propose a novel semi-supervised learning framework for segmentation of volumetric images from new unlabeled domains. We jointly use supervised and contrastive learning, also introducing a contrastive pairing scheme that leverages similarity between nearby slices in 3D. In addition, we propose channel-wise aggregation as an alternative to conventional spatial-pooling aggregation for contrastive feature map projection. We evaluate our methods for domain adaptation from a (labeled) source domain to an (unlabeled) target domain, each containing images acquired with different acquisition devices. In the target domain, our method achieves a Dice coefficient 13.8% higher than SimCLR (a state-of-the-art contrastive framework), and leads to results comparable to an upper bound with supervised training in that domain. In the source domain, our model also improves the results by 5.4% Dice, by successfully leveraging information from many unlabeled images.

cs.CV↗

arXiv2022

Differentiable Zooming for Multiple Instance Learning on Whole-Slide Images

Multiple Instance Learning (MIL) methods have become increasingly popular for classifying giga-pixel sized Whole-Slide Images (WSIs) in digital pathology. Most MIL methods operate at a single WSI magnification, by processing all the tissue patches. Such a formulation induces high computational requirements, and constrains the contextualization of the WSI-level representation to a single scale. A few MIL methods extend to multiple scales, but are computationally more demanding. In this paper, inspired by the pathological diagnostic process, we propose ZoomMIL, a method that learns to perform multi-level zooming in an end-to-end manner. ZoomMIL builds WSI representations by aggregating tissue-context information from multiple magnifications. The proposed method outperforms the state-of-the-art MIL methods in WSI classification on two large datasets, while significantly reducing the computational demands with regard to Floating-Point Operations (FLOPs) and processing time by up to 40x.

cs.CV↗

arXiv2022

Spectral Ultrasound Imaging of Speed-of-Sound and Attenuation Using an Acoustic Mirror

Speed-of-sound and attenuation of ultrasound waves vary in the tissues. There exist methods in the literature that allow for spatially reconstructing the distribution of group speed-of-sound (SoS) and frequency-dependent ultrasound attenuation (UA) using reflections from an acoustic mirror positioned at a known distance from the transducer. These methods utilize a conventional ultrasound transducer operating in pulse-echo mode and a calibration protocol with measurements in water. In this study, we introduce a novel method for reconstructing local SoS and UA maps as a function of acoustic frequency through Fourier-domain analysis and by fitting linear and power-law dependency models in closed form. Frequency-dependent SoS and UA together characterize the tissue comprehensively in spectral domain within the utilized transducer bandwidth. In simulations, our proposed methods are shown to yield low reconstruction error: 0.01 dB/cm.MHz^y for attenuation coefficient and 0.05 for the frequency exponent. For tissue-mimicking phantoms and ex-vivo bovine muscle samples, a high reconstruction contrast was achieved. Attenuation exponents in a gelatin-cellulose mixture and an ex-vivo bovine muscle sample were found to be, respectively, 1.3 and 0.6 on average. Linear dispersion of SoS in a gelatin-cellulose mixture and an ex-vivo bovine muscle sample were found to be, respectively, 1.3 and 4.0 m/s.MHz on average. These findings were reproducible when the inclusion and substrate materials were exchanged. Bulk loss modulus in the bovine muscle sample was computed to be approximately 4 times the bulk loss modulus in the gelatin-cellulose mixture. Such frequency-dependent characteristics of SoS and UA, and bulk loss modulus may therefore differentiate tissues as potential diagnostic biomarkers.

physics.med-ph↗

arXiv2021

Content-Preserving Unpaired Translation from Simulated to Realistic Ultrasound Images

Interactive simulation of ultrasound imaging greatly facilitates sonography training. Although ray-tracing based methods have shown promising results, obtaining realistic images requires substantial modeling effort and manual parameter tuning. In addition, current techniques still result in a significant appearance gap between simulated images and real clinical scans. Herein we introduce a novel content-preserving image translation framework (ConPres) to bridge this appearance gap, while maintaining the simulated anatomical layout. We achieve this goal by leveraging both simulated images with semantic segmentations and unpaired in-vivo ultrasound scans. Our framework is based on recent contrastive unpaired translation techniques and we propose a regularization approach by learning an auxiliary segmentation-to-real image translation task, which encourages the disentanglement of content and style. In addition, we extend the generator to be class-conditional, which enables the incorporation of additional losses, in particular a cyclic consistency loss, to further improve the translation quality. Qualitative and quantitative comparisons against state-of-the-art unpaired translation methods demonstrate the superiority of our proposed framework.

eess.IV↗

arXiv2021

Estimating Mean Speed-of-Sound from Sequence-Dependent Geometric Disparities

In ultrasound beamforming, focusing time delays are typically computed with a spatially constant speed-of-sound (SoS) assumption. A mismatch between beamforming and true medium SoS then leads to aberration artifacts. Other imaging techniques such as spatially-resolved SoS reconstruction using tomographic techniques also rely on a good SoS estimate for initial beamforming. In this work, we exploit spatially-varying geometric disparities in the transmit and receive paths of multiple sequences for estimating a mean medium SoS. We use images from diverging waves beamformed with an assumed SoS, and propose a model fitting method for estimating the SoS offset. We demonstrate the effectiveness of our proposed method for tomographic SoS reconstruction. With corrected beamforming SoS, the reconstruction accuracy on simulated data was improved by 63% and 29%, respectively, for an initial SoS over- and under-estimation of 1.5%. We further demonstrate our proposed method on a breast phantom, indicating substantial improvement in contrast-to-noise ratio for local SoS mapping.

eess.IV↗

arXiv2021

Phase-Aberration Correction in Shear-wave Elastography Imaging Using Local Speed-of-Sound Adaptive Beamforming

Shear-wave Elastography Imaging (SWEI) is a noninvasive imaging modality that provides tissue elasticity information by measuring the travelling speed of an induced shear-wave. It is commercially available on clinical ultrasound scanners and popularly used in the diagnosis and staging of liver disease and breast cancer. In conventional SWEI methods, a sequence of acoustic radiation force (ARF) pushes are used for inducing a shear-wave, which is tracked using high frame-rate multi-angle plane wave imaging (MA-PWI) to estimate the shear-wave speed (SWS). Conventionally, these plane waves are beamformed using a constant speed-of-sound (SoS), assuming an a-priori known and homogeneous tissue medium. However, soft tissues are inhomogeneous, with intrinsic SoS variations. In this work, study the SoS effects and inhomogeneities on SWS estimation, using simulation and phantoms experiments with porcine muscle as an abbarator, and show how these aberrations can be corrected using local speed-of-sound adaptive beamforming. For shear-wave tracking, we compare standard beamform with spatially constant SoS values to software beamforming with locally varying SoS maps. We show that, given SoS aberrations, traditional beamforming using a constant SoS, regardless of the utilized SoS value, introduces a substantial bias in resulting SWS estimations. Average SWS estimation disparity for the same material was observed over 4.3 times worse when a constant SoS value is used compared to that when a known SoS map is used for beamforming. Such biases are shown to be corrected by using a local SoS map in beamforming, indicating the importance of and a need for local SoS reconstruction techniques.

physics.med-ph↗

arXiv2021

Modality Attention and Sampling Enables Deep Learning with Heterogeneous Marker Combinations in Fluorescence Microscopy

Fluorescence microscopy allows for a detailed inspection of cells, cellular networks, and anatomical landmarks by staining with a variety of carefully-selected markers visualized as color channels. Quantitative characterization of structures in acquired images often relies on automatic image analysis methods. Despite the success of deep learning methods in other vision applications, their potential for fluorescence image analysis remains underexploited. One reason lies in the considerable workload required to train accurate models, which are normally specific for a given combination of markers, and therefore applicable to a very restricted number of experimental settings. We herein propose Marker Sampling and Excite, a neural network approach with a modality sampling strategy and a novel attention module that together enable (i) flexible training with heterogeneous datasets with combinations of markers and (ii) successful utility of learned models on arbitrary subsets of markers prospectively. We show that our single neural network solution performs comparably to an upper bound scenario where an ensemble of many networks is naïvely trained for each possible marker combination separately. In addition, we demonstrate the feasibility of this framework in high-throughput biological analysis by revising a recent quantitative characterization of bone marrow vasculature in 3D confocal microscopy datasets and further confirm the validity of our approach on an additional, significantly different dataset of microvessels in fetal liver tissues. Not only can our work substantially ameliorate the use of deep learning in fluorescence microscopy analysis, but it can also be utilized in other fields with incomplete data acquisitions and missing modalities.

cs.CV↗

arXiv2021

Quantifying Explainers of Graph Neural Networks in Computational Pathology

Explainability of deep learning methods is imperative to facilitate their clinical adoption in digital pathology. However, popular deep learning methods and explainability techniques (explainers) based on pixel-wise processing disregard biological entities' notion, thus complicating comprehension by pathologists. In this work, we address this by adopting biological entity-based graph processing and graph explainers enabling explanations accessible to pathologists. In this context, a major challenge becomes to discern meaningful explainers, particularly in a standardized and quantifiable fashion. To this end, we propose herein a set of novel quantitative metrics based on statistics of class separability using pathologically measurable concepts to characterize graph explainers. We employ the proposed metrics to evaluate three types of graph explainers, namely the layer-wise relevance propagation, gradient-based saliency, and graph pruning approaches, to explain Cell-Graph representations for Breast Cancer Subtyping. The proposed metrics are also applicable in other domains by using domain-specific intuitive concepts. We validate the qualitative and quantitative findings on the BRACS dataset, a large cohort of breast cancer RoIs, by expert pathologists.

cs.CV↗

arXiv2021

Motion Estimation for Optical Coherence Elastography Using Signal Phase and Intensity

Displacement estimation in optical coherence tomography (OCT) imaging is relevant for several potential applications, e.g. for optical coherence elastography (OCE) for corneal biomechanical characterization. Larger displacements may be resolved using correlation-based block matching techniques, which however are prone to signal de-correlation and imprecise at commonly desired sub-pixel resolutions. Phase-based tracking methods can estimate tiny sub-wavelength motion, but are not suitable for motion magnitudes larger than half the wavelength due to phase wrapping and the difficulty of any unwrapping due to noise. In this paper a robust OCT displacement estimation method is introduced by formulating tracking as an optimization problem that jointly penalizes intensity disparity, phase difference, and motion discontinuity. This is then solved using yynamic programming, utilizing both sub-wavelength-scale phase and pixel-scale intensity information from OCT imaging, while inherently seeking for the number of phase wraps. This allows for effectively tracking axial and lateral displacements, respectively, with sub-wavelength and pixel scale resolution. Results with tissue mimicking phantoms show that our proposed approach substantially outperforms conventional methods in terms of axial tracking precision, in particular for displacements exceeding half the imaging wavelength.

eess.IV↗

arXiv2021

Hierarchical Graph Representations in Digital Pathology

Cancer diagnosis, prognosis, and therapy response predictions from tissue specimens highly depend on the phenotype and topological distribution of constituting histological entities. Thus, adequate tissue representations for encoding histological entities is imperative for computer aided cancer patient care. To this end, several approaches have leveraged cell-graphs that encode cell morphology and organization to denote the tissue information. These allow for utilizing machine learning to map tissue representations to tissue functionality to help quantify their relationship. Though cellular information is crucial, it is incomplete alone to comprehensively characterize complex tissue structure. We herein treat the tissue as a hierarchical composition of multiple types of histological entities from fine to coarse level, capturing multivariate tissue information at multiple levels. We propose a novel multi-level hierarchical entity-graph representation of tissue specimens to model hierarchical compositions that encode histological entities as well as their intra- and inter-entity level interactions. Subsequently, a graph neural network is proposed to operate on the hierarchical entity-graph representation to map the tissue structure to tissue functionality. Specifically, for input histology images we utilize well-defined cells and tissue regions to build HierArchical Cell-to-Tissue (HACT) graph representations, and devise HACT-Net, a graph neural network, to classify such HACT representations. As part of this work, we introduce the BReAst Carcinoma Subtyping (BRACS) dataset, a large cohort of H&E stained breast tumor images, to evaluate our proposed methodology against pathologists and state-of-the-art approaches. Through comparative assessment and ablation studies, our method is demonstrated to yield superior classification results compared to alternative methods as well as pathologists.

cs.CV↗

arXiv2021

Learning Whole-Slide Segmentation from Inexact and Incomplete Labels using Tissue Graphs

Segmenting histology images into diagnostically relevant regions is imperative to support timely and reliable decisions by pathologists. To this end, computer-aided techniques have been proposed to delineate relevant regions in scanned histology slides. However, the techniques necessitate task-specific large datasets of annotated pixels, which is tedious, time-consuming, expensive, and infeasible to acquire for many histology tasks. Thus, weakly-supervised semantic segmentation techniques are proposed to utilize weak supervision that is cheaper and quicker to acquire. In this paper, we propose SegGini, a weakly supervised segmentation method using graphs, that can utilize weak multiplex annotations, i.e. inexact and incomplete annotations, to segment arbitrary and large images, scaling from tissue microarray (TMA) to whole slide image (WSI). Formally, SegGini constructs a tissue-graph representation for an input histology image, where the graph nodes depict tissue regions. Then, it performs weakly-supervised segmentation via node classification by using inexact image-level labels, incomplete scribbles, or both. We evaluated SegGini on two public prostate cancer datasets containing TMAs and WSIs. Our method achieved state-of-the-art segmentation performance on both datasets for various annotation settings while being comparable to a pathologist baseline.

cs.CV↗

arXiv2021

Probabilistic Spatial Analysis in Quantitative Microscopy with Uncertainty-Aware Cell Detection using Deep Bayesian Regression of Density Maps

3D microscopy is key in the investigation of diverse biological systems, and the ever increasing availability of large datasets demands automatic cell identification methods that not only are accurate, but also can imply the uncertainty in their predictions to inform about potential errors and hence confidence in conclusions using them. While conventional deep learning methods often yield deterministic results, advances in deep Bayesian learning allow for accurate predictions with a probabilistic interpretation in numerous image classification and segmentation tasks. It is however nontrivial to extend such Bayesian methods to cell detection, which requires specialized learning frameworks. In particular, regression of density maps is a popular successful approach for extracting cell coordinates from local peaks in a postprocessing step, which hinders any meaningful probabilistic output. We herein propose a deep learning-based cell detection framework that can operate on large microscopy images and outputs desired probabilistic predictions by (i) integrating Bayesian techniques for the regression of uncertainty-aware density maps, where peak detection can be applied to generate cell proposals, and (ii) learning a mapping from the numerous proposals to a probabilistic space that is calibrated, i.e. accurately represents the chances of a successful prediction. Utilizing such calibrated predictions, we propose a probabilistic spatial analysis with Monte-Carlo sampling. We demonstrate this in revising an existing description of the distribution of a mesenchymal stromal cell type within the bone marrow, where our proposed methods allow us to reveal spatial patterns that are otherwise undetectable. Introducing such probabilistic analysis in quantitative microscopy pipelines will allow for reporting confidence intervals for testing biological hypotheses of spatial distributions.

cs.CV↗

arXiv2021

Utilizing Uncertainty Estimation in Deep Learning Segmentation of Fluorescence Microscopy Images with Missing Markers

Fluorescence microscopy images contain several channels, each indicating a marker staining the sample. Since many different marker combinations are utilized in practice, it has been challenging to apply deep learning based segmentation models, which expect a predefined channel combination for all training samples as well as at inference for future application. Recent work circumvents this problem using a modality attention approach to be effective across any possible marker combination. However, for combinations that do not exist in a labeled training dataset, one cannot have any estimation of potential segmentation quality if that combination is encountered during inference. Without this, not only one lacks quality assurance but one also does not know where to put any additional imaging and labeling effort. We herein propose a method to estimate segmentation quality on unlabeled images by (i) estimating both aleatoric and epistemic uncertainties of convolutional neural networks for image segmentation, and (ii) training a Random Forest model for the interpretation of uncertainty features via regression to their corresponding segmentation metrics. Additionally, we demonstrate that including these uncertainty measures during training can provide an improvement on segmentation performance.

cs.CV↗

arXiv2021

Learning Ultrasound Rendering from Cross-Sectional Model Slices for Simulated Training

Purpose. Given the high level of expertise required for navigation and interpretation of ultrasound images, computational simulations can facilitate the training of such skills in virtual reality. With ray-tracing based simulations, realistic ultrasound images can be generated. However, due to computational constraints for interactivity, image quality typically needs to be compromised. Methods. We propose herein to bypass any rendering and simulation process at interactive time, by conducting such simulations during a non-time-critical offline stage and then learning image translation from cross-sectional model slices to such simulated frames. We use a generative adversarial framework with a dedicated generator architecture and input feeding scheme, which both substantially improve image quality without increase in network parameters. Integral attenuation maps derived from cross-sectional model slices, texture-friendly strided convolutions, providing stochastic noise and input maps to intermediate layers in order to preserve locality are all shown herein to greatly facilitate such translation task. Results. Given several quality metrics, the proposed method with only tissue maps as input is shown to provide comparable or superior results to a state-of-the-art that uses additional images of low-quality ultrasound renderings. An extensive ablation study shows the need and benefits from the individual contributions utilized in this work, based on qualitative examples and quantitative ultrasound similarity metrics. To that end, a local histogram statistics based error metric is proposed and demonstrated for visualization of local dissimilarities between ultrasound images.

eess.IV↗

arXiv2020

Computational Analysis of Subscapularis Tears and Pectoralis Major Transfers on Muscular Activity

Muscle transfers are commonly performed to restore joint function after muscle tears. However, there are not many biomechanical studies of muscle transfers, with the available ones often limited to passive movements in anatomical planes. Using data from three activities of daily living (ADL) and an available computational musculoskeletal model of the shoulder, we analyse the impact of a subscapularis tear and its treatment by a pectoralis major (PMA) transfer of the clavicular, sternal, or both segments. The shoulder model is validated against experimental data: the model kinematics with motion capture, muscle activity with EMG measurements, and model joint reaction force with in-vivo data from an instrumented prosthesis. Our results indicate that subscapularis tear requires a compensatory activation of the supraspinatus and is accompanied by a reduced co-contraction of the infraspinatus, both of which can be partially recovered after PMA transfer. Furthermore, although the PMA acts asynchronously to the subscapularis before the transfer, its patterns of activation change significantly after the transfer. Overall, this study demonstrates that muscle transfers have a significant impact on the neuromuscular system of the joint during active motion, beyond mere kinematics. Capability of a transferred muscle segment to activate similarly to intact subscapularis is found to be dependent on a considered motion. Differences in the activation patterns between intact subscapularis and segments of PMA may explain the difficulty of some patients in adapting their psycho-motor patterns during the rehabilitation period. Thereby, rehabilitation programs could benefit from targeted training on specific motion patterns and biofeedback programs. Finally, the condition of the anterior deltoid should be considered to avoid adding limitations to the joint function before a transfer of the clavicular part.

physics.med-ph↗

arXiv2020

Influence of Rotator Cuff Integrity on Loading and Kinematics Before and After Reverse Shoulder Arthroplasty

Reverse Shoulder Arthroplasty (RSA) has become a very common procedure for shoulder joint replacement, even for scenarios where an anatomical reconstruction would traditionally be used. In this study, we investigate joint reaction forces and scapular kinematics for rotator cuff tears of different tendons with and without a reverse prosthesis. Available motion capture data during anterior flexion was input to a finite-element musculoskeletal shoulder model, and muscle activations were computed using inverse dynamics. The model was validated with respect to in-vivo glenohumeral joint reaction force (JRF) measurements, and also compared to existing clinical and biomechanical data. Simulations were carried out for the intact joint as well as for various tendons involved in a rotator cuff tear: superior (supraspinatus), superior-anterior (supraspinatus and subscapularis), and superior-posterior (supraspinatus, infraspinatus and teres minor). Each rotator cuff tear condition was repeated after shifting the humerus and the glenohumeral joint center of rotation to simulate the effect of a reverse prosthesis. Changes in compressive, shear, and total JRF were analysed, along with scapular upward rotation. The model compared favourably to in-vivo measurements, and existing clinical and biomechanical knowledge. Simulated JRF lie in the ranges of in-vivo JRF measurements and shows a linear increase past 90 degree flexion. Implanting a reverse prosthesis with a functional rotator cuff or with an isolated supraspinatus tear led to over 2 times higher compressive force component than with massive rotator cuff tears (superior-anterior or superior-posterior). Such higher compression forces might increase the risk of wear and implant fracture.

physics.med-ph↗

arXiv2020

Frequency-Dependent Attenuation Reconstruction with an Acoustic Reflector

Attenuation of ultrasound waves varies with tissue composition, hence its estimation offers great potential for tissue characterization and diagnosis and staging of pathology. We recently proposed a method that allows to spatially reconstruct the distribution of the overall ultrasound attenuation in tissue based on computed tomography, using reflections from a passive acoustic reflector. This requires a standard ultrasound transducer operating in pulse-echo mode and a calibration protocol using water measurements, thus it can be implemented on conventional ultrasound systems with minor adaptations. Herein, we extend this method by additionally estimating and imaging the frequency-dependent nature of local ultrasound attenuation for the first time. Spatial distributions of attenuation coefficient and exponent are reconstructed, enabling an elaborate and expressive tissue-specific characterization. With simulations, we demonstrate that our proposed method yields a low reconstruction error of 0.04dB/cm at 1MHz for attenuation coefficient and 0.08 for the frequency exponent. With tissue-mimicking phantoms and ex-vivo bovine muscle samples, a high reconstruction contrast as well as reproducibility are demonstrated. Attenuation exponents of a gelatin-cellulose mixture and an ex-vivo bovine muscle sample were found to be, respectively, 1.4 and 0.5 on average, consistently from different images of their heterogeneous compositions. Such frequency-dependent parametrization could enable novel imaging and diagnostic techniques, as well as facilitate attenuation compensation of other ultrasound-based imaging techniques.

physics.med-ph↗