SearcharxivSearch

arXiv subjects

Huihong Zhang

Publications and source records attributed to Huihong Zhang.

4 recordsLinked to original sources

Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning

The choroid provides oxygen and nourishment to the outer retina thus is related to the pathology of various ocular diseases. Optical coherence tomography (OCT) is advantageous in visualizing and quantifying the choroid in vivo. (1) The lower boundary of the choroid (choroid-sclera interface) in OCT is fuzzy, which makes the automatic segmentation difficult and inaccurate. (2) The visualization of the choroid is hindered by the vessel shadows from the superficial layers of the inner retina. In this paper, we propose to incorporate medical and imaging prior knowledge with deep learning to address these two problems. We propose a biomarker infused global-to-local network for the choroid segmentation. It leverages the choroidal thickness, a primary biomarker in clinic, as a constraint to improve the segmentation accuracy. We also design a global-to-local strategy in the choroid segmentation: a global module is used to segment all the retinal and choroidal layers simultaneously for suppressing overfitting and providing global structure information, then a local module is used to refine the segmentation with the biomarker infusion. To eliminate the retinal vessel shadows, we propose a pipeline that firstly use anatomical and OCT imaging knowledge to locate the shadows using their projection on the retinal pigment epithelium layer, then the contents of the choroidal vasculature at the shadow locations are predicted with an edge-to-texture generative adversarial inpainting network. The experiments show our method outperforms the existing methods on both the segmentation and shadow elimination tasks. We further apply the proposed method in a clinical prospective study for understanding the pathology of glaucoma by detecting the structure and vascular changes of the choroid related to the elevation of intra-ocular pressure.

eess.IV

BioNet: Infusing Biomarker Prior into Global-to-Local Network for Choroid Segmentation in Optical Coherence Tomography Images

Choroid is the vascular layer of the eye, which is directly related to the incidence and severity of many ocular diseases. Optical Coherence Tomography (OCT) is capable of imaging both the cross-sectional view of retina and choroid, but the segmentation of the choroid region is challenging because of the fuzzy choroid-sclera interface (CSI). In this paper, we propose a biomarker infused global-to-local network (BioNet) for choroid segmentation, which segments the choroid with higher credibility and robustness. Firstly, our method trains a biomarker prediction network to learn the features of the biomarker. Then a global multi-layers segmentation module is applied to segment the OCT image into 12 layers. Finally, the global multi-layered result and the original OCT image are fed into a local choroid segmentation module to segment the choroid region with the biomarker infused as regularizer. We conducted comparison experiments with the state-of-the-art methods on a dataset (named AROD). The experimental results demonstrate the superiority of our method with $90.77\%$ Dice-index and 6.23 pixels Average-unsigned-surface-detection-error, etc.

cs.CV

Knowledge infused cascade convolutional neural network for segmenting retinal vessels in volumetric optical coherence tomography

We present a cascade deep neural network to segment retinal vessels in volumetric optical coherence tomography (OCT). Two types of knowledge are infused into the network for confining the searching regions. (1) Histology. The retinal vessels locate between the inner limiting membrane and the inner nuclear layer of human retina. (2) Imaging. The red blood cells inside the vessels scatter the OCT probe light forward and form projection shadows on the retinal pigment epithelium (RPE) layer, which is avascular thus perfect for localizing the retinal vessel in transverse plane. Qualitative and quantitative comparison results show that the proposed method outperforms the state-of-the-art deep learning and graph-based methods. This work demonstrates, instead of modifying the architectures of the deep networks, incorporating proper prior knowledge in the design of the image processing framework could be an efficient approach for handling such specific tasks.

eess.IV

Eliminating Shadow Artifacts via Generative Inpainting Networks to Quantify Vascular Changes of the Choroid

Shadow artifacts from retinal vessels hinder the development of quantitative choroidal biomarkers in Optical Coherence Tomography (OCT), which limits the clinical applications of the choroidal OCT to the measures of layer thickness. In this paper, we present a novel framework that could eliminate the retinal shadows and realize the quantification of choroidal vasculature. Different from existing methods, we convert the shadow elimination into an object removal task, which can be handled by image inpainting techniques. We adopt and finetune a two-stage generative inpainting network which connects the edges of the vessels ahead of refilling the shadow-contaminated areas. It shows surpassing performance in repairing the choroidal vasculature compared with traditional inpainting algorithms. We further verify the feasibility of the proposed frame using a prospective observational study, which detects the choroidal vascular changes related to the Intra-Ocular Pressure (IOP) elevation of 34 healthy volunteers. As the average IOP increases from $15.84\pm1.99$ mmHg to $34.48\pm5.35$ mmHg, we achieve the decreases of the choroidal vessel density and flow index from $0.491\pm0.020$ to $0.463\pm0.019$ and from $0.336\pm0.025$ to $0.300\pm0.019$, respectively.

physics.med-ph