arXiv subjects

Jae Kyu Choi

Publications and source records attributed to Jae Kyu Choi.

15 recordsLinked to original sources

arXiv2023

Restoration Guarantee of Image Inpainting via Low Rank Patch Matrix Completion

In recent years, patch-based image restoration approaches have demonstrated superior performance compared to conventional variational methods. This paper delves into the mathematical foundations underlying patch-based image restoration methods, with a specific focus on establishing restoration guarantees for patch-based image inpainting, leveraging the assumption of self-similarity among patches. To accomplish this, we present a reformulation of the image inpainting problem as structured low-rank matrix completion, accomplished by grouping image patches with potential overlaps. By making certain incoherence assumptions, we establish a restoration guarantee, given that the number of samples exceeds the order of $rlog^2(N)$, where $N\times N$ denotes the size of the image and $r > 0$ represents the sum of ranks for each group of image patches. Through our rigorous mathematical analysis, we provide valuable insights into the theoretical foundations of patch-based image restoration methods, shedding light on their efficacy and offering guidelines for practical implementation.

cs.IT↗

arXiv2022

Approximation Theory of Wavelet Frame Based Image Restoration

In this paper, we analyze the error estimate of a wavelet frame based image restoration method from degraded and incomplete measurements. We present the error between the underlying original discrete image and the approximate solution which has the minimal $\ell_1$-norm of the canonical wavelet frame coefficients among all possible solutions. Then we further connect the error estimate for the discrete model to the approximation to the underlying function from which the underlying image comes.

math.AP↗

arXiv2022

Two Stage Continuous Domain Regularization for Piecewise Constant Image Restoration

The finite-rate-of-innovation (FRI) framework which corresponds a signal/image to a structured low-rank matrix is emerging as an alternative to the traditional sparse regularization. This is because such an off-the-grid approach is able to alleviate the basis mismatch between the true support in the continuous domain and the discrete grid. In this paper, we propose a two-stage off-the-grid regularization model for the image restoration. Given that the discontinuities/edges of the image lie in the zero level set of a band-limited periodic function, we can derive that the Fourier samples of the gradient of the image satisfy an annihilation relation, resulting in a low-rank two-fold Hankel matrix. In addition, since the singular value decomposition of a low-rank Hankel matrix corresponds to an adaptive tight frame system which can represent the image with sparse canonical coefficients, our approach consists of the following two stages. The first stage learns the tight wavelet frame system from a given measurement, and the second stage restores the image via the analysis approach based sparse regularization. The numerical results are presented to demonstrate that the proposed approach is compared favorably against several popular discrete regularization approaches and structured low-rank matrix approaches.

math.NA↗

arXiv2022

Approximation Theory of Total Variation Minimization for Data Completion

Total variation (TV) minimization is one of the most important techniques in modern signal/image processing, and has wide range of applications. While there are numerous recent works on the restoration guarantee of the TV minimization in the framework of compressed sensing, there are few works on the restoration guarantee of the restoration from partial observations. This paper is to analyze the error of TV based restoration from random entrywise samples. In particular, we estimate the error between the underlying original data and the approximate solution that interpolates (or approximates with an error bound depending on the noise level) the given data that has the minimal TV seminorm among all possible solutions. Finally, we further connect the error estimate for the discrete model to the sparse gradient restoration problem and to the approximation to the underlying function from which the underlying true data comes.

math.AP↗

arXiv2020

Image Restoration: Structured Low Rank Matrix Framework for Piecewise Smooth Functions and Beyond

Recently, mapping a signal/image into a low rank Hankel/Toeplitz matrix has become an emerging alternative to the traditional sparse regularization, due to its ability to alleviate the basis mismatch between the true support in the continuous domain and the discrete grid. In this paper, we introduce a novel structured low rank matrix framework to restore piecewise smooth functions. Inspired by the total generalized variation to use sparse higher order derivatives, we derive that the Fourier samples of higher order derivatives satisfy an annihilation relation, resulting in a low rank multi-fold Hankel matrix. We further observe that the SVD of a low rank Hankel matrix corresponds to a tight wavelet frame system which can represent the image with sparse coefficients. Based on this observation, we also propose a wavelet frame analysis approach based continuous domain regularization model for the piecewise smooth image restoration. Finally, numerical results on image restoration tasks are presented as a proof-of-concept study to demonstrate that the proposed approach is compared favorably against several popular discrete regularization approaches and structured low rank matrix approaches.

math.NA↗

arXiv2020

Data Driven Tight Frame for Compressed Sensing MRI Reconstruction via Off-the-Grid Regularization

Recently, the finite-rate-of-innovation (FRI) based continuous domain regularization is emerging as an alternative to the conventional on-the-grid sparse regularization for the compressed sensing (CS) due to its ability to alleviate the basis mismatch between the true support of the shape in the continuous domain and the discrete grid. In this paper, we propose a new off-the-grid regularization for the CS-MRI reconstruction. Following the recent works on two dimensional FRI, we assume that the discontinuities/edges of the image are localized in the zero level set of a band-limited periodic function. This assumption induces the linear dependencies among the Fourier samples of the gradient of the image, which leads to a low rank two-fold Hankel matrix. We further observe that the singular value decomposition of a low rank Hankel matrix corresponds to an adaptive tight frame system which can represent the image with sparse canonical coefficients. Based on this observation, we propose a data driven tight frame based off-the-grid regularization model for the CS-MRI reconstruction. To solve the nonconvex and nonsmooth model, a proximal alternating minimization algorithm with a guaranteed global convergence is adopted. Finally, the numerical experiments show that our proposed data driven tight frame based approach outperforms the existing approaches.

math.NA↗

arXiv2019

Unpaired image denoising using a generative adversarial network in X-ray CT

This paper proposes a deep learning-based denoising method for noisy low-dose computerized tomography (CT) images in the absence of paired training data. The proposed method uses a fidelity-embedded generative adversarial network (GAN) to learn a denoising function from unpaired training data of low-dose CT (LDCT) and standard-dose CT (SDCT) images, where the denoising function is the optimal generator in the GAN framework. This paper analyzes the f-GAN objective to derive a suitable generator that is optimized by minimizing a weighted sum of two losses: the Kullback-Leibler divergence between an SDCT data distribution and a generated distribution, and the $\ell_2$ loss between the LDCT image and the corresponding generated images (or denoised image). The computed generator reflects the prior belief about SDCT data distribution through training. We observed that the proposed method allows the preservation of fine anomalous features while eliminating noise. The experimental results show that the proposed deep-learning method with unpaired datasets performs comparably to a method using paired datasets. A clinical experiment was also performed to show the validity of the proposed method for noise arising in the low-dose X-ray CT.

cs.CV↗

arXiv2019

Framelet Pooling Aided Deep Learning Network : The Method to Process High Dimensional Medical Data

Machine learning-based analysis of medical images often faces several hurdles, such as the lack of training data, the curse of dimensionality problem, and the generalization issues. One of the main difficulties is that there exists computational cost problem in dealing with input data of large size matrices which represent medical images. The purpose of this paper is to introduce a framelet-pooling aided deep learning method for mitigating computational bundle, caused by large dimensionality. By transforming high dimensional data into low dimensional components by filter banks with preserving detailed information, the proposed method aims to reduce the complexity of the neural network and computational costs significantly during the learning process. Various experiments show that our method is comparable to the standard unreduced learning method, while reducing computational burdens by decomposing large-sized learning tasks into several small-scale learning tasks.

cs.LG↗

arXiv2019

NLTG Priors in Medical Image: Nonlocal TV-Gaussian (NLTG) prior for Bayesian inverse problems with applications to Limited CT Reconstruction

Bayesian inference methods have been widely applied in inverse problems, {largely due to their ability to characterize the uncertainty associated with the estimation results.} {In the Bayesian framework} the prior distribution of the unknown plays an essential role in the Bayesian inference, {and a good prior distribution can significantly improve the inference results.} In this paper, we extend the total~variation-Gaussian (TG) prior in \cite{Z.Yao2016}, and propose a hybrid prior distribution which combines the nonlocal total variation regularization and the Gaussian (NLTG) distribution. The advantage of the new prior is two-fold. The proposed prior models both texture and geometric structures present in images through the NLTV. The Gaussian reference measure also provides a flexibility of incorporating structure information from a reference image. Some theoretical properties are established for the NLTG prior. The proposed prior is applied to limited-angle tomography reconstruction problem with difficulties of severe data missing. We compute both MAP and CM estimates through two efficient methods and the numerical experiments validate the advantages and feasibility of the proposed NLTG prior.

math.OC↗

arXiv2018

Whole Brain Susceptibility Mapping Using Harmonic Incompatibility Removal

Quantitative susceptibility mapping (QSM) aims to visualize the three dimensional susceptibility distribution by solving the field-to-source inverse problem using the phase data in magnetic resonance signal. However, the inverse problem is ill-posed since the Fourier transform of integral kernel has zeroes in the frequency domain. Although numerous regularization based models have been proposed to overcome this problem, the incompatibility in the field data has not received enough attention, which leads to deterioration of the recovery. In this paper, we show that the data acquisition process of QSM inherently generates a harmonic incompatibility in the measured local field. Based on such discovery, we propose a novel regularization based susceptibility reconstruction model with an additional sparsity based regularization term on the harmonic incompatibility. Numerical experiments show that the proposed method achieves better performance than the existing approaches.

math.NA↗

arXiv2018

PET-MRI Joint Reconstruction by Joint Sparsity Based Tight Frame Regularization

Recent technical advances lead to the coupling of PET and MRI scanners, enabling to acquire functional and anatomical data simultaneously. In this paper, we propose a tight frame based PET-MRI joint reconstruction model via the joint sparsity of tight frame coefficients. In addition, a non-convex balanced approach is adopted to take the different regularities of PET and MRI images into account. To solve the nonconvex and nonsmooth model, a proximal alternating minimization algorithm is proposed, and the global convergence is present based on Kurdyka-Lojasiewicz property. Finally, the numerical experiments show that the our proposed models achieve better performance over the existing PET-MRI joint reconstruction models.

math.NA↗

arXiv2017

An Edge Driven Wavelet Frame Model for Image Restoration

Wavelet frame systems are known to be effective in capturing singularities from noisy and degraded images. In this paper, we introduce a new edge driven wavelet frame model for image restoration by approximating images as piecewise smooth functions. With an implicit representation of image singularities sets, the proposed model inflicts different strength of regularization on smooth and singular image regions and edges. The proposed edge driven model is robust to both image approximation and singularity estimation. The implicit formulation also enables an asymptotic analysis of the proposed models and a rigorous connection between the discrete model and a general continuous variational model. Finally, numerical results on image inpainting and deblurring show that the proposed model is compared favorably against several popular image restoration models.

math.NA↗

arXiv2017

Dipole Incompatibility Related Artifacts in Quantitative Susceptibility Mapping

Artifacts in quantitative susceptibility mapping (QSM) are analyzed to establish an optimal design criterion for QSM inversion algorithms. The magnetic field data is decomposed into two parts, dipole compatible and incompatible parts. The dipole compatible part generates the desired non-streaking solution. The dipole incompatible part, including noise, discretization error, and anisotropy sources, generates artifacts defined by a wave propagator with the B0 field direction as the time axis. Granular noise causes streaking and contiguous error causes both streaking and shadow artifacts. As an example, truncation-based QSM algorithms are inherently prone to streaking artifacts because of the deviation of the dipole kernel during truncation. Through numerical phantom and imaging experiments, several QSM methods, including a Bayesian regularization method and the k-space truncation methods, were compared to show that the Bayesian approach with a structural prior provides advantages in terms of both image quality and quantitative measures.

physics.med-ph↗

arXiv2016

Limited Tomography Reconstruction via Tight Frame and Sinogram Extrapolation

X-ray computed tomography (CT) is one of widely used diagnostic tools for medical and dental tomographic imaging of the human body. However, the standard filtered backprojection reconstruction method requires the complete knowledge of the projection data. In the case of limited data, the inverse problem of CT becomes more ill-posed, which makes the reconstructed image deteriorated by the artifacts. In this paper, we consider two dimensional CT reconstruction using the horizontally truncated projections. Over the decades, the numerous results including the sparsity model based approach has enabled the reconstruction of the image inside the region of interest (ROI) from the limited knowledge of the data. However, unlike these existing methods, we try to reconstruct the entire CT image from the limited knowledge of the sinogram via the tight frame regularization and the simultaneous sinogram extrapolation. Our proposed model shows more promising numerical simulation results compared with the existing sparsity model based approach.

math.NA↗

arXiv2014

Characterization of Metal Artifacts in X-ray Computed Tomography

Metal streak artifacts in X-ray computerized tomography (CT) are rigorously characterized here using the notion of the wavefront set from microlocal analysis. The metal artifacts are caused mainly from the mismatch of the forward model of the filtered back-projection; the presence of metallic subjects in an imaging subject violates the model's assumption of the CT sinogram data being the Radon transform of an image. The increasing use of metallic implants has increased demand for the reduction of metal artifacts in the field of dental and medical radiography. However, it is a challenging issue due to the serious difficulties in analyzing the X-ray data, which depends nonlinearly on the distribution of the metallic subject. In this paper, we found that the metal streaking artifacts cause mainly from the boundary geometry of the metal region. The metal streaking artifacts are produced only when the wavefront set of the Radon transform of the characteristic function of a metal region does not contain the wavefront set of the square of the Radon transform. We also found a sufficient condition for the non-existence of the metal streak artifacts.

math.AP↗