Searcharxiv⌕ Search

arXiv subjects

Jie Luo

Publications and source records attributed to Jie Luo.

At least 91 records · Page 5Linked to original sources

All-Around Real Label Supervision: Cyclic Prototype Consistency Learning for Semi-supervised Medical Image Segmentation

Semi-supervised learning has substantially advanced medical image segmentation since it alleviates the heavy burden of acquiring the costly expert-examined annotations. Especially, the consistency-based approaches have attracted more attention for their superior performance, wherein the real labels are only utilized to supervise their paired images via supervised loss while the unlabeled images are exploited by enforcing the perturbation-based \textit{"unsupervised"} consistency without explicit guidance from those real labels. However, intuitively, the expert-examined real labels contain more reliable supervision signals. Observing this, we ask an unexplored but interesting question: can we exploit the unlabeled data via explicit real label supervision for semi-supervised training? To this end, we discard the previous perturbation-based consistency but absorb the essence of non-parametric prototype learning. Based on the prototypical network, we then propose a novel cyclic prototype consistency learning (CPCL) framework, which is constructed by a labeled-to-unlabeled (L2U) prototypical forward process and an unlabeled-to-labeled (U2L) backward process. Such two processes synergistically enhance the segmentation network by encouraging more discriminative and compact features. In this way, our framework turns previous \textit{"unsupervised"} consistency into new \textit{"supervised"} consistency, obtaining the \textit{"all-around real label supervision"} property of our method. Extensive experiments on brain tumor segmentation from MRI and kidney segmentation from CT images show that our CPCL can effectively exploit the unlabeled data and outperform other state-of-the-art semi-supervised medical image segmentation methods.

eess.IV↗

Double-Uncertainty Guided Spatial and Temporal Consistency Regularization Weighting for Learning-based Abdominal Registration

In order to tackle the difficulty associated with the ill-posed nature of the image registration problem, regularization is often used to constrain the solution space. For most learning-based registration approaches, the regularization usually has a fixed weight and only constrains the spatial transformation. Such convention has two limitations: (i) Besides the laborious grid search for the optimal fixed weight, the regularization strength of a specific image pair should be associated with the content of the images, thus the "one value fits all" training scheme is not ideal; (ii) Only spatially regularizing the transformation may neglect some informative clues related to the ill-posedness. In this study, we propose a mean-teacher based registration framework, which incorporates an additional temporal consistency regularization term by encouraging the teacher model's prediction to be consistent with that of the student model. More importantly, instead of searching for a fixed weight, the teacher enables automatically adjusting the weights of the spatial regularization and the temporal consistency regularization by taking advantage of the transformation uncertainty and appearance uncertainty. Extensive experiments on the challenging abdominal CT-MRI registration show that our training strategy can promisingly advance the original learning-based method in terms of efficient hyperparameter tuning and a better tradeoff between accuracy and smoothness.

cs.CV↗

Trust It or Not: Confidence-Guided Automatic Radiology Report Generation

Medical imaging plays a pivotal role in diagnosis and treatment in clinical practice. Inspired by the significant progress in automatic image captioning, various deep learning (DL)-based methods have been proposed to generate radiology reports for medical images. Despite promising results, previous works overlook the uncertainties of their models and are thus unable to provide clinicians with the reliability/confidence of the generated radiology reports to assist their decision-making. In this paper, we propose a novel method to explicitly quantify both the visual uncertainty and the textual uncertainty for DL-based radiology report generation. Such multi-modal uncertainties can sufficiently capture the model confidence degree at both the report level and the sentence level, and thus they are further leveraged to weight the losses for more comprehensive model optimization. Experimental results have demonstrated that the proposed method for model uncertainty characterization and estimation can produce more reliable confidence scores for radiology report generation, and the modified loss function, which takes into account the uncertainties, leads to better model performance on two public radiology report datasets. In addition, the quality of the automatically generated reports was manually evaluated by human raters and the results also indicate that the proposed uncertainties can reflect the variance of clinical diagnosis.

cs.CV↗

GPU optimization of the 3D Scale-invariant Feature Transform Algorithm and a Novel BRIEF-inspired 3D Fast Descriptor

This work details a highly efficient implementation of the 3D scale-invariant feature transform (SIFT) algorithm, for the purpose of machine learning from large sets of volumetric medical image data. The primary operations of the 3D SIFT code are implemented on a graphics processing unit (GPU), including convolution, sub-sampling, and 4D peak detection from scale-space pyramids. The performance improvements are quantified in keypoint detection and image-to-image matching experiments, using 3D MRI human brain volumes of different people. Computationally efficient 3D keypoint descriptors are proposed based on the Binary Robust Independent Elementary Feature (BRIEF) code, including a novel descriptor we call Ranked Robust Independent Elementary Features (RRIEF), and compared to the original 3D SIFT-Rank method\citep{toews2013efficient}. The GPU implementation affords a speedup of approximately 7X beyond an optimised CPU implementation, where computation time is reduced from 1.4 seconds to 0.2 seconds for 3D volumes of size (145, 174, 145) voxels with approximately 3000 keypoints. Notable speedups include the convolution operation (20X), 4D peak detection (3X), sub-sampling (3X), and difference-of-Gaussian pyramid construction (2X). Efficient descriptors offer a speedup of 2X and a memory savings of 6X compared to standard SIFT-Rank descriptors, at a cost of reduced numbers of keypoint correspondences, revealing a trade-off between computational efficiency and algorithmic performance. The speedups gained by our implementation will allow for a more efficient analysis on larger data sets. Our optimized GPU implementation of the 3D SIFT-Rank extractor is available at https://github.com/CarluerJB/3D_SIFT_CUDA.

cs.CV↗

The Effects of Learning in Morphologically Evolving Robot Systems

Simultaneously evolving morphologies (bodies) and controllers (brains) of robots can cause a mismatch between the inherited body and brain in the offspring. To mitigate this problem, the addition of an infant learning period by the so-called Triangle of Life framework has been proposed relatively long ago. However, an empirical assessment is still lacking to-date. In this paper we investigate the effects of such a learning mechanism from different perspectives. Using extensive simulations we show that learning can greatly increase task performance and reduce the number of generations required to reach a certain fitness level compared to the purely evolutionary approach. Furthermore, although learning only directly affects the controllers, we demonstrate that the evolved morphologies will be also different. This provides a quantitative demonstration that changes in the brain can induce changes in the body. Finally, we examine the concept of morphological intelligence quantified by the ability of a given body to learn. We observe that the learning delta, the performance difference between the inherited and the learned brain, is growing throughout the evolutionary process. This shows that evolution is producing robots with an increasing plasticity, that is, consecutive generations are becoming better and better learners which in turn makes them better and better at the given task. All in all, our results demonstrate that the Triangle of Life is not only a concept of theoretical interest, but a system architecture with practical benefits.

cs.RO↗

Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding

Knowledge graph embedding models learn the representations of entities and relations in the knowledge graphs for predicting missing links (relations) between entities. Their effectiveness are deeply affected by the ability of modeling and inferring different relation patterns such as symmetry, asymmetry, inversion, composition and transitivity. Although existing models are already able to model many of these relations patterns, transitivity, a very common relation pattern, is still not been fully supported. In this paper, we first theoretically show that the transitive relations can be modeled with projections. We then propose the Rot-Pro model which combines the projection and relational rotation together. We prove that Rot-Pro can infer all the above relation patterns. Experimental results show that the proposed Rot-Pro model effectively learns the transitivity pattern and achieves the state-of-the-art results on the link prediction task in the datasets containing transitive relations.

cs.AI↗

Gait-learning with morphologically evolving robots generated by L-system

When controllers (brains) and morphologies (bodies) of robots simultaneously evolve, this can lead to a problem, namely the brain & body mismatch problem. In this research, we propose a solution of lifetime learning. We set up a system where modular robots can create offspring that inherit the bodies of parents by recombination and mutation. With regards to the brains of the offspring, we use two methods to create them. The first one entails solely evolution which means the brain of a robot child is inherited from its parents. The second approach is evolution plus learning which means the brain of a child is inherited as well, but additionally is developed by a learning algorithm - RevDEknn. We compare these two methods by running experiments in a simulator called Revolve and use efficiency, efficacy, and the morphology intelligence of the robots for the comparison. The experiments show that the evolution plus learning method does not only lead to a higher fitness level, but also to more morphologically evolving robots. This constitutes a quantitative demonstration that changes in the brain can induce changes in the body, leading to the concept of morphological intelligence, which is quantified by the learning delta, meaning the ability of a morphology to facilitate learning.

cs.RO↗

Arm locking using laser frequency comb

In this work, we describe an updated version of single arm locking, and the noise amplification due to the nulls can be flexibly restricted with the help of optical frequency comb. We show that, the laser phase noise can be divided by a specific factor with optical frequency comb as the bridge. The analytical results indicate that, the peaks in the science band have been greatly reduced. The performance of the noise suppression shows that the total noise after arm locking can well satisfy the requirement of time delay interferometry, even with the free-running laser source. We also estimate the frequency pulling characteristics of the updated single arm locking, and the results suggest that the pulling rate can be tolerated, without the risk of mode hopping. Arm locking will be a valuable solution for the noise reduction in the space-borne GW detectors. We demonstrate that, with the precise control of the returned laser phase noise, the noise amplification in the science band can be efficiently suppressed based on the updated single arm locking. Not only our method allows the suppression of the peaks, the high gain, low pulling rate, it can also serve for full year, without the potential risk of locking failure due to the arm length mismatch. We finally discuss the unified demonstration of the updated single arm locking, where both the local and the returned laser phase noises can be tuned to generate the expected arm-locking sensor actually. Our work could provide a powerful method for the arm locking in the future space-borne GW detectors.

physics.optics↗

Optical Brewster metasurfaces exhibiting ultra-broadband reflectionless absorption and extreme angular-asymmetry

Impedance mismatch between free space and absorptive materials is a fundamental issue plaguing the pursue of high-efficiency light absorption. In this work, we design and numerically demonstrate a type of non-resonant impedance-matched optical metasurfaces exhibiting ultra-broadband reflectionless absorption based on anomalous Brewster effect, which are donated as optical Brewster metasurfaces here. Interestingly, such Brewster metasurfaces exhibit a unique type of extreme angular-asymmetry: a transition between perfect transparency and perfect absorption appears when the sign of the incident angle is changed. Such a remarkable phenomenon originates in the coexistence of traditional and anomalous Brewster effects. Guidelines of material selection based on an effective-medium description and strategies such as the integration of a metal back-reflector or folded metasurfaces are proposed to improve the absorption performance. Finally, a gradient optical Brewster metasurface exhibiting ultra-broadband and near-omnidirectional reflectionless absorption is demonstrated. Such high-efficiency asymmetric optical metasurfaces may find applications in optoelectrical and thermal devices like photodetectors, thermal emitters and photovoltaics.

physics.optics↗

Accurate Mode-Coupling Characterization of Low-Crosstalk Ring-Core Fibers using Integral Calculation based Swept-Wavelength Interferometry Measurement

In this paper, to accurately characterize the low inter-mode coupling of the weakly-coupled few mode fibers (FMFs), we propose a modified inter-mode coupling characterization method based on swept-wavelength interferometry measurement, in which an integral calculation approach is used to eliminate significant sources of error that may lead to underestimation of the power coupling coefficient. Using the proposed characterization method, a low-crosstalk ring-core fiber (RCF) with low mode dependent loss (MDL) and with single span length up to 100 km is experimentally measured to have low power coupling coefficients between high-order orbital angular momentum (OAM) mode groups of below -30 dB/km over C band. The measured low coupling coefficients based on the proposed method are verified by the direct system power measurements, proving the feasibility and reliability of the proposed inter-mode coupling characterization method.

physics.optics↗

Noisy Labels are Treasure: Mean-Teacher-Assisted Confident Learning for Hepatic Vessel Segmentation

Manually segmenting the hepatic vessels from Computer Tomography (CT) is far more expertise-demanding and laborious than other structures due to the low-contrast and complex morphology of vessels, resulting in the extreme lack of high-quality labeled data. Without sufficient high-quality annotations, the usual data-driven learning-based approaches struggle with deficient training. On the other hand, directly introducing additional data with low-quality annotations may confuse the network, leading to undesirable performance degradation. To address this issue, we propose a novel mean-teacher-assisted confident learning framework to robustly exploit the noisy labeled data for the challenging hepatic vessel segmentation task. Specifically, with the adapted confident learning assisted by a third party, i.e., the weight-averaged teacher model, the noisy labels in the additional low-quality dataset can be transformed from "encumbrance" to "treasure" via progressive pixel-wise soft-correction, thus providing productive guidance. Extensive experiments using two public datasets demonstrate the superiority of the proposed framework as well as the effectiveness of each component.

eess.IV↗

Synthesizing dynamic MRI using long-term recurrent convolutional networks

A method is proposed for converting raw ultrasound signals of respiratory organ motion into high frame rate dynamic MRI using a long-term recurrent convolutional neural network. Ultrasound signals were acquired using a single-element transducer, referred to here as `organ-configuration motion' (OCM) sensor, while sagittal MR images were simultaneously acquired. Both streams of data were used for training a cascade of convolutional layers, to extract relevant features from raw ultrasound, followed by a recurrent neural network, to learn its temporal dynamics. The network was trained with MR images on the output, and was employed to predict MR images at a temporal resolution of 100 frames per second, based on ultrasound input alone, without any further MR scanner input. The method was validated on 7 subjects.

eess.IV↗

Deep-Learning-Enabled Inverse Engineering of Multi-Wavelength Invisibility-to-Superscattering Switching with Phase-Change Materials

Inverse design of nanoparticles for desired scattering spectra and dynamic switching between the two opposite scattering anomalies, i.e. superscattering and invisibility, is important in realizing cloaking, sensing and functional devices. However, traditionally the design process is quite complicated, which involves complex structures with many choices of synthetic constituents and dispersions. Here, we demonstrate that a well-trained deep-learning neural network can handle these issues efficiently, which can not only forwardly predict scattering spectra of multilayer nanoparticles with high precision, but also inversely design the required structural and material parameters efficiently. Moreover, we show that the neural network is capable of finding out multi-wavelength invisibility-to-superscattering switching points at the desired wavelengths in multilayer nanoparticles composed of metals and phase-change materials. Our work provides a useful solution of deep learning for inverse design of nanoparticles with dynamic scattering spectra by using phase-change materials.

physics.optics↗

Ultra-broadband reflectionless Brewster absorber protected by reciprocity

The Brewster's law predicts zero reflection of p-polarization on a dielectric surface at a particular angle. However, when loss is introduced into the permittivity of the dielectric, the Brewster condition breaks down and reflection unavoidably appears. In this work, we found an exception to this long-standing dilemma by creating a class of nonmagnetic anisotropic metamaterials, where an anomalous Brewster effects with independently tunable absorption and refraction emerges. This loss-independent Brewster effect is bestowed by the extra degrees of freedoms introduced by anisotropy and strictly protected by the reciprocity principle. The bandwidth can cover an extremely wide spectrum from dc to optical frequencies. Two examples of reflectionless Brewster absorbers with different Brewster angles are both demonstrated to achieve large absorbance in a wide spectrum via microwave experiments. Our work extends the scope of Brewster effect to the horizon of nonmagnetic absorptive materials, which promises an unprecedented wide bandwidth for reflectionless absorption with high efficiency.

physics.optics↗

Three-dimensional Electromagnetic Void Space

We report a realization of three-dimensional (3D) electromagnetic void space. Despite occupying a finite volume of space, such a medium is optically equivalent to an infinitesimal point where electromagnetic waves experience no phase accumulation. The 3D void space is realized by constructing all-dielectric 3D photonic crystals such that the effective permittivity and permeability vanish simultaneously, forming a six-fold Dirac-like point with Dirac-like linear dispersions at the center of the Brillouin Zone. We demonstrate, both theoretically and experimentally, that such a 3D void space exhibits unique properties and rich functionalities absent in any other electromagnetic media, such as boundary-control transmission switching and 3D perfect wave-steering mechanisms. Especially, contrary to the photonic "doping" effect in its two-dimensional counterpart, the 3D void space exhibits an amazing property of "impurity-immunity". Our work paves a road towards the realization of 3D void space where electromagnetic waves can be manipulated in unprecedented ways.

physics.optics↗

Breakdown of Maxwell Garnett theory due to evanescent fields at deep-subwavelength scale

Deep-subwavelength all-dielectric composite materials are believed to tightly obey the Maxwell Garnett effective medium theory. Here, we demonstrate that the Maxwell Garnett theory could break down due to evanescent fields in deep-subwavelength dielectric structures. By utilizing two- and three-dimensional dielectric composite materials with inhomogeneities at the scale of λ/100, we show that local evanescent fields generally occur nearby the dielectric inhomogeneities. When tiny absorptive constituents are placed there, the absorption and transmission of the whole composite will show strong dependence on the positions of the absorptive constituents. The Maxwell Garnett theory fails to predict such position-dependent characteristics, because it averages out the evanescent fields. By taking the distribution of the evanescent fields into consideration, we made a correction to the Maxwell Garnett theory, such that the position-dependent characteristics become predictable. We reveal not only the breakdown of the Maxwell Garnett theory, but also a unique phenomenon of "invisible" loss induced by the prohibition of electric fields at deep-subwavelength scales. Our work promises a route to control the macroscopic properties of composite materials without changing their composition, which is beyond the traditional Maxwell Garnett theory.

physics.optics↗

F3RNet: Full-Resolution Residual Registration Network for Deformable Image Registration

Deformable image registration (DIR) is essential for many image-guided therapies. Recently, deep learning approaches have gained substantial popularity and success in DIR. Most deep learning approaches use the so-called mono-stream "high-to-low, low-to-high" network structure, and can achieve satisfactory overall registration results. However, accurate alignments for some severely deformed local regions, which are crucial for pinpointing surgical targets, are often overlooked. Consequently, these approaches are not sensitive to some hard-to-align regions, e.g., intra-patient registration of deformed liver lobes. In this paper, we propose a novel unsupervised registration network, namely the Full-Resolution Residual Registration Network (F3RNet), for deformable registration of severely deformed organs. The proposed method combines two parallel processing streams in a residual learning fashion. One stream takes advantage of the full-resolution information that facilitates accurate voxel-level registration. The other stream learns the deep multi-scale residual representations to obtain robust recognition. We also factorize the 3D convolution to reduce the training parameters and enhance network efficiency. We validate the proposed method on a clinically acquired intra-patient abdominal CT-MRI dataset and a public inspiratory and expiratory thorax CT dataset. Experiments on both multimodal and unimodal registration demonstrate promising results compared to state-of-the-art approaches.

eess.IV↗

Unimodal Cyclic Regularization for Training Multimodal Image Registration Networks

The loss function of an unsupervised multimodal image registration framework has two terms, i.e., a metric for similarity measure and regularization. In the deep learning era, researchers proposed many approaches to automatically learn the similarity metric, which has been shown effective in improving registration performance. However, for the regularization term, most existing multimodal registration approaches still use a hand-crafted formula to impose artificial properties on the estimated deformation field. In this work, we propose a unimodal cyclic regularization training pipeline, which learns task-specific prior knowledge from simpler unimodal registration, to constrain the deformation field of multimodal registration. In the experiment of abdominal CT-MR registration, the proposed method yields better results over conventional regularization methods, especially for severely deformed local regions.

cs.CV↗