SearcharxivSearch

arXiv subjects

Junhang Zhang

Publications and source records attributed to Junhang Zhang.

4 recordsLinked to original sources

Super-Resolution Posterior Ocular Microvascular Imaging Using 3-D Ultrasound Localization Microscopy With a 32X32 Matrix Array

The purpose of this study is to enable in-vivo three-dimensional (3-D) ultrasound localization microscopy (ULM) of posterior ocular microvasculature using a 256-channel system and a 1024-element matrix array, and to overcome limitations of restricted transmit angles, sound speed mismatch caused by the crystalline lens and surrounding tissues, and the low signal-to-noise ratio (SNR) of microbubble signals. To address phase distortions from the crystalline lens, which has a higher speed of sound (SOS) than surrounding tissues, a region-dependent SOS beamforming approach was implemented to improve microbubble resolution. A 4-D non-local means filter was subsequently applied to suppress background noise and enhance microbubble contrast. The proposed method improved localization accuracy and image quality, achieving a spatial resolution of 63 um, while Fourier shell correlation (1/2-bit threshold) confirmed a global resolution of approximately 59 um. Higher mean normalized cross-correlation coefficients between the microbubbles and the system point-spread function, obtained with the proposed method (approximately 0.67), compared with those without the proposed method (approximately 0.60), indicate enhanced microbubble signal quality. Furthermore, the 3-D bi-directional vessel density and flow-velocity maps were reconstructed, capturing detailed choroidal vascular and hemodynamic patterns. These results demonstrate that region-dependent SOS beamforming combined with spatiotemporal denoising enables high-resolution posterior ocular ULM and provides a practical pathway toward quantitative 3-D assessment of retinal and choroidal microvasculature for potential clinical use.

physics.med-ph

Surgery-R1: Advancing Surgical-VQLA with Reasoning Multimodal Large Language Model via Reinforcement Learning

In recent years, significant progress has been made in the field of surgical scene understanding, particularly in the task of Visual Question Localized-Answering in robotic surgery (Surgical-VQLA). However, existing Surgical-VQLA models lack deep reasoning capabilities and interpretability in surgical scenes, which limits their reliability and potential for development in clinical applications. To address this issue, inspired by the development of Reasoning Multimodal Large Language Models (MLLMs), we first build the Surgery-R1-54k dataset, including paired data for Visual-QA, Grounding-QA, and Chain-of-Thought (CoT). Then, we propose the first Reasoning MLLM for Surgical-VQLA (Surgery-R1). In our Surgery-R1, we design a two-stage fine-tuning mechanism to enable the basic MLLM with complex reasoning abilities by utilizing supervised fine-tuning (SFT) and reinforcement fine-tuning (RFT). Furthermore, for an efficient and high-quality rule-based reward system in our RFT, we design a Multimodal Coherence reward mechanism to mitigate positional illusions that may arise in surgical scenarios. Experiment results demonstrate that Surgery-R1 outperforms other existing state-of-the-art (SOTA) models in the Surgical-VQLA task and widely-used MLLMs, while also validating its reasoning capabilities and the effectiveness of our approach. The code and dataset will be organized in https://github.com/FiFi-HAO467/Surgery-R1.

cs.CV

Label-free super-resolution color flow imaging using ultrasound phase microscopy

Ultrasound vascular imaging is limited by acoustic diffraction, restricting visualization of microvessels essential for understanding organ function and disease. Label-free super-resolution methods exploiting endogenous red blood cells have faced challenges in acquisition time and complexity. Here we introduce ultrasound phase microscopy (UPM), a label-free technique that achieves sub-wavelength resolution flow imaging by exploiting phase differences between consecutively beamformed frames with mismatched apodizations, without requiring localization or tracking. Validated in vivo across multiple species, organs, and ultrasound platforms, UPM attains spatial resolutions better than 5 um up to tenfold improvement over conventional color flow imaging while accelerating data acquisition by nearly two orders of magnitude compared to ultrasound localization microscopy. UPM enables rapid, high resolution vascular imaging and offers a practical approach for label-free super-resolution vascular imaging.

eess.SP

A Survey of Human-in-the-loop for Machine Learning

Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. Humans can provide training data for machine learning applications and directly accomplish tasks that are hard for computers in the pipeline with the help of machine-based approaches. In this paper, we survey existing works on human-in-the-loop from a data perspective and classify them into three categories with a progressive relationship: (1) the work of improving model performance from data processing, (2) the work of improving model performance through interventional model training, and (3) the design of the system independent human-in-the-loop. Using the above categorization, we summarize major approaches in the field; along with their technical strengths/ weaknesses, we have simple classification and discussion in natural language processing, computer vision, and others. Besides, we provide some open challenges and opportunities. This survey intends to provide a high-level summarization for human-in-the-loop and motivates interested readers to consider approaches for designing effective human-in-the-loop solutions.

cs.LG