SearcharxivSearch

arXiv subjects

Zhihui Yang

Publications and source records attributed to Zhihui Yang.

6 recordsLinked to original sources

A Hybrid Framework for Blood Vessel Morphology Classification: Discrete Geometry-based Tortuosity Feature Measurement, Information Gain-based Feature Selection, and Random Forest Classification

Subjective visual grading of blood vessel tortuosity relies heavily on clinical experience, while traditional distance-based indices often fail to adequately characterize three-dimensional spatial deformation. Because abnormal internal carotid artery morphology may be clinically relevant to cerebrovascular assessment and stroke-risk evaluation, objective and reproducible quantification of vascular tortuosity is of considerable importance. To address this limitation, we propose a mathematical framework for the morphological classification of the internal carotid artery (ICA-C1) segment. The framework integrates discrete geometric feature measurement, Information Gain-based feature selection, and Random Forest classification. An initial set of 13 tortuosity features is extracted from the corresponding 379 clinical vascular centerlines using discrete geometric methods and subsequently reduced to a six-feature subset consisting of $\mathcal{TI}$, $\mathcal{AC}$, $\mathcal{TC}$, $\mathcal{AC}/\mathcal{AT}$, $\mathcal{AT}$, and $\mathcal{TT}$. The framework is evaluated in two classification tasks. For binary classification of non-severe and severe tortuosity, the RF model achieves a Macro-F1 score of 0.9206. For ternary morphological grading into straight, low-tortuosity, and high-tortuosity groups, it achieves a Macro-F1 score of 0.8626. The results indicate that elongation- and curvature-related features provide strong discriminatory information for basic screening, whereas torsion-related features contribute additional information for more detailed morphological classification. Based on the RF feature-importance values, we further define a Morphological Risk Index (MRI), which provides a direct numerical reference for vascular morphology and may facilitate more objective and consistent clinical assessment.

eess.IV

Data-Free Privacy-Preserving for LLMs via Model Inversion and Selective Unlearning

Large language models (LLMs) exhibit powerful capabilities but risk memorizing sensitive personally identifiable information (PII) from their training data, posing significant privacy concerns. While machine unlearning techniques aim to remove such data, they predominantly depend on access to the training data. This requirement is often impractical, as training data in real-world deployments is commonly proprietary or inaccessible. To address this limitation, we propose Data-Free Selective Unlearning (DFSU), a novel privacy-preserving framework that removes sensitive PII from an LLM without requiring its training data. Our approach first synthesizes pseudo-PII through language model inversion, then constructs token-level privacy masks for these synthetic samples, and finally performs token-level selective unlearning via a contrastive mask loss within a low-rank adaptation (LoRA) subspace. Extensive experiments on the AI4Privacy PII-Masking dataset using Pythia models demonstrate that our method effectively removes target PII while maintaining model utility.

cs.CR

Does Visual Grounding Enhance the Understanding of Embodied Knowledge in Large Language Models?

Despite significant progress in multimodal language models (LMs), it remains unclear whether visual grounding enhances their understanding of embodied knowledge compared to text-only models. To address this question, we propose a novel embodied knowledge understanding benchmark based on the perceptual theory from psychology, encompassing visual, auditory, tactile, gustatory, olfactory external senses, and interoception. The benchmark assesses the models' perceptual abilities across different sensory modalities through vector comparison and question-answering tasks with over 1,700 questions. By comparing 30 state-of-the-art LMs, we surprisingly find that vision-language models (VLMs) do not outperform text-only models in either task. Moreover, the models perform significantly worse in the visual dimension compared to other sensory dimensions. Further analysis reveals that the vector representations are easily influenced by word form and frequency, and the models struggle to answer questions involving spatial perception and reasoning. Our findings underscore the need for more effective integration of embodied knowledge in LMs to enhance their understanding of the physical world.

cs.CL

Moirai: Towards Optimal Placement for Distributed Inference on Heterogeneous Devices

The escalating size of Deep Neural Networks (DNNs) has spurred a growing research interest in hosting and serving DNN models across multiple devices. A number of studies have been reported to partition a DNN model across devices, providing device placement solutions. The methods appeared in the literature, however, either suffer from poor placement performance due to the exponential search space or miss an optimal placement as a consequence of the reduced search space with limited heuristics. Moreover, these methods have ignored the runtime inter-operator optimization of a computation graph when coarsening the graph, which degrades the end-to-end inference performance. This paper presents Moirai that better exploits runtime inter-operator fusion in a model to render a coarsened computation graph, reducing the search space while maintaining the inter-operator optimization provided by inference backends. Moirai also generalizes the device placement algorithm from multiple perspectives by considering inference constraints and device heterogeneity.Extensive experimental evaluation with 11 large DNNs demonstrates that Moirai outperforms the state-of-the-art counterparts, i.e., Placeto, m-SCT, and GETF, up to 4.28$\times$ in reduction of the end-to-end inference latency. Moirai code is anonymously released at \url{https://github.com/moirai-placement/moirai}.

cs.DC

Optimizing Machine Learning Inference Queries with Correlative Proxy Models

We consider accelerating machine learning (ML) inference queries on unstructured datasets. Expensive operators such as feature extractors and classifiers are deployed as user-defined functions(UDFs), which are not penetrable with classic query optimization techniques such as predicate push-down. Recent optimization schemes (e.g., Probabilistic Predicates or PP) assume independence among the query predicates, build a proxy model for each predicate offline, and rewrite a new query by injecting these cheap proxy models in the front of the expensive ML UDFs. In such a manner, unlikely inputs that do not satisfy query predicates are filtered early to bypass the ML UDFs. We show that enforcing the independence assumption in this context may result in sub-optimal plans. In this paper, we propose CORE, a query optimizer that better exploits the predicate correlations and accelerates ML inference queries. Our solution builds the proxy models online for a new query and leverages a branch-and-bound search process to reduce the building costs. Results on three real-world text, image and video datasets show that CORE improves the query throughput by up to 63% compared to PP and up to 80% compared to running the queries as it is.

cs.DB

An intermediate regime for exit phenomena driven by non-Gaussian Levy noises

A dynamical system driven by non-Gaussian Lévy noises of small intensity is considered. The first exit time of solution orbits from a bounded neighborhood of an attracting equilibrium state is estimated. For a class of non-Gaussian Lévy noises, it is shown that the mean exit time is asymptotically faster than exponential (the well-known Gaussian Brownian noise case) but slower than polynomial (the stable Lévy noise case), in terms of the reciprocal of the small noise intensity.

math.DS