arXiv subjects

Xiaoyu Jiang

Publications and source records attributed to Xiaoyu Jiang.

23 records · Page 2Linked to original sources

arXiv2024

S2vNTM: Semi-supervised vMF Neural Topic Modeling

Language model based methods are powerful techniques for text classification. However, the models have several shortcomings. (1) It is difficult to integrate human knowledge such as keywords. (2) It needs a lot of resources to train the models. (3) It relied on large text data to pretrain. In this paper, we propose Semi-Supervised vMF Neural Topic Modeling (S2vNTM) to overcome these difficulties. S2vNTM takes a few seed keywords as input for topics. S2vNTM leverages the pattern of keywords to identify potential topics, as well as optimize the quality of topics' keywords sets. Across a variety of datasets, S2vNTM outperforms existing semi-supervised topic modeling methods in classification accuracy with limited keywords provided. S2vNTM is at least twice as fast as baselines.

cs.CL↗

arXiv2024

Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semantics

Deep neural networks were significantly vulnerable to adversarial examples manipulated by malicious tiny perturbations. Although most conventional adversarial attacks ensured the visual imperceptibility between adversarial examples and corresponding raw images by minimizing their geometric distance, these constraints on geometric distance led to limited attack transferability, inferior visual quality, and human-imperceptible interpretability. In this paper, we proposed a supervised semantic-transformation generative model to generate adversarial examples with real and legitimate semantics, wherein an unrestricted adversarial manifold containing continuous semantic variations was constructed for the first time to realize a legitimate transition from non-adversarial examples to adversarial ones. Comprehensive experiments on MNIST and industrial defect datasets showed that our adversarial examples not only exhibited better visual quality but also achieved superior attack transferability and more effective explanations for model vulnerabilities, indicating their great potential as generic adversarial examples. The code and pre-trained models were available at https://github.com/shuaili1027/MAELS.git.

cs.CV↗

arXiv2023

vONTSS: vMF based semi-supervised neural topic modeling with optimal transport

Recently, Neural Topic Models (NTM), inspired by variational autoencoders, have attracted a lot of research interest; however, these methods have limited applications in the real world due to the challenge of incorporating human knowledge. This work presents a semi-supervised neural topic modeling method, vONTSS, which uses von Mises-Fisher (vMF) based variational autoencoders and optimal transport. When a few keywords per topic are provided, vONTSS in the semi-supervised setting generates potential topics and optimizes topic-keyword quality and topic classification. Experiments show that vONTSS outperforms existing semi-supervised topic modeling methods in classification accuracy and diversity. vONTSS also supports unsupervised topic modeling. Quantitative and qualitative experiments show that vONTSS in the unsupervised setting outperforms recent NTMs on multiple aspects: vONTSS discovers highly clustered and coherent topics on benchmark datasets. It is also much faster than the state-of-the-art weakly supervised text classification method while achieving similar classification performance. We further prove the equivalence of optimal transport loss and cross-entropy loss at the global minimum.

cs.LG↗

arXiv2022

Latent Variable Models in the Era of Industrial Big Data: Extension and Beyond

A rich supply of data and innovative algorithms have made data-driven modeling a popular technique in modern industry. Among various data-driven methods, latent variable models (LVMs) and their counterparts account for a major share and play a vital role in many industrial modeling areas. LVM can be generally divided into statistical learning-based classic LVM and neural networks-based deep LVM (DLVM). We first discuss the definitions, theories and applications of classic LVMs in detail, which serves as both a comprehensive tutorial and a brief application survey on classic LVMs. Then we present a thorough introduction to current mainstream DLVMs with emphasis on their theories and model architectures, soon afterwards provide a detailed survey on industrial applications of DLVMs. The aforementioned two types of LVM have obvious advantages and disadvantages. Specifically, classic LVMs have concise principles and good interpretability, but their model capacity cannot address complicated tasks. Neural networks-based DLVMs have sufficient model capacity to achieve satisfactory performance in complex scenarios, but it comes at sacrifices in model interpretability and efficiency. Aiming at combining the virtues and mitigating the drawbacks of these two types of LVMs, as well as exploring non-neural-network manners to build deep models, we propose a novel concept called lightweight deep LVM (LDLVM). After proposing this new idea, the article first elaborates the motivation and connotation of LDLVM, then provides two novel LDLVMs, along with thorough descriptions on their principles, architectures and merits. Finally, outlooks and opportunities are discussed, including important open questions and possible research directions.

eess.SY↗

arXiv2019

Magnetic resonance imaging of mean cell size in human breast tumors

Purpose: Cell size is a fundamental characteristic of all tissues, and changes in cell size in cancer reflect tumor status and response to treatments, such as apoptosis and cell cycle arrest. Unfortunately, cell size can only be obtained by pathologic evaluation of the tumor in the current standard of care. Previous imaging approaches can be implemented on only animal MRI scanners or require relatively long acquisition times that are undesirable for clinical imaging. There is a need to develop cell size imaging for clinics. Experimental Design: We propose a new method, IMPULSED (Imaging Microstructural Parameters Using Limited Spectrally Edited Diffusion) that can characterize mean cell sizes in solid tumors. We report the use of combined sequences with different gradient waveforms on human MRI and analytical equations that link DWI signals of real gradient waveforms and specific microstructural parameters such as cell size. We also describe comprehensive validations using computer simulations, cell experiments in vitro, and animal experiments in vivo and finally demonstrate applications in pre-operative breast cancer patients. Results: With fast acquisitions (~ 7 mins), IMPULSED can provide high-resolution (1.3 mm in-plane) mapping of mean cell size of human tumors in vivo on currently-available 3T MRI scanners. All validations suggest IMPULSED provide accurate and reliable measurements of mean cell size. Conclusion: The proposed IMPULSED method can assess cell size variations in the tumor of breast cancer patients, which may have the potential to assess early response to neoadjuvant therapy.

physics.bio-ph↗