arXiv subjects

Lei Liu

Publications and source records attributed to Lei Liu.

At least 199 records · Page 11Linked to original sources

arXiv2024

Data Conditioning for Subsurface Models with Single-Image Generative Adversarial Network (SinGAN)

The characterization of subsurface models relies on the accuracy of subsurface models which request integrating a large number of information across different sources through model conditioning, such as data conditioning and geological concepts conditioning. Conventional geostatistical models have a trade-off between honoring geological conditioning (i.e., qualitative geological concepts) and data conditioning (i.e., quantitative static data and dynamic data). To resolve this limit, generative AI methods, such as Generative adversarial network (GAN), have been widely applied for subsurface modeling due to their ability to reproduce complex geological patterns. However, the current practices of data conditioning in GANs conduct quality assessment through ocular inspection to check model plausibility or some preliminary quantitative analysis of the distribution of property of interests. We propose the generative AI realization minimum acceptance criteria for data conditioning, demonstrated with single image GAN. Our conditioning checks include static small-scale local and large-scale exhaustive data conditioning checks, local uncertainty, and spatial nonstationarity reproduction checks. We also check conditioning to geological concepts through multiscale spatial distribution, the number of connected geobodies, the spatial continuity check, and the model facies proportion reproduction check. Our proposed workflow provides guidance on the conditioning of deep learning methods for subsurface modeling and enhanced model conditioning checking essential for applying these models to support uncertainty characterization and decision making.

stat.AP↗

arXiv2024

The relative isoperimetric inequality for minimal submanifolds with free boundary in the Euclidean space

In this paper, we mainly consider the relative isoperimetric inequalities for minimal submanifolds with free boundary. We first generalize ideas of restricted normal cones introduced by Choe-Ghomi-Ritoré in \cite{CGR06} and obtain an optimal area estimate for generalized restricted normal cones. This area estimate, together with the ABP method of Cabré in \cite{Cabre2008}, provides a new proof of the relative isoperimetric inequality obtained by Choe-Ghomi-Ritoré in \cite{CGR07}. Furthermore, we use this estimate and the idea of Brendle in his recent work \cite{Brendle2019} to obtain a relative isoperimetric inequality for minimal submanifolds with free boundary on a convex support surface in $\mathbb{R}^{n+m}$, which is optimal and gives an affirmative answer to an open problem proposed by Choe in \cite{Choe2005}, Open Problem 12.6, when the codimension $m\leq 2$.

math.DG↗

arXiv2024

Towards Automatic Evaluation for LLMs' Clinical Capabilities: Metric, Data, and Algorithm

Large language models (LLMs) are gaining increasing interests to improve clinical efficiency for medical diagnosis, owing to their unprecedented performance in modelling natural language. Ensuring the safe and reliable clinical applications, the evaluation of LLMs indeed becomes critical for better mitigating the potential risks, e.g., hallucinations. However, current evaluation methods heavily rely on labor-intensive human participation to achieve human-preferred judgements. To overcome this challenge, we propose an automatic evaluation paradigm tailored to assess the LLMs' capabilities in delivering clinical services, e.g., disease diagnosis and treatment. The evaluation paradigm contains three basic elements: metric, data, and algorithm. Specifically, inspired by professional clinical practice pathways, we formulate a LLM-specific clinical pathway (LCP) to define the clinical capabilities that a doctor agent should possess. Then, Standardized Patients (SPs) from the medical education are introduced as the guideline for collecting medical data for evaluation, which can well ensure the completeness of the evaluation procedure. Leveraging these steps, we develop a multi-agent framework to simulate the interactive environment between SPs and a doctor agent, which is equipped with a Retrieval-Augmented Evaluation (RAE) to determine whether the behaviors of a doctor agent are in accordance with LCP. The above paradigm can be extended to any similar clinical scenarios to automatically evaluate the LLMs' medical capabilities. Applying such paradigm, we construct an evaluation benchmark in the field of urology, including a LCP, a SPs dataset, and an automated RAE. Extensive experiments are conducted to demonstrate the effectiveness of the proposed approach, providing more insights for LLMs' safe and reliable deployments in clinical practice.

cs.CL↗

arXiv2024

Synergy between Spin and Orbital Angular Momenta on a Möbius Strip

Spin and orbital angular momenta are fundamental physical characteristics described by polarization and spatial degrees of freedom, respectively. Polarization is a feature of vector fields while spatial phase gradient determines the orbital angular momentum ubiquitous to any scalar field. Common wisdom treats these two degrees of freedom as distinct and independent principles to manipulate wave propagations. Here, we demonstrate their synergy. This is achieved by introducing two orthogonal $p$-orbitals as eigenbases, whose spatial modal features are exploited to generate orbital angular momenta and the associated orbital orientations provide means to simultaneously manipulate polarizations. Through periodic modulation and directional coupling, we realize a full cyclic evolution of the synchronized and synergized spin-orbital angular momenta. Remarkably, this evolution acquires a nontrivial geometric phase, leading to its representation on a Möbius strip. Experimentally, an acoustic cavity array is designed, whose dipole resonances precisely mimic the $p$-orbitals. The acoustic waves, uniquely, see the pressure (scalar) field as a spatial feature and carry an intrinsic polarization defined by the velocity (vector) field, serving as an ideal platform to observe the synergy of spin and orbital angular momenta. Based on such a property, we further showcase a spin-orbital-Hall effect, highlighting the intricate locking of handedness, directionality, spin density and spatial mode profile. Our study unveils a fundamental connection between spin and orbital angular momenta, promising avenues for novel applications in information coding and high-capacity communications.

physics.app-ph↗

arXiv2024

Real is not True: Backdoor Attacks Against Deepfake Detection

The proliferation of malicious deepfake applications has ignited substantial public apprehension, casting a shadow of doubt upon the integrity of digital media. Despite the development of proficient deepfake detection mechanisms, they persistently demonstrate pronounced vulnerability to an array of attacks. It is noteworthy that the pre-existing repertoire of attacks predominantly comprises adversarial example attack, predominantly manifesting during the testing phase. In the present study, we introduce a pioneering paradigm denominated as Bad-Deepfake, which represents a novel foray into the realm of backdoor attacks levied against deepfake detectors. Our approach hinges upon the strategic manipulation of a delimited subset of the training data, enabling us to wield disproportionate influence over the operational characteristics of a trained model. This manipulation leverages inherent frailties inherent to deepfake detectors, affording us the capacity to engineer triggers and judiciously select the most efficacious samples for the construction of the poisoned set. Through the synergistic amalgamation of these sophisticated techniques, we achieve an remarkable performance-a 100% attack success rate (ASR) against extensively employed deepfake detectors.

cs.CR↗

arXiv2024

Global Tropical Cyclone Intensity Forecasting with Multi-modal Multi-scale Causal Autoregressive Model

Accurate forecasting of Tropical cyclone (TC) intensity is crucial for formulating disaster risk reduction strategies. Current methods predominantly rely on limited spatiotemporal information from ERA5 data and neglect the causal relationships between these physical variables, failing to fully capture the spatial and temporal patterns required for intensity forecasting. To address this issue, we propose a Multi-modal multi-Scale Causal AutoRegressive model (MSCAR), which is the first model that combines causal relationships with large-scale multi-modal data for global TC intensity autoregressive forecasting. Furthermore, given the current absence of a TC dataset that offers a wide range of spatial variables, we present the Satellite and ERA5-based Tropical Cyclone Dataset (SETCD), which stands as the longest and most comprehensive global dataset related to TCs. Experiments on the dataset show that MSCAR outperforms the state-of-the-art methods, achieving maximum reductions in global and regional forecast errors of 9.52% and 6.74%, respectively. The code and dataset are publicly available at https://anonymous.4open.science/r/MSCAR.

physics.ao-ph↗

arXiv2024

BadLabel: A Robust Perspective on Evaluating and Enhancing Label-noise Learning

Label-noise learning (LNL) aims to increase the model's generalization given training data with noisy labels. To facilitate practical LNL algorithms, researchers have proposed different label noise types, ranging from class-conditional to instance-dependent noises. In this paper, we introduce a novel label noise type called BadLabel, which can significantly degrade the performance of existing LNL algorithms by a large margin. BadLabel is crafted based on the label-flipping attack against standard classification, where specific samples are selected and their labels are flipped to other labels so that the loss values of clean and noisy labels become indistinguishable. To address the challenge posed by BadLabel, we further propose a robust LNL method that perturbs the labels in an adversarial manner at each epoch to make the loss values of clean and noisy labels again distinguishable. Once we select a small set of (mostly) clean labeled data, we can apply the techniques of semi-supervised learning to train the model accurately. Empirically, our experimental results demonstrate that existing LNL algorithms are vulnerable to the newly introduced BadLabel noise type, while our proposed robust LNL method can effectively improve the generalization performance of the model under various types of label noise. The new dataset of noisy labels and the source codes of robust LNL algorithms are available at https://github.com/zjfheart/BadLabels.

cs.LG↗

arXiv2024

Computation and Parameter Efficient Multi-Modal Fusion Transformer for Cued Speech Recognition

Cued Speech (CS) is a pure visual coding method used by hearing-impaired people that combines lip reading with several specific hand shapes to make the spoken language visible. Automatic CS recognition (ACSR) seeks to transcribe visual cues of speech into text, which can help hearing-impaired people to communicate effectively. The visual information of CS contains lip reading and hand cueing, thus the fusion of them plays an important role in ACSR. However, most previous fusion methods struggle to capture the global dependency present in long sequence inputs of multi-modal CS data. As a result, these methods generally fail to learn the effective cross-modal relationships that contribute to the fusion. Recently, attention-based transformers have been a prevalent idea for capturing the global dependency over the long sequence in multi-modal fusion, but existing multi-modal fusion transformers suffer from both poor recognition accuracy and inefficient computation for the ACSR task. To address these problems, we develop a novel computation and parameter efficient multi-modal fusion transformer by proposing a novel Token-Importance-Aware Attention mechanism (TIAA), where a token utilization rate (TUR) is formulated to select the important tokens from the multi-modal streams. More precisely, TIAA firstly models the modality-specific fine-grained temporal dependencies over all tokens of each modality, and then learns the efficient cross-modal interaction for the modality-shared coarse-grained temporal dependencies over the important tokens of different modalities. Besides, a light-weight gated hidden projection is designed to control the feature flows of TIAA. The resulting model, named Economical Cued Speech Fusion Transformer (EcoCued), achieves state-of-the-art performance on all existing CS datasets, compared with existing transformer-based fusion methods and ACSR fusion methods.

cs.CV↗

arXiv2024

Adaptive Confidence Multi-View Hashing for Multimedia Retrieval

The multi-view hash method converts heterogeneous data from multiple views into binary hash codes, which is one of the critical technologies in multimedia retrieval. However, the current methods mainly explore the complementarity among multiple views while lacking confidence learning and fusion. Moreover, in practical application scenarios, the single-view data contain redundant noise. To conduct the confidence learning and eliminate unnecessary noise, we propose a novel Adaptive Confidence Multi-View Hashing (ACMVH) method. First, a confidence network is developed to extract useful information from various single-view features and remove noise information. Furthermore, an adaptive confidence multi-view network is employed to measure the confidence of each view and then fuse multi-view features through a weighted summation. Lastly, a dilation network is designed to further enhance the feature representation of the fused features. To the best of our knowledge, we pioneer the application of confidence learning into the field of multimedia retrieval. Extensive experiments on two public datasets show that the proposed ACMVH performs better than state-of-the-art methods (maximum increase of 3.24%). The source code is available at https://github.com/HackerHyper/ACMVH.

cs.CV↗

arXiv2024

From Beginner to Expert: Modeling Medical Knowledge into General LLMs

Recently, large language model (LLM) based artificial intelligence (AI) systems have demonstrated remarkable capabilities in natural language understanding and generation. However, these models face a significant challenge when it comes to sensitive applications, such as reasoning over medical knowledge and answering medical questions in a physician-like manner. Prior studies attempted to overcome this challenge by increasing the model size (>100B) to learn more general medical knowledge, while there is still room for improvement in LLMs with smaller-scale model sizes (<100B). In this work, we start from a pre-trained general LLM model (AntGLM-10B) and fine-tune it from a medical beginner towards a medical expert (called AntGLM-Med-10B), which leverages a 3-stage optimization procedure, i.e., general medical knowledge injection, medical domain instruction tuning, and specific medical task adaptation. Our contributions are threefold: (1) We specifically investigate how to adapt a pre-trained general LLM in medical domain, especially for a specific medical task. (2) We collect and construct large-scale medical datasets for each stage of the optimization process. These datasets encompass various data types and tasks, such as question-answering, medical reasoning, multi-choice questions, and medical conversations. (3) Specifically for multi-choice questions in the medical domain, we propose a novel Verification-of-Choice approach for prompting engineering, which significantly enhances the reasoning ability of LLMs. Remarkably, by combining the above approaches, our AntGLM-Med-10B model can outperform the most of LLMs on PubMedQA, including both general and medical LLMs, even when these LLMs have larger model size.

cs.CL↗

arXiv2024

RJUA-QA: A Comprehensive QA Dataset for Urology

We introduce RJUA-QA, a novel medical dataset for question answering (QA) and reasoning with clinical evidence, contributing to bridge the gap between general large language models (LLMs) and medical-specific LLM applications. RJUA-QA is derived from realistic clinical scenarios and aims to facilitate LLMs in generating reliable diagnostic and advice. The dataset contains 2,132 curated Question-Context-Answer pairs, corresponding about 25,000 diagnostic records and clinical cases. The dataset covers 67 common urological disease categories, where the disease coverage exceeds 97.6\% of the population seeking medical services in urology. Each data instance in RJUA-QA comprises: (1) a question mirroring real patient to inquiry about clinical symptoms and medical conditions, (2) a context including comprehensive expert knowledge, serving as a reference for medical examination and diagnosis, (3) a doctor response offering the diagnostic conclusion and suggested examination guidance, (4) a diagnosed clinical disease as the recommended diagnostic outcome, and (5) clinical advice providing recommendations for medical examination. RJUA-QA is the first medical QA dataset for clinical reasoning over the patient inquiries, where expert-level knowledge and experience are required for yielding diagnostic conclusions and medical examination advice. A comprehensive evaluation is conducted to evaluate the performance of both medical-specific and general LLMs on the RJUA-QA dataset. Our data is are publicly available at \url{https://github.com/alipay/RJU_Ant_QA}.

cs.CL↗

arXiv2024

Channel Mapping Based on Interleaved Learning with Complex-Domain MLP-Mixer

In multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) systems, representing the whole channel only based on partial subchannels will significantly reduce the channel acquisition overhead. For such a channel mapping task, inspired by the intrinsic coupling across the space and frequency domains, this letter proposes to use interleaved learning with partial antenna and subcarrier characteristics to represent the whole MIMO-OFDM channel. Specifically, we design a complex-domain multilayer perceptron (MLP)-Mixer (CMixer), which utilizes two kinds of complex-domain MLP modules to learn the space and frequency characteristics respectively and then interleaves them to couple the learned properties. The complex-domain computation facilitates the learning on the complex-valued channel data, while the interleaving tightens the coupling of space and frequency domains. These two designs jointly reduce the learning burden, making the physics-inspired CMixer more effective on channel representation learning than existing data-driven approaches. Simulation shows that the proposed scheme brings 4.6~10dB gains in mapping accuracy compared to existing schemes under different settings. Besides, ablation studies show the necessity of complex-domain computation as well as the extent to which the interleaved learning matches the channel properties.

eess.SP↗

arXiv2023

Cross-Modal Object Tracking via Modality-Aware Fusion Network and A Large-Scale Dataset

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven effective, existing multi-modal imaging platforms are complex and lack real-world applicability. In contrast, near-infrared (NIR) imaging, commonly used in surveillance cameras, can switch between RGB and NIR based on light intensity. However, tracking objects across these heterogeneous modalities poses significant challenges, particularly due to the absence of modality switch signals during tracking. To address these challenges, we propose an adaptive cross-modal object tracking algorithm called Modality-Aware Fusion Network (MAFNet). MAFNet efficiently integrates information from both RGB and NIR modalities using an adaptive weighting mechanism, effectively bridging the appearance gap and enabling a modality-aware target representation. It consists of two key components: an adaptive weighting module and a modality-specific representation module......

cs.CV↗

arXiv2023

Prototype-based Cross-Modal Object Tracking

Cross-modal object tracking is an important research topic in the field of information fusion, and it aims to address imaging limitations in challenging scenarios by integrating switchable visible and near-infrared modalities. However, existing tracking methods face some difficulties in adapting to significant target appearance variations in the presence of modality switch. For instance, model update based tracking methods struggle to maintain stable tracking results during modality switching, leading to error accumulation and model drift. Template based tracking methods solely rely on the template information from first frame and/or last frame, which lacks sufficient representation ability and poses challenges in handling significant target appearance changes. To address this problem, we propose a prototype-based cross-modal object tracker called ProtoTrack, which introduces a novel prototype learning scheme to adapt to significant target appearance variations, for cross-modal object tracking. In particular, we design a multi-modal prototype to represent target information by multi-kind samples, including a fixed sample from the first frame and two representative samples from different modalities. Moreover, we develop a prototype generation algorithm based on two new modules to ensure the prototype representative in different challenges......

cs.CV↗

arXiv2023

Irregularity of polymer domain boundaries in two-dimensional polymer solution

Polymer chains composing a polymer solution in strict two dimensions (2D) are characterized with irregular domain boundaries, whose fractal dimension ($\mathcal{D}^{\partial}$) varies with the area fraction of the solution and the solvent quality. {\color{black}Our analysis of numerical simulations of polymer solutions finds} that $\mathcal{D}^{\partial}$ in good solvents changes non-monotonically from $\mathcal{D}^{\partial}=4/3$ in dilute phase to $\mathcal{D}^{\partial}=5/4$ in dense phase, maximizing to $\mathcal{D}^{\partial}\approx 3/2$ at a crossover area fraction $ϕ_{\rm cr}\approx 0.2$, whereas for polymers in $Θ$ solvents $\mathcal{D}^{\partial}$ remains constant at $\mathcal{D}^{\partial}=4/3$ from dilute to semi-dilute phase. Using polymer physics arguments, we rationalize these values, and show that the maximum irregularity of $\mathcal{D}^\partial\approx 3/2$ is due to "fjord"-like corrugations formed along the domain boundaries which also maximize at the same crossover area fraction. Our finding of $\mathcal{D}^\partial\approx 3/2$ is, in fact, in perfect agreement with the upper bound for the fractal dimension of the external perimeter of 2D random curves at scaling limit, which is predicted by the Schramm-Loewner evolution (SLE).

cond-mat.soft↗

arXiv2023

In situ tuning of dynamical Coulomb blockade on Andreev bound states in hybrid nanowire devices

Electron interactions in quantum devices can exhibit intriguing phenomena. One example is assembling an electronic device in series with an on-chip resistor. The quantum laws of electricity of the device is modified at low energies and temperatures by dissipative interactions induced by the resistor, a phenomenon known as dynamical Coulomb blockade (DCB). The DCB strength is usually non-adjustable in a fixed environment defined by the resistor. Here, we design an on-chip circuit for InAs-Al hybrid nanowires where the DCB strength can be gate-tuned in situ. InAs-Al nanowires could host Andreev or Majorana zero-energy states. This technique enables tracking the evolution of the same state while tuning the DCB strength from weak to strong. We observe the transition from a zero-bias conductance peak to split peaks for Andreev zero-energy states. Our technique opens the door to in situ tuning interaction strength on zero-energy states.

cond-mat.mes-hall↗

arXiv2023

Efficient Trigger Word Insertion

With the boom in the natural language processing (NLP) field these years, backdoor attacks pose immense threats against deep neural network models. However, previous works hardly consider the effect of the poisoning rate. In this paper, our main objective is to reduce the number of poisoned samples while still achieving a satisfactory Attack Success Rate (ASR) in text backdoor attacks. To accomplish this, we propose an efficient trigger word insertion strategy in terms of trigger word optimization and poisoned sample selection. Extensive experiments on different datasets and models demonstrate that our proposed method can significantly improve attack effectiveness in text classification tasks. Remarkably, our approach achieves an ASR of over 90% with only 10 poisoned samples in the dirty-label setting and requires merely 1.5% of the training data in the clean-label setting.

cs.CR↗

arXiv2023

TransCDR: a deep learning model for enhancing the generalizability of cancer drug response prediction through transfer learning and multimodal data fusion for drug representation

Accurate and robust drug response prediction is of utmost importance in precision medicine. Although many models have been developed to utilize the representations of drugs and cancer cell lines for predicting cancer drug responses (CDR), their performances can be improved by addressing issues such as insufficient data modality, suboptimal fusion algorithms, and poor generalizability for novel drugs or cell lines. We introduce TransCDR, which uses transfer learning to learn drug representations and fuses multi-modality features of drugs and cell lines by a self-attention mechanism, to predict the IC50 values or sensitive states of drugs on cell lines. We are the first to systematically evaluate the generalization of the CDR prediction model to novel (i.e., never-before-seen) compound scaffolds and cell line clusters. TransCDR shows better generalizability than 8 state-of-the-art models. TransCDR outperforms its 5 variants that train drug encoders (i.e., RNN and AttentiveFP) from scratch under various scenarios. The most critical contributors among multiple drug notations and omics profiles are Extended Connectivity Fingerprint and genetic mutation. Additionally, the attention-based fusion module further enhances the predictive performance of TransCDR. TransCDR, trained on the GDSC dataset, demonstrates strong predictive performance on the external testing set CCLE. It is also utilized to predict missing CDRs on GDSC. Moreover, we investigate the biological mechanisms underlying drug response by classifying 7,675 patients from TCGA into drug-sensitive or drug-resistant groups, followed by a Gene Set Enrichment Analysis. TransCDR emerges as a potent tool with significant potential in drug response prediction. The source code and data can be accessed at https://github.com/XiaoqiongXia/TransCDR.

q-bio.QM↗