arXiv subjects

Zhe Liu

Publications and source records attributed to Zhe Liu.

At least 199 records · Page 11Linked to original sources

arXiv2024

How to characterize imprecision in multi-view clustering?

It is still challenging to cluster multi-view data since existing methods can only assign an object to a specific (singleton) cluster when combining different view information. As a result, it fails to characterize imprecision of objects in overlapping regions of different clusters, thus leading to a high risk of errors. In this paper, we thereby want to answer the question: how to characterize imprecision in multi-view clustering? Correspondingly, we propose a multi-view low-rank evidential c-means based on entropy constraint (MvLRECM). The proposed MvLRECM can be considered as a multi-view version of evidential c-means based on the theory of belief functions. In MvLRECM, each object is allowed to belong to different clusters with various degrees of support (masses of belief) to characterize uncertainty when decision-making. Moreover, if an object is in the overlapping region of several singleton clusters, it can be assigned to a meta-cluster, defined as the union of these singleton clusters, to characterize the local imprecision in the result. In addition, entropy-weighting and low-rank constraints are employed to reduce imprecision and improve accuracy. Compared to state-of-the-art methods, the effectiveness of MvLRECM is demonstrated based on several toy and UCI real datasets.

cs.LG↗

arXiv2024

Dynamic Response of Ionic Current in Conical Nanopores

Ionic current rectification (ICR) of charged conical nanopores has various applications in fields including nanofluidics, bio-sensing, and energy conversion, whose function is closely related to the dynamic response of nanopores. The occurrence of ICR originates from the ion enrichment and depletion in conical pores, whose formation is found to be affected by the scanning rate of voltages. Here, through time-dependent simulations, we investigate the variation of ion current under electric fields and the dynamic formation of ion enrichment and depletion, which can reflect the response time of conical nanopores. The response time of nanopores when ion enrichment forms i.e. at the on state is significantly longer than that with the formation of ion depletion i.e. at the off state. Our simulation results reveal the regulation of response time by different nanopore parameters including the surface charge density, pore length, tip, and base radius, as well as the applied conditions such as the voltage and bulk concentration. The response time of nanopores is closely related to the surface charge density, pore length, voltage, and bulk concentration. Our uncovered dynamic response mechanism of the ionic current can guide the design of nanofluidic devices with conical nanopores, including memristors, ionic switches, and rectifiers.

physics.chem-ph↗

arXiv2024

Programmable Nonlinear Quantum Photonic Circuits

The lack of interactions between single photons prohibits direct nonlinear operations in quantum optical circuits, representing a central obstacle in photonic quantum technologies. Here, we demonstrate multi-mode nonlinear photonic circuits where both linear and direct nonlinear operations can be programmed with high precision at the single-photon level. Deterministic nonlinear interaction is realized with a tunable quantum dot embedded in a nanophotonic waveguide mediating interactions between individual photons within a temporal linear optical interferometer. We demonstrate the capability to reprogram the nonlinear photonic circuits and implement protocols where strong nonlinearities are required, in particular for quantum simulation of anharmonic molecular dynamics, thereby showcasing the new key functionalities enabled by our technology.

quant-ph↗

arXiv2024

Learning with User-Level Local Differential Privacy

User-level privacy is important in distributed systems. Previous research primarily focuses on the central model, while the local models have received much less attention. Under the central model, user-level DP is strictly stronger than the item-level one. However, under the local model, the relationship between user-level and item-level LDP becomes more complex, thus the analysis is crucially different. In this paper, we first analyze the mean estimation problem and then apply it to stochastic optimization, classification, and regression. In particular, we propose adaptive strategies to achieve optimal performance at all privacy levels. Moreover, we also obtain information-theoretic lower bounds, which show that the proposed methods are minimax optimal up to logarithmic factors. Unlike the central DP model, where user-level DP always leads to slower convergence, our result shows that under the local model, the convergence rates are nearly the same between user-level and item-level cases for distributions with bounded support. For heavy-tailed distributions, the user-level rate is even faster than the item-level one.

stat.ML↗

arXiv2024

Enhancing Learning with Label Differential Privacy by Vector Approximation

Label differential privacy (DP) is a framework that protects the privacy of labels in training datasets, while the feature vectors are public. Existing approaches protect the privacy of labels by flipping them randomly, and then train a model to make the output approximate the privatized label. However, as the number of classes $K$ increases, stronger randomization is needed, thus the performances of these methods become significantly worse. In this paper, we propose a vector approximation approach, which is easy to implement and introduces little additional computational overhead. Instead of flipping each label into a single scalar, our method converts each label into a random vector with $K$ components, whose expectations reflect class conditional probabilities. Intuitively, vector approximation retains more information than scalar labels. A brief theoretical analysis shows that the performance of our method only decays slightly with $K$. Finally, we conduct experiments on both synthesized and real datasets, which validate our theoretical analysis as well as the practical performance of our method.

cs.LG↗

arXiv2024

Distinguish Any Fake Videos: Unleashing the Power of Large-scale Data and Motion Features

The development of AI-Generated Content (AIGC) has empowered the creation of remarkably realistic AI-generated videos, such as those involving Sora. However, the widespread adoption of these models raises concerns regarding potential misuse, including face video scams and copyright disputes. Addressing these concerns requires the development of robust tools capable of accurately determining video authenticity. The main challenges lie in the dataset and neural classifier for training. Current datasets lack a varied and comprehensive repository of real and generated content for effective discrimination. In this paper, we first introduce an extensive video dataset designed specifically for AI-Generated Video Detection (GenVidDet). It includes over 2.66 M instances of both real and generated videos, varying in categories, frames per second, resolutions, and lengths. The comprehensiveness of GenVidDet enables the training of a generalizable video detector. We also present the Dual-Branch 3D Transformer (DuB3D), an innovative and effective method for distinguishing between real and generated videos, enhanced by incorporating motion information alongside visual appearance. DuB3D utilizes a dual-branch architecture that adaptively leverages and fuses raw spatio-temporal data and optical flow. We systematically explore the critical factors affecting detection performance, achieving the optimal configuration for DuB3D. Trained on GenVidDet, DuB3D can distinguish between real and generated video content with 96.77% accuracy, and strong generalization capability even for unseen types.

cs.CV↗

arXiv2024

DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Model

Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained searching ranges, and struggle with accumulated inaccuracy arising from the coarse-to-fine structure. To alleviate these problems, we propose a novel uncertainty-aware scene flow estimation network (DifFlow3D) with the diffusion probabilistic model. Iterative diffusion-based refinement is designed to enhance the correlation robustness and resilience to challenging cases, e.g. dynamics, noisy inputs, repetitive patterns, etc. To restrain the generation diversity, three key flow-related features are leveraged as conditions in our diffusion model. Furthermore, we also develop an uncertainty estimation module within diffusion to evaluate the reliability of estimated scene flow. Our DifFlow3D achieves state-of-the-art performance, with 24.0% and 29.1% EPE3D reduction respectively on FlyingThings3D and KITTI 2015 datasets. Notably, our method achieves an unprecedented millimeter-level accuracy (0.0078m in EPE3D) on the KITTI dataset. Additionally, our diffusion-based refinement paradigm can be readily integrated as a plug-and-play module into existing scene flow networks, significantly increasing their estimation accuracy. Codes are released at https://github.com/IRMVLab/DifFlow3D.

cs.CV↗

arXiv2024

FairCMS: Cloud Media Sharing with Fair Copyright Protection

The onerous media sharing task prompts resource-constrained media owners to seek help from a cloud platform, i.e., storing media contents in the cloud and letting the cloud do the sharing. There are three key security/privacy problems that need to be solved in the cloud media sharing scenario, including data privacy leakage and access control in the cloud, infringement on the owner's copyright, and infringement on the user's rights. In view of the fact that no single technique can solve the above three problems simultaneously, two cloud media sharing schemes are proposed in this paper, named FairCMS-I and FairCMS-II. By cleverly utilizing the proxy re-encryption technique and the asymmetric fingerprinting technique, FairCMS-I and FairCMS-II solve the above three problems with different privacy/efficiency trade-offs. Among them, FairCMS-I focuses more on cloud-side efficiency while FairCMS-II focuses more on the security of the media content, which provides owners with flexibility of choice. In addition, FairCMS-I and FairCMS-II also have advantages over existing cloud media sharing efforts in terms of optional IND-CPA (indistinguishability under chosen-plaintext attack) security and high cloud-side efficiency, as well as exemption from needing a trusted third party. Furthermore, FairCMS-I and FairCMS-II allow owners to reap significant local resource savings and thus can be seen as the privacy-preserving outsourcing of asymmetric fingerprinting. Finally, the feasibility and efficiency of FairCMS-I and FairCMS-II are demonstrated by experiments.

cs.CR↗

arXiv2024

Spontaneous assembly of condensate networks during the demixing of structured fluids

Liquid-liquid phase separation, whereby two liquids spontaneously demix, is ubiquitous in industrial, environmental, and biological processes. While isotropic fluids are known to condense into spherical droplets in the binodal region, these dynamics are poorly understood for structured fluids. Here, we report the novel observation of condensate networks, which spontaneously assemble during the demixing of a mesogen from a solvent. Condensing mesogens form rapidly-elongating filaments, rather than spheres, to relieve distortion of a simultaneously-forming internal smectic mesophase. As filaments densify, they collapse into bulged discs, lowering the elastic free energy. Additional distortion is relieved by retraction of filaments into the bulged discs, which are straightened under tension to form a ramified network. Understanding and controlling these dynamics may provide new avenues to direct pattern formation or template materials.

cond-mat.soft↗

arXiv2024

Electronic correlations and partial gap in the bilayer nickelate La$_{3}$Ni$_{2}$O$_{7}$

The discovery of superconductivity with a critical temperature of about 80~K in La$_{3}$Ni$_{2}$O$_{7}$ single crystals under pressure has received enormous attention. La$_{3}$Ni$_{2}$O$_{7}$ is not superconducting under ambient pressure but exhibits a transition at $T^{\ast} \simeq 115$~K. Understanding the electronic correlations and charge dynamics is an important step towards the origin of superconductivity and other instabilities. Here, our optical study shows that La$_{3}$Ni$_{2}$O$_{7}$ features strong electronic correlations which significantly reduce the electron's kinetic energy and place this system in the proximity of the Mott phase. The low-frequency optical conductivity reveals two Drude components arising from multiple bands at the Fermi level. The transition at $T^{\ast}$ removes the Drude component exhibiting non-Fermi liquid behavior, whereas the one with Fermi-liquid behavior is barely affected. These observations in combination with theoretical results suggest that the Fermi surface dominated by the Ni-$d_{3z^{2}-r^{2}}$ orbital is removed due to the transition at $T^{\ast}$. Our experimental results provide pivotal information for understanding the transition at $T^{\ast}$ and superconductivity in La$_{3}$Ni$_{2}$O$_{7}$.

cond-mat.supr-con↗

arXiv2024

Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLM

Mobile apps have become indispensable for accessing and participating in various environments, especially for low-vision users. Users with visual impairments can use screen readers to read the content of each screen and understand the content that needs to be operated. Screen readers need to read the hint-text attribute in the text input component to remind visually impaired users what to fill in. Unfortunately, based on our analysis of 4,501 Android apps with text inputs, over 0.76 of them are missing hint-text. These issues are mostly caused by developers' lack of awareness when considering visually impaired individuals. To overcome these challenges, we developed an LLM-based hint-text generation model called HintDroid, which analyzes the GUI information of input components and uses in-context learning to generate the hint-text. To ensure the quality of hint-text generation, we further designed a feedback-based inspection mechanism to further adjust hint-text. The automated experiments demonstrate the high BLEU and a user study further confirms its usefulness. HintDroid can not only help visually impaired individuals, but also help ordinary people understand the requirements of input components. HintDroid demo video: https://youtu.be/FWgfcctRbfI.

cs.HC↗

arXiv2024

RCBEVDet: Radar-camera Fusion in Bird's Eye View for 3D Object Detection

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. However, relying solely on cameras is difficult to achieve highly accurate and robust 3D object detection. An effective solution to this issue is combining multi-view cameras with the economical millimeter-wave radar sensor to achieve more reliable multi-modal 3D object detection. In this paper, we introduce RCBEVDet, a radar-camera fusion 3D object detection method in the bird's eye view (BEV). Specifically, we first design RadarBEVNet for radar BEV feature extraction. RadarBEVNet consists of a dual-stream radar backbone and a Radar Cross-Section (RCS) aware BEV encoder. In the dual-stream radar backbone, a point-based encoder and a transformer-based encoder are proposed to extract radar features, with an injection and extraction module to facilitate communication between the two encoders. The RCS-aware BEV encoder takes RCS as the object size prior to scattering the point feature in BEV. Besides, we present the Cross-Attention Multi-layer Fusion module to automatically align the multi-modal BEV feature from radar and camera with the deformable attention mechanism, and then fuse the feature with channel and spatial fusion layers. Experimental results show that RCBEVDet achieves new state-of-the-art radar-camera fusion results on nuScenes and view-of-delft (VoD) 3D object detection benchmarks. Furthermore, RCBEVDet achieves better 3D detection results than all real-time camera-only and radar-camera 3D object detectors with a faster inference speed at 21~28 FPS. The source code will be released at https://github.com/VDIGPKU/RCBEVDet.

cs.CV↗

arXiv2024

Boosting Image Restoration via Priors from Pre-trained Models

Pre-trained models with large-scale training data, such as CLIP and Stable Diffusion, have demonstrated remarkable performance in various high-level computer vision tasks such as image understanding and generation from language descriptions. Yet, their potential for low-level tasks such as image restoration remains relatively unexplored. In this paper, we explore such models to enhance image restoration. As off-the-shelf features (OSF) from pre-trained models do not directly serve image restoration, we propose to learn an additional lightweight module called Pre-Train-Guided Refinement Module (PTG-RM) to refine restoration results of a target restoration network with OSF. PTG-RM consists of two components, Pre-Train-Guided Spatial-Varying Enhancement (PTG-SVE), and Pre-Train-Guided Channel-Spatial Attention (PTG-CSA). PTG-SVE enables optimal short- and long-range neural operations, while PTG-CSA enhances spatial-channel attention for restoration-related learning. Extensive experiments demonstrate that PTG-RM, with its compact size ($<$1M parameters), effectively enhances restoration performance of various models across different tasks, including low-light enhancement, deraining, deblurring, and denoising.

cs.CV↗

arXiv2024

EMIE-MAP: Large-Scale Road Surface Reconstruction Based on Explicit Mesh and Implicit Encoding

Road surface reconstruction plays a vital role in autonomous driving systems, enabling road lane perception and high-precision mapping. Recently, neural implicit encoding has achieved remarkable results in scene representation, particularly in the realistic rendering of scene textures. However, it faces challenges in directly representing geometric information for large-scale scenes. To address this, we propose EMIE-MAP, a novel method for large-scale road surface reconstruction based on explicit mesh and implicit encoding. The road geometry is represented using explicit mesh, where each vertex stores implicit encoding representing the color and semantic information. To overcome the difficulty in optimizing road elevation, we introduce a trajectory-based elevation initialization and an elevation residual learning method based on Multi-Layer Perceptron (MLP). Additionally, by employing implicit encoding and multi-camera color MLPs decoding, we achieve separate modeling of scene physical properties and camera characteristics, allowing surround-view reconstruction compatible with different camera models. Our method achieves remarkable road surface reconstruction performance in a variety of real-world challenging scenarios.

cs.CV↗

arXiv2024

Low-cost and Convenient Fabrication of Polymer Micro/Nanopores with the Needle Punching Process and Their Applications in Nanofluidic Sensing

Solid-state micro/nanopores play an important role in the sensing field because of their high stability and controllable size. Aiming at problems of complex processes and high costs in pore manufacturing, we propose a convenient and low-cost micro/nanopore fabrication technique based on the needle punching method. The thin film is pierced by controlling the feed of a microscale tungsten needle, and the size variations of the micropore are monitored by the current feedback system. Based on the positive correlation between the micropore size and the current threshold, the size-controllable preparation of micropores is achieved. The preparation of nanopores is realized by the combination of needle punching and chemical etching. Firstly, a conical defect is prepared on the film with the tungsten needle. Then, nanopores are obtained by unilateral chemical etching of the film. Using the prepared conical micropores resistive-pulse detection of nanoparticles is performed. Significant ionic current rectification is also obtained with our conical nanopores. It is proved that the properties of micro/nanopores prepared by our method are comparable to those prepared by the track-etching method. The simple and controllable fabrication process proposed here will advance the development of low-cost micro/nanopore sensors.

physics.chem-ph↗

arXiv2024

Improved theoretical prediction of nanoparticle sizes with the resistive-pulse technique

With the resistive-pulse technique (RPT), nanopores serve as the nanofluidic sensors of various analytes for their many physical and chemical properties. Here, we focus on the size measurement and its theoretical prediction for sub-200 nm nanoparticles with RPT. Through systematical investigation of the current blockade of nanoparticles across cylindrical nanopores with simulations, Maxwell method considering the shape coefficient and access resistances agrees well with simulation results. However, the widely used integration method of the resistance has distinct deviations in various cases. With the introduction of a correction factor \b{eta} to the integration method, our revised equations can provide good predictions for simulation results. \b{eta} shows a strong dependence on the diameter ratio (d over D) of the nanoparticle and nanopore. Following the same strategy, modified equations are provided for the accurate size prediction for nanoparticles across conical nanopores, where the integration method is the default convenient way. The correction factor \b{eta}' relates to \b{eta} in cylindrical nanopores. \b{eta}' exhibits independence on the pore geometry parameters and diameters of nanoparticles, but dependence on the surface charge density of conical nanopores. Our improved equations can provide theoretical predictions for the accurate size detection of 100-200 nm diameter nanoparticles across cylindrical and conical nanopores.

physics.chem-ph↗

arXiv2024

Software Testing with Large Language Models: Survey, Landscape, and Vision

Pre-trained large language models (LLMs) have recently emerged as a breakthrough technology in natural language processing and artificial intelligence, with the ability to handle large-scale datasets and exhibit remarkable performance across a wide range of tasks. Meanwhile, software testing is a crucial undertaking that serves as a cornerstone for ensuring the quality and reliability of software products. As the scope and complexity of software systems continue to grow, the need for more effective software testing techniques becomes increasingly urgent, making it an area ripe for innovative approaches such as the use of LLMs. This paper provides a comprehensive review of the utilization of LLMs in software testing. It analyzes 102 relevant studies that have used LLMs for software testing, from both the software testing and LLMs perspectives. The paper presents a detailed discussion of the software testing tasks for which LLMs are commonly used, among which test case preparation and program repair are the most representative. It also analyzes the commonly used LLMs, the types of prompt engineering that are employed, as well as the accompanied techniques with these LLMs. It also summarizes the key challenges and potential opportunities in this direction. This work can serve as a roadmap for future research in this area, highlighting potential avenues for exploration, and identifying gaps in our current understanding of the use of LLMs in software testing.

cs.SE↗

arXiv2024

Context-based and Diversity-driven Specificity in Compositional Zero-Shot Learning

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen attribute-object pairs based on a limited set of observed examples. Current CZSL methodologies, despite their advancements, tend to neglect the distinct specificity levels present in attributes. For instance, given images of sliced strawberries, they may fail to prioritize `Sliced-Strawberry' over a generic `Red-Strawberry', despite the former being more informative. They also suffer from ballooning search space when shifting from Close-World (CW) to Open-World (OW) CZSL. To address the issues, we introduce the Context-based and Diversity-driven Specificity learning framework for CZSL (CDS-CZSL). Our framework evaluates the specificity of attributes by considering the diversity of objects they apply to and their related context. This novel approach allows for more accurate predictions by emphasizing specific attribute-object pairs and improves composition filtering in OW-CZSL. We conduct experiments in both CW and OW scenarios, and our model achieves state-of-the-art results across three datasets.

cs.CV↗