Searcharxiv⌕ Search

arXiv subjects

Han Li

Publications and source records attributed to Han Li.

At least 307 records · Page 17Linked to original sources
arXiv2023

An integrated framework for accelerating reactive flow simulation using GPU and machine learning models

Recent progress in artificial intelligence (AI) and high-performance computing (HPC) have brought potentially game-changing opportunities in accelerating reactive flow simulations. In this study, we introduce an open-source computational fluid dynamics (CFD) framework that integrates the strengths of machine learning (ML) and graphics processing unit (GPU) to demonstrate their combined capability. Within this framework, all computational operations are solely executed on GPU, including ML-accelerated chemistry integration, fully-implicit solving of PDEs, and computation of thermal and transport properties, thereby eliminating the CPU-GPU memory copy overhead. Optimisations both within the kernel functions and during the kernel launch process are conducted to enhance computational performance. Strategies such as static data reorganisation and dynamic data allocation are adopted to reduce the GPU memory footprint. The computational performance is evaluated in two turbulent flame benchmarks using quasi-DNS and LES modelling, respectively. Remarkably, while maintaining a similar level of accuracy to the conventional CPU/CVODE-based solver, the GPU/ML-accelerated approach shows an overall speedup of over two orders of magnitude for both cases. This result highlights that high-fidelity turbulent combustion simulation with finite-rate chemistry that requires normally hundreds of CPUs can now be performed on portable devices such as laptops with a medium-end GPU.

cs.CE↗
arXiv2023

GPU-accelerated Large Eddy Simulation of turbulent stratified flames with machine learning chemistry

Stratified premixed combustion, known for its capability to expand flammability limits and reduce overall-lean combustion instability, has been widely adopted to comply with increasingly stringent environmental regulations. Numerous numerical simulations with different combustion models and mesh resolutions have been conducted on laboratory-scale flames to further understand the stratified premixed combustion. However, the trade-off between the high-fidelity and low computational cost for simulating laboratory-scale flames still remains, particularly for those combustion models involving direct coupling of chemistry and flow. In the present study, a GPU-based solver is employed to solve partial differential equations and calculate the thermal and transport properties, while an artificial neural network (ANN) is introduced to replace reaction rate calculation. Particular emphasis is placed on evaluating the proposed GPU-ANN approach through the large eddy simulation of the Cambridge stratified flame. The simulation results show good agreement for the flow and flame statistics between the GPU-ANN approach and the conventional CPU-based solver with direct integration (DI). The comparison suggests that the GPU-ANN approach can achieve the same level of accuracy as the conventional CPU-DI solver. In addition, the overall speed-up factor for the GPU-ANN approach is over two orders of magnitude. This study lays the potential groundwork for fully resolved laboratory-scale flame simulations based on detailed chemistry with much more affordable computational cost.

physics.flu-dyn↗
arXiv2023

Prompting ChatGPT in MNER: Enhanced Multimodal Named Entity Recognition with Auxiliary Refined Knowledge

Multimodal Named Entity Recognition (MNER) on social media aims to enhance textual entity prediction by incorporating image-based clues. Existing studies mainly focus on maximizing the utilization of pertinent image information or incorporating external knowledge from explicit knowledge bases. However, these methods either neglect the necessity of providing the model with external knowledge, or encounter issues of high redundancy in the retrieved knowledge. In this paper, we present PGIM -- a two-stage framework that aims to leverage ChatGPT as an implicit knowledge base and enable it to heuristically generate auxiliary knowledge for more efficient entity prediction. Specifically, PGIM contains a Multimodal Similar Example Awareness module that selects suitable examples from a small number of predefined artificial samples. These examples are then integrated into a formatted prompt template tailored to the MNER and guide ChatGPT to generate auxiliary refined knowledge. Finally, the acquired knowledge is integrated with the original text and fed into a downstream model for further processing. Extensive experiments show that PGIM outperforms state-of-the-art methods on two classic MNER datasets and exhibits a stronger robustness and generalization capability.

cs.CL↗
arXiv2023

Discovering Sounding Objects by Audio Queries for Audio Visual Segmentation

Audio visual segmentation (AVS) aims to segment the sounding objects for each frame of a given video. To distinguish the sounding objects from silent ones, both audio-visual semantic correspondence and temporal interaction are required. The previous method applies multi-frame cross-modal attention to conduct pixel-level interactions between audio features and visual features of multiple frames simultaneously, which is both redundant and implicit. In this paper, we propose an Audio-Queried Transformer architecture, AQFormer, where we define a set of object queries conditioned on audio information and associate each of them to particular sounding objects. Explicit object-level semantic correspondence between audio and visual modalities is established by gathering object information from visual features with predefined audio queries. Besides, an Audio-Bridged Temporal Interaction module is proposed to exchange sounding object-relevant information among multiple frames with the bridge of audio features. Extensive experiments are conducted on two AVS benchmarks to show that our method achieves state-of-the-art performances, especially 7.1% M_J and 7.6% M_F gains on the MS3 setting.

cs.CV↗
arXiv2023

Diminishing Mott gap by doping electrons through depositing one monolayer thin film of Rb on Ca$_{2}$CuO$_{2}$Cl$_{2}$

Understanding the doping evolution from a Mott insulator to a superconductor probably holds the key for resolving the mystery of unconventional superconductivity in copper oxides. To elucidate the evolution of the electronic state starting from the Mott insulator, we dose the surface of the parent phase Ca$_{2}$CuO$_{2}$Cl$_{2}$ by depositing one monolayer thin film of Rb atoms which are supposed to donate electrons to the CuO$_{2}$ planes underneath. We successfully achieved the Rb thin films with periodic structures, and the scanning tunneling microscopy or spectroscopy (STM or STS) measurements on the surface show that the Fermi energy is pinned within the Mott gap but more close to the edge of the charge transfer band (CTB). However, the electron doping does not reduce the spectra weight of the upper Hubbard band (UHB) for the double occupancy as expected from the rigid model, but instead increase it; meanwhile, further doping will create a new wide spread in gap states derivative from the UHB, and the Mott gap will be significantly diminished. Our results provide new clues to understand the strong correlation effect of parent Mott insulators for cuprates and shed new light on the origin of high-temperature superconductivity.

cond-mat.supr-con↗
arXiv2023

Plaquette Singlet Transition, Magnetic Barocaloric Effect, and Spin Supersolidity in the Shastry-Sutherland Model

Inspired by recent experimental measurements [Guo \textit{et al.}, Phys. Rev. Lett.~\textbf{124}, 206602 (2020); Jiménez \textit{et al.}, Nature \textbf{592}, 370 (2021)] on frustrated quantum magnet SrCu$_2$(BO$_3$)$_2$ under combined pressure and magnetic fields, we study the related spin-$1/2$ Shastry-Sutherland (SS) model using state-of-the-art tensor network methods. By calculating thermodynamics, correlations and susceptibilities, we find, in zero magnetic field, not only a line of first-order plaquette-singlet (PS) to dimer-singlet phase transition ending with a critical point, but also signatures of the ordered PS transition with its critical endpoint terminating on this first-order line. Moreover, we uncover prominent magnetic barocaloric responses, a novel type of quantum correlation induced cooling effect, in the strongly fluctuating supercritical regime. Under finite fields, we identify a quantum phase transition from the PS phase to the spin supersolid phase that breaks simultaneously lattice translational and spin rotational symmetries. The present findings on the SS model are accessible in current experiments and would shed new light on exotic critical and supercritical phenomena in archetypal frustrated quantum magnets.

cond-mat.str-el↗
arXiv2023

Possible Intermediate Quantum Spin Liquid Phase in $α$-RuCl$_3$ under High Magnetic Fields up to 100 T

Pursuing the exotic quantum spin liquid (QSL) state in the Kitaev material $α$-RuCl$_3$ has intrigued great research interest recently. A fascinating question is on the possible existence of field-induced QSL phase in this compound. Here we perform a high-field measurement of the magnetization process of $α$-RuCl$_3$ up to 102 T employing the non-destructive and destructive pulsed magnets. Under the out-of-plane field along the c$^*$ axis (i.e., perpendicular to the honeycomb plane), two quantum phase transitions are uncovered at respectively 36 T and about 83 T, between which there lies an intermediate phase as the predicted QSL. By measuring the magnetization data with fields tilted from the c$^*$ axis up to $90^\circ$ (i.e., in-plane direction), we obtain the field-angle phase diagram that contains the zigzag, paramagnetic, and QSL phases. Based on the accurate $K$-$J$-$Γ$-$Γ^{\prime}$ model of $α$-RuCl$_3$, we perform density matrix renormalization group simulations and reproduce the quantum phase diagram in excellent agreement with experiments.

cond-mat.str-el↗
arXiv2023

Cross-view Semantic Alignment for Livestreaming Product Recognition

Live commerce is the act of selling products online through live streaming. The customer's diverse demands for online products introduce more challenges to Livestreaming Product Recognition. Previous works have primarily focused on fashion clothing data or utilize single-modal input, which does not reflect the real-world scenario where multimodal data from various categories are present. In this paper, we present LPR4M, a large-scale multimodal dataset that covers 34 categories, comprises 3 modalities (image, video, and text), and is 50x larger than the largest publicly available dataset. LPR4M contains diverse videos and noise modality pairs while exhibiting a long-tailed distribution, resembling real-world problems. Moreover, a cRoss-vIew semantiC alignmEnt (RICE) model is proposed to learn discriminative instance features from the image and video views of the products. This is achieved through instance-level contrastive learning and cross-view patch-level feature propagation. A novel Patch Feature Reconstruction loss is proposed to penalize the semantic misalignment between cross-view patches. Extensive experiments demonstrate the effectiveness of RICE and provide insights into the importance of dataset diversity and expressivity. The dataset and code are available at https://github.com/adxcreative/RICE

cs.CV↗
arXiv2023

Cross-Domain Product Representation Learning for Rich-Content E-Commerce

The proliferation of short video and live-streaming platforms has revolutionized how consumers engage in online shopping. Instead of browsing product pages, consumers are now turning to rich-content e-commerce, where they can purchase products through dynamic and interactive media like short videos and live streams. This emerging form of online shopping has introduced technical challenges, as products may be presented differently across various media domains. Therefore, a unified product representation is essential for achieving cross-domain product recognition to ensure an optimal user search experience and effective product recommendations. Despite the urgent industrial need for a unified cross-domain product representation, previous studies have predominantly focused only on product pages without taking into account short videos and live streams. To fill the gap in the rich-content e-commerce area, in this paper, we introduce a large-scale cRoss-dOmain Product Ecognition dataset, called ROPE. ROPE covers a wide range of product categories and contains over 180,000 products, corresponding to millions of short videos and live streams. It is the first dataset to cover product pages, short videos, and live streams simultaneously, providing the basis for establishing a unified product representation across different media domains. Furthermore, we propose a Cross-dOmain Product rEpresentation framework, namely COPE, which unifies product representations in different domains through multimodal learning including text and vision. Extensive experiments on downstream tasks demonstrate the effectiveness of COPE in learning a joint feature space for all product domains.

cs.CV↗
arXiv2023

Erase and Repair: An Efficient Box-Free Removal Attack on High-Capacity Deep Hiding

Deep hiding, embedding images with others using deep neural networks, has demonstrated impressive efficacy in increasing the message capacity and robustness of secret sharing. In this paper, we challenge the robustness of existing deep hiding schemes by preventing the recovery of secret images, building on our in-depth study of state-of-the-art deep hiding schemes and their vulnerabilities. Leveraging our analysis, we first propose a simple box-free removal attack on deep hiding that does not require any prior knowledge of the deep hiding schemes. To improve the removal performance on the deep hiding schemes that may be enhanced by adversarial training, we further design a more powerful removal attack, efficient box-free removal attack (EBRA), which employs image inpainting techniques to remove secret images from container images. In addition, to ensure the effectiveness of our attack and preserve the fidelity of the processed container images, we design an erasing phase based on the locality of deep hiding to remove secret information and then make full use of the visual information of container images to repair the erased visual content. Extensive evaluations show our method can completely remove secret images from container images with negligible impact on the quality of container images.

cs.CR↗
arXiv2023

Magnetotransport and Berry phase Tuning in Gd-doped Bi2Se3 Topological Insulator Single Crystals

The Berry phase is an important concept in solids, correlated to the band topology, axion electrodynamics and potential applications of topological materials. Here, we investigate the magnetotransport and Berry phase of rare earth element Gd doped Bi2Se3 (Gd_Bi2Se3) topological insulator at low temperatures and high magnetic fields. Gd_Bi2Se3 single crystals show Shubnikov-de Haas (SdH) oscillations with nontrivial Berry phase while Bi2Se3 single crystals show zero Berry phase in SdH oscillations. The temperature dependent magnetization curves can be well fitted with the Curie-Weiss law in 3-300 K region, indicating no magnetic ordering in Gd_Bi2Se3 crystals. Moreover, Gd doping has limited influence on the quantum oscillation parameters (e.g., frequency of oscillations, the area of the Fermi surface, effective electron mass, Fermi wave vectors etc.), but has an impact on the Hall mobility, carrier density, and band topology. Our results demonstrate that Gd doping can tune the Berry phase of topological insulators effectively, which may pave a way for the future realization of many predicted exotic transport phenomena of topological origin.

cond-mat.mtrl-sci↗
arXiv2023

ActionPrompt: Action-Guided 3D Human Pose Estimation With Text and Pose Prompting

Recent 2D-to-3D human pose estimation (HPE) utilizes temporal consistency across sequences to alleviate the depth ambiguity problem but ignore the action related prior knowledge hidden in the pose sequence. In this paper, we propose a plug-and-play module named Action Prompt Module (APM) that effectively mines different kinds of action clues for 3D HPE. The highlight is that, the mining scheme of APM can be widely adapted to different frameworks and bring consistent benefits. Specifically, we first present a novel Action-related Text Prompt module (ATP) that directly embeds action labels and transfers the rich language information in the label to the pose sequence. Besides, we further introduce Action-specific Pose Prompt module (APP) to mine the position-aware pose pattern of each action, and exploit the correlation between the mined patterns and input pose sequence for further pose refinement. Experiments show that APM can improve the performance of most video-based 2D-to-3D HPE frameworks by a large margin.

cs.CV↗
arXiv2023

LEST: Large-scale LiDAR Semantic Segmentation with Transformer

Large-scale LiDAR-based point cloud semantic segmentation is a critical task in autonomous driving perception. Almost all of the previous state-of-the-art LiDAR semantic segmentation methods are variants of sparse 3D convolution. Although the Transformer architecture is becoming popular in the field of natural language processing and 2D computer vision, its application to large-scale point cloud semantic segmentation is still limited. In this paper, we propose a LiDAR sEmantic Segmentation architecture with pure Transformer, LEST. LEST comprises two novel components: a Space Filling Curve (SFC) Grouping strategy and a Distance-based Cosine Linear Transformer, DISCO. On the public nuScenes semantic segmentation validation set and SemanticKITTI test set, our model outperforms all the other state-of-the-art methods.

cs.CV↗
arXiv2023

CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection

Formalizing surgical activities as triplets of the used instruments, actions performed, and target anatomies is becoming a gold standard approach for surgical activity modeling. The benefit is that this formalization helps to obtain a more detailed understanding of tool-tissue interaction which can be used to develop better Artificial Intelligence assistance for image-guided surgery. Earlier efforts and the CholecTriplet challenge introduced in 2021 have put together techniques aimed at recognizing these triplets from surgical footage. Estimating also the spatial locations of the triplets would offer a more precise intraoperative context-aware decision support for computer-assisted intervention. This paper presents the CholecTriplet2022 challenge, which extends surgical action triplet modeling from recognition to detection. It includes weakly-supervised bounding box localization of every visible surgical instrument (or tool), as the key actors, and the modeling of each tool-activity in the form of triplet. The paper describes a baseline method and 10 new deep learning algorithms presented at the challenge to solve the task. It also provides thorough methodological comparisons of the methods, an in-depth analysis of the obtained results across multiple metrics, visual and procedural challenges; their significance, and useful insights for future research directions and applications in surgery.

eess.IV↗
arXiv2023

PELE scores: Pelvic X-ray Landmark Detection by Pelvis Extraction and Enhancement

The pelvis, the lower part of the trunk, supports and balances the trunk. Landmark detection from a pelvic X-ray (PXR) facilitates downstream analysis and computer-assisted diagnosis and treatment of pelvic diseases. Although PXRs have the advantages of low radiation and reduced cost compared to computed tomography (CT) images, their 2D pelvis-tissue superposition of 3D structures confuses clinical decision-making. In this paper, we propose a PELvis Extraction (PELE) module that utilizes 3D prior anatomical knowledge in CT to guide and well isolate the pelvis from PXRs, thereby eliminating the influence of soft tissue. We conduct an extensive evaluation based on two public datasets and one private dataset, totaling 850 PXRs. The experimental results show that the proposed PELE module significantly improves the accuracy of PXRs landmark detection and achieves state-of-the-art performances in several benchmark metrics, thus better serving downstream tasks.

eess.IV↗
arXiv2023

Multi-Epoch Learning for Deep Click-Through Rate Prediction Models

The one-epoch overfitting phenomenon has been widely observed in industrial Click-Through Rate (CTR) applications, where the model performance experiences a significant degradation at the beginning of the second epoch. Recent advances try to understand the underlying factors behind this phenomenon through extensive experiments. However, it is still unknown whether a multi-epoch training paradigm could achieve better results, as the best performance is usually achieved by one-epoch training. In this paper, we hypothesize that the emergence of this phenomenon may be attributed to the susceptibility of the embedding layer to overfitting, which can stem from the high-dimensional sparsity of data. To maintain feature sparsity while simultaneously avoiding overfitting of embeddings, we propose a novel Multi-Epoch learning with Data Augmentation (MEDA), which can be directly applied to most deep CTR models. MEDA achieves data augmentation by reinitializing the embedding layer in each epoch, thereby avoiding embedding overfitting and simultaneously improving convergence. To our best knowledge, MEDA is the first multi-epoch training paradigm designed for deep CTR prediction models. We conduct extensive experiments on several public datasets, and the effectiveness of our proposed MEDA is fully verified. Notably, the results show that MEDA can significantly outperform the conventional one-epoch training. Besides, MEDA has exhibited significant benefits in a real-world scene on Kuaishou.

cs.IR↗
arXiv2023

Strain Anisotropy Driven Spontaneous Formation of Nanoscrolls from Two-Dimensional Janus Layers

Two-dimensional Janus transition metal dichalcogenides (TMDs) have attracted attention due to their emergent properties arising from broken mirror symmetry and self-driven polarisation fields. While it has been proposed that their vdW superlattices hold the key to achieving superior properties in piezoelectricity and photovoltiacs, available synthesis has ultimately limited their realisation. Here, we report the first packed vdW nanoscrolls made from Janus TMDs through a simple one-drop solution technique. Our results, including ab-initio simulations, show that the Bohr radius difference between the top sulphur and the bottom selenium atoms within Janus M_Se^S (M=Mo, W) results in a permanent compressive surface strain that acts as a nanoscroll formation catalyst after small liquid interaction. Unlike classical 2D layers, the surface strain in Janus TMDs can be engineered from compressive to tensile by placing larger Bohr radius atoms on top (M_S^Se) to yield inverted C scrolls. Detailed microscopy studies offer the first insights into their morphology and readily formed Moiré lattices. In contrast, spectroscopy and FETs studies establish their excitonic and device properties and highlight significant differences compared to 2D flat Janus TMDs. These results introduce the first polar Janus TMD nanoscrolls and introduce inherent strain-driven scrolling dynamics as a catalyst to create superlattices.

cond-mat.mtrl-sci↗