arXiv subjects

Wei Guo

Publications and source records attributed to Wei Guo.

At least 217 records · Page 12Linked to original sources

arXiv2023

A learned conservative semi-Lagrangian finite volume scheme for transport simulations

Semi-Lagrangian (SL) schemes are known as a major numerical tool for solving transport equations with many advantages and have been widely deployed in the fields of computational fluid dynamics, plasma physics modeling, numerical weather prediction, among others. In this work, we develop a novel machine learning-assisted approach to accelerate the conventional SL finite volume (FV) schemes. The proposed scheme avoids the expensive tracking of upstream cells but attempts to learn the SL discretization from the data by incorporating specific inductive biases in the neural network, significantly simplifying the algorithm implementation and leading to improved efficiency. In addition, the method delivers sharp shock transitions and a level of accuracy that would typically require a much finer grid with traditional transport solvers. Numerical tests demonstrate the effectiveness and efficiency of the proposed method.

math.NA↗

arXiv2023

Vinen's latest thoughts on the "bump'' puzzle in decaying He II counterflow turbulence

The pioneering work of William F. Vinen (also known as Joe Vinen) on thermal counterflow turbulence in superfluid helium-4 largely inaugurated the research on quantum turbulence. But despite decades of research on this topic, there are still open questions remaining to be solved. One such question is related to the anomalous increase of the vortex-line density $L(t)$ during the decay of counterflow turbulence, which is often termed as the ``bump'' on the $L(t)$ curve. In 2016, Vinen and colleagues developed a theoretical model to explain this puzzling phenomenon (JETP Letters, \textbf{103}, 648-652 (2016)). However, he realized in the last a few years of his life that this theory must be at least inadequate. In remembrance of Joe, we discuss in this paper his latest thoughts on counterflow turbulence and its decay. We also briefly outline our recent experimental and numerical work on this topic.

physics.flu-dyn↗

arXiv2023

Disentangling Past-Future Modeling in Sequential Recommendation via Dual Networks

Sequential recommendation (SR) plays an important role in personalized recommender systems because it captures dynamic and diverse preferences from users' real-time increasing behaviors. Unlike the standard autoregressive training strategy, future data (also available during training) has been used to facilitate model training as it provides richer signals about user's current interests and can be used to improve the recommendation quality. However, these methods suffer from a severe training-inference gap, i.e., both past and future contexts are modeled by the same encoder when training, while only historical behaviors are available during inference. This discrepancy leads to potential performance degradation. To alleviate the training-inference gap, we propose a new framework DualRec, which achieves past-future disentanglement and past-future mutual enhancement by a novel dual network. Specifically, a dual network structure is exploited to model the past and future context separately. And a bi-directional knowledge transferring mechanism enhances the knowledge learnt by the dual network. Extensive experiments on four real-world datasets demonstrate the superiority of our approach over baseline methods. Besides, we demonstrate the compatibility of DualRec by instantiating using RNN, Transformer, and filter-MLP as backbones. Further empirical analysis verifies the high utility of modeling future contexts under our DualRec framework. The code of DualRec is publicly available at https://github.com/zhy99426/DualRec.

cs.IR↗

arXiv2022

Intent-aware Multi-source Contrastive Alignment for Tag-enhanced Recommendation

To offer accurate and diverse recommendation services, recent methods use auxiliary information to foster the learning process of user and item representations. Many SOTA methods fuse different sources of information (user, item, knowledge graph, tags, etc.) into a graph and use Graph Neural Networks to introduce the auxiliary information through the message passing paradigm. In this work, we seek an alternative framework that is light and effective through self-supervised learning across different sources of information, particularly for the commonly accessible item tag information. We use a self-supervision signal to pair users with the auxiliary information associated with the items they have interacted with before. To achieve the pairing, we create a proxy training task. For a given item, the model predicts the correct pairing between the representations obtained from the users that have interacted with this item and the assigned tags. This design provides an efficient solution, using the auxiliary information directly to enhance the quality of user and item embeddings. User behavior in recommendation systems is driven by the complex interactions of many factors behind the decision-making processes. To make the pairing process more fine-grained and avoid embedding collapse, we propose an intent-aware self-supervised pairing process where we split the user embeddings into multiple sub-embedding vectors. Each sub-embedding vector captures a specific user intent via self-supervised alignment with a particular cluster of tags. We integrate our designed framework with various recommendation models, demonstrating its flexibility and compatibility. Through comparison with numerous SOTA methods on seven real-world datasets, we show that our method can achieve better performance while requiring less training time. This indicates the potential of applying our approach on web-scale datasets.

cs.IR↗

arXiv2022

Adaptive sparse grid discontinuous Galerkin method: review and software implementation

This paper reviews the adaptive sparse grid discontinuous Galerkin (aSG-DG) method for computing high dimensional partial differential equations (PDEs) and its software implementation. The C\texttt{++} software package called AdaM-DG, implementing the aSG-DG method, is available on Github at \url{https://github.com/JuntaoHuang/adaptive-multiresolution-DG}. The package is capable of treating a large class of high dimensional linear and nonlinear PDEs. We review the essential components of the algorithm and the functionality of the software, including the multiwavelets used, assembling of bilinear operators, fast matrix-vector product for data with hierarchical structures. We further demonstrate the performance of the package by reporting numerical error and CPU cost for several benchmark test, including linear transport equations, wave equations and Hamilton-Jacobi equations.

math.NA↗

arXiv2022

Imaging the decay of quantized vortex rings to decipher quantum dissipation

Like many quantum fluids, superfluid helium-4 (He II) can be considered as a mixture of two miscible fluid components: an inviscid superfluid and a viscous normal fluid consisting of thermal quasiparticles [1]. A mutual friction between the two fluids can emerge due to quasiparticles scattering off quantized vortex lines in the superfluid [2]. This quantum dissipation mechanism is the key for understanding various fascinating behaviors of the two-fluid system [3,4]. However, due to the lack of experimental data for guidance, modeling the mutual friction between individual vortices and the normal fluid remains an unsettled topic despite decades of research [5-10]. Here we report an experiment where we visualize the motion of quantized vortex rings in He II by decorating them with solidified deuterium tracer particles. By examining how the rings spontaneously shrink and accelerate, we provide unequivocal evidences showing that only a recent theory [9] which accounts for the coupled motion of the two fluids with a self-consistent local friction can reproduce the observed ring dynamics. Our work eliminates long-standing ambiguities in our theoretical description of the vortex dynamics in He II, which will have a far-reaching impact since similar mutual friction concept has been adopted for a wide variety of quantum two-fluid systems, including atomic Bose-Einstein condensates (BECs) [11,12], superfluid neutron stars [13-15], and gravity-mapped holographic superfluid [16,17].

cond-mat.quant-gas↗

arXiv2022

IntTower: the Next Generation of Two-Tower Model for Pre-Ranking System

Scoring a large number of candidates precisely in several milliseconds is vital for industrial pre-ranking systems. Existing pre-ranking systems primarily adopt the \textbf{two-tower} model since the ``user-item decoupling architecture'' paradigm is able to balance the \textit{efficiency} and \textit{effectiveness}. However, the cost of high efficiency is the neglect of the potential information interaction between user and item towers, hindering the prediction accuracy critically. In this paper, we show it is possible to design a two-tower model that emphasizes both information interactions and inference efficiency. The proposed model, IntTower (short for \textit{Interaction enhanced Two-Tower}), consists of Light-SE, FE-Block and CIR modules. Specifically, lightweight Light-SE module is used to identify the importance of different features and obtain refined feature representations in each tower. FE-Block module performs fine-grained and early feature interactions to capture the interactive signals between user and item towers explicitly and CIR module leverages a contrastive interaction regularization to further enhance the interactions implicitly. Experimental results on three public datasets show that IntTower outperforms the SOTA pre-ranking models significantly and even achieves comparable performance in comparison with the ranking models. Moreover, we further verify the effectiveness of IntTower on a large-scale advertisement pre-ranking system. The code of IntTower is publicly available\footnote{https://github.com/archersama/IntTower}

cs.IR↗

arXiv2022

A Local Macroscopic Conservative (LoMaC) low rank tensor method with the discontinuous Galerkin method for the Vlasov dynamics

In this paper, we propose a novel Local Macroscopic Conservative (LoMaC) low rank tensor method with discontinuous Galerkin (DG) discretization for the physical and phase spaces for simulating the Vlasov-Poisson (VP) system. The LoMaC property refers to the exact local conservation of macroscopic mass, momentum and energy at the discrete level. The recently developed LoMaC low rank tensor algorithm (arXiv:2207.00518) simultaneously evolves the macroscopic conservation laws of mass, momentum and energy using the kinetic flux vector splitting; then the LoMaC property is realized by projecting the low rank kinetic solution onto a subspace that shares the same macroscopic observables. This paper is a generalization of our previous work, but with DG discretization to take advantage of its compactness and flexibility in handling boundary conditions and its superior accuracy in the long term. The algorithm is developed in a similar fashion as that for a finite difference scheme, by observing that the DG method can be viewed equivalently in a nodal fashion. With the nodal DG method, assuming a tensorized computational grid, one will be able to (1) derive differentiation matrices for different nodal points based on a DG upwind discretization of transport terms, and (2) define a weighted inner product space based on the nodal DG grid points. The algorithm can be extended to the high dimensional problems by hierarchical Tucker decomposition of solution tensors and a corresponding conservative projection algorithm. In a similar spirit, the algorithm can be extended to DG methods on nodal points of an unstructured mesh, or to other types of discretization, e.g. the spectral method in velocity direction. Extensive numerical results are performed to showcase the efficacy of the method.

math.NA↗

arXiv2022

Coarse-to-Fine Knowledge-Enhanced Multi-Interest Learning Framework for Multi-Behavior Recommendation

Multi-types of behaviors (e.g., clicking, adding to cart, purchasing, etc.) widely exist in most real-world recommendation scenarios, which are beneficial to learn users' multi-faceted preferences. As dependencies are explicitly exhibited by the multiple types of behaviors, effectively modeling complex behavior dependencies is crucial for multi-behavior prediction. The state-of-the-art multi-behavior models learn behavior dependencies indistinguishably with all historical interactions as input. However, different behaviors may reflect different aspects of user preference, which means that some irrelevant interactions may play as noises to the target behavior to be predicted. To address the aforementioned limitations, we introduce multi-interest learning to the multi-behavior recommendation. More specifically, we propose a novel Coarse-to-fine Knowledge-enhanced Multi-interest Learning (CKML) framework to learn shared and behavior-specific interests for different behaviors. CKML introduces two advanced modules, namely Coarse-grained Interest Extracting (CIE) and Fine-grained Behavioral Correlation (FBC), which work jointly to capture fine-grained behavioral dependencies. CIE uses knowledge-aware information to extract initial representations of each interest. FBC incorporates a dynamic routing scheme to further assign each behavior among interests. Additionally, we use the self-attention mechanism to correlate different behavioral information at the interest level. Empirical results on three real-world datasets verify the effectiveness and efficiency of our model in exploiting multi-behavior data. Further experiments demonstrate the effectiveness of each module and the robustness and superiority of the shared and specific modelling paradigm for multi-behavior data.

cs.IR↗

arXiv2022

A Local Macroscopic Conservative (LoMaC) low rank tensor method for the Vlasov dynamics

In this paper, we propose a novel Local Macroscopic Conservative (LoMaC) low rank tensor method for simulating the Vlasov-Poisson (VP) system. The LoMaC property refers to the exact local conservation of macroscopic mass, momentum and energy at the discrete level. This is a follow-up work of our previous development of a conservative low rank tensor approach for Vlasov dynamics (arXiv:2201.10397). In that work, we applied a low rank tensor method with a conservative singular value decomposition (SVD) to the high dimensional VP system to mitigate the curse of dimensionality, while maintaining the local conservation of mass and momentum. However, energy conservation is not guaranteed, which is a critical property to avoid unphysical plasma self-heating or cooling. The new ingredient in the LoMaC low rank tensor algorithm is that we simultaneously evolve the macroscopic conservation laws of mass, momentum and energy using a flux-difference form with kinetic flux vector splitting; then the LoMaC property is realized by projecting the low rank kinetic solution onto a subspace that shares the same macroscopic observables by a conservative orthogonal projection. The algorithm is extended to the high dimensional problems by hierarchical Tuck decomposition of solution tensors and a corresponding conservative projection algorithm. Extensive numerical tests on the VP system are showcased for the algorithm's efficacy.

math.NA↗

arXiv2022

Boiling and cavitation caused by transient heat transfer in superfluid helium-4

Superfluid helium-4 (He II) has been widely utilized as a coolant in various scientific and engineering applications due to its superior heat transfer capability. An important parameter required in the design of many He II based cooling systems is the peak heat flux $q^*$, which refers to the threshold heat flux above which boiling spontaneously occurs in He II. Past experimental and numerical studies showed that $q^*$ increases when the heating time $t_h$ is reduced, which leads to an intuitive expectation that very high $q^*$ may be achievable at sufficiently small $t_h$. Knowledge on how $q^*$ actually behaves at small $t_h$ is important for applications such as laser ablation in He II. Here we present a numerical study on the evolution of the thermodynamic state of the He II in front of a planar heater by solving the He II two-fluid equations of motion. For an applied heat flux, we determine the heating time beyond which the He II near the heater transits to the vapor phase. As such, a curve correlating $q^*$ and $t_h$ can be obtained, which nicely reproduces some relevant experimental data. Surprisingly, we find that there exists a critical peak heat flux $q^*_c$, above which boiling occurs nearly instantaneously regardless of $t_h$. We reveal that the boiling in this regime is essentially cavitation caused by the combined effects of the first-sound and the second-sound waves in He II. Based on this physical picture, an analytical model for $q^*_c$ is developed, which reproduces the simulated $q^*_c$ values at various He II bath temperatures and hydrostatic head pressures. This work represents a major progress in our understanding of transient heat transfer in He II.

cond-mat.other↗

arXiv2022

Nonlinear beam self-maintaining effect in graded-index multimode fiber

Multimode fiber systems are desirable for industrial and scientific applications. As an interesting effect for the laser beam propagation in a multimode fiber, nonlinear Kerr beam cleanup has attracted considerable research interest due to the spatial beam compressing. However, its physical mechanisms, especially the influences of input conditions on its performances, remain unclear. Here, we report a new self-organized regime for the multimode beam propagation in a graded-index multimode fiber: when the input laser has a dominant mode in which most of the laser energy is concentrated, the beam profile can be maintaining in a well-defined structure similar to the input dominant mode in nonlinear regime, while it will evolve to an irregular pattern in linear regime. The existence and universality of this nonlinear beam self-maintaining effect have been verified by the experimental and numerical data. Our results also provide evidence that nonlinear Kerr effects can be the driving mechanism and nonlinear Kerr beam cleanup is a specific case of this effect. Further research into this spatial beam shaping effect may provide a new perspective to understand other multimode fiber nonlinearities.

physics.optics↗

arXiv2022

A temporal chrominance trigger for clean-label backdoor attack against anti-spoof rebroadcast detection

We propose a stealthy clean-label video backdoor attack against Deep Learning (DL)-based models aiming at detecting a particular class of spoofing attacks, namely video rebroadcast attacks. The injected backdoor does not affect spoofing detection in normal conditions, but induces a misclassification in the presence of a specific triggering signal. The proposed backdoor relies on a temporal trigger altering the average chrominance of the video sequence. The backdoor signal is designed by taking into account the peculiarities of the Human Visual System (HVS) to reduce the visibility of the trigger, thus increasing the stealthiness of the backdoor. To force the network to look at the presence of the trigger in the challenging clean-label scenario, we choose the poisoned samples used for the injection of the backdoor following a so-called Outlier Poisoning Strategy (OPS). According to OPS, the triggering signal is inserted in the training samples that the network finds more difficult to classify. The effectiveness of the proposed backdoor attack and its generality are validated experimentally on different datasets and anti-spoofing rebroadcast detection architectures.

cs.CV↗

arXiv2022

Joint Device Selection and Power Control for Wireless Federated Learning

This paper studies the joint device selection and power control scheme for wireless federated learning (FL), considering both the downlink and uplink communications between the parameter server (PS) and the terminal devices. In each round of model training, the PS first broadcasts the global model to the terminal devices in an analog fashion, and then the terminal devices perform local training and upload the updated model parameters to the PS via over-the-air computation (AirComp). First, we propose an AirComp-based adaptive reweighing scheme for the aggregation of local updated models, where the model aggregation weights are directly determined by the uplink transmit power values of the selected devices and which enables the joint learning and communication optimization simply by the device selection and power control. Furthermore, we provide a convergence analysis for the proposed wireless FL algorithm and the upper bound on the expected optimality gap between the expected and optimal global loss values is derived. With instantaneous channel state information (CSI), we formulate the optimality gap minimization problems under both the individual and sum uplink transmit power constraints, respectively, which are shown to be solved by the semidefinite programming (SDR) technique. Numerical results reveal that our proposed wireless FL algorithm achieves close to the best performance by using the ideal FedAvg scheme with error-free model exchange and full device participation.

cs.IT↗

arXiv2022

Dynamic Clustering and Power Control for Two-Tier Wireless Federated Learning

Federated learning (FL) has been recognized as a promising distributed learning paradigm to support intelligent applications at the wireless edge, where a global model is trained iteratively through the collaboration of the edge devices without sharing their data. However, due to the relatively large communication cost between the devices and parameter server (PS), direct computing based on the information from the devices may not be resource efficient. This paper studies the joint communication and learning design for the over-the-air computation (AirComp)-based two-tier wireless FL scheme, where the lead devices first collect the local gradients from their nearby subordinate devices, and then send the merged results to the PS for the second round of aggregation. We establish a convergence result for the proposed scheme and derive the upper bound on the optimality gap between the expected and optimal global loss values. Next, based on the device distance and data importance, we propose a hierarchical clustering method to build the two-tier structure. Then, with only the instantaneous channel state information (CSI), we formulate the optimality gap minimization problem and solve it by using an efficient alternating minimization method. Numerical results show that the proposed scheme outperforms the baseline ones.

cs.IT↗

arXiv2022

Improved-Flow Warp Module for Remote Sensing Semantic Segmentation

Remote sensing semantic segmentation aims to assign automatically each pixel on aerial images with specific label. In this letter, we proposed a new module, called improved-flow warp module (IFWM), to adjust semantic feature maps across different scales for remote sensing semantic segmentation. The improved-flow warp module is applied along with the feature extraction process in the convolutional neural network. First, IFWM computes the offsets of pixels by a learnable way, which can alleviate the misalignment of the multi-scale features. Second, the offsets help with the low-resolution deep feature up-sampling process to improve the feature accordance, which boosts the accuracy of semantic segmentation. We validate our method on several remote sensing datasets, and the results prove the effectiveness of our method..

cs.CV↗

arXiv2022

Evidence for quasi-two-dimensional superconductivity in infinite-layer nickelates

After being expected as a promising analogue to cuprates for decades, superconductivity was recently discovered in infinite-layer nickelates, providing new opportunities to explore mechanisms of high-temperature superconductivity. However, in sharp contrast to the single-band quasi-two-dimensional superconductivity in cuprates, nickelates exhibit a multi-band electronic structure and an unexpected isotropic superconductivity as reported recently, which challenges the cuprate-like picture in nickelates. Here, we show the superconductivity in nickelates is actually anisotropic and quasi-two-dimensional in nature, as that in cuprates. By synthesizing high-quality lanthanide nickelate films with enhanced crystallinity and superconductivity ($T_{c}^{onset}$ = 18.8 K, $T_{c}^{zero}$ = 16.5 K), strong anisotropic magnetotransport behaviors have been observed. The quasi-two-dimensional nature is further confirmed by the existence of a cusp-like peak of the angle-dependent $T_{c}$, and a Berezinskii-Kosterlitz-Thouless transition near $T_{c}$. Our work thus suggests a quasi-two-dimensional superconductivity in infinite-layer nickelates, implying a single-3$d_{x^2-y^2}$-band cuprate-like picture may remain valid in these compounds.

cond-mat.supr-con↗

arXiv2022

Velocity circulation intermittency in finite-temperature turbulent superfluid helium

We study intermittency of circulation moments in turbulent superfluid helium by using experimental grid turbulence and numerical simulations of the Hall-Vinen-Bekarevich-Khalatnikov model. More precisely, we compute the velocity circulation $Γ_r$ in loops of size $r$ laying in the inertial range. For both, experimental and numerical data, the circulation variance shows a clear Kolmogorov scaling $\langle Γ_r^2 \rangle \sim r^{8/3}$ in the inertial range, independently of the temperature. Scaling exponents of high-order moments are comparable, within error bars, to previously reported anomalous circulation exponents in classical turbulence and low-temperature quantum turbulence numerical simulations.

physics.flu-dyn↗