arXiv subjects

Junjie Zhai

Publications and source records attributed to Junjie Zhai.

9 recordsLinked to original sources

arXiv2026

Efficient Cross-Architecture Knowledge Transfer for Large-Scale Online User Response Prediction

Deploying new architectures in large-scale user response prediction systems incurs high model switching costs due to expensive retraining on massive historical data and performance degradation under data retention constraints. Existing knowledge distillation methods struggle with architectural heterogeneity and the prohibitive cost of transferring large embedding tables. We propose CrossAdapt, a two-stage framework for efficient cross-architecture knowledge transfer. The offline stage enables rapid embedding transfer via dimension-adaptive projections without iterative training, combined with progressive network distillation and strategic sampling to reduce computational cost. The online stage introduces asymmetric co-distillation, where students update frequently while teachers update infrequently, together with a distribution-aware adaptation mechanism that dynamically balances historical knowledge preservation and fast adaptation to evolving data. Experiments on three public datasets show that CrossAdapt achieves 0.27-0.43% AUC improvements while reducing training time by 43-71%. Large-scale deployment on Tencent WeChat Channels (~10M daily samples) further demonstrates its effectiveness, significantly mitigating AUC degradation, LogLoss increase, and prediction bias compared to standard distillation baselines.

cs.AI↗

arXiv2025

Practice on Long Behavior Sequence Modeling in Tencent Advertising

Long-sequence modeling has become an indispensable frontier in recommendation systems for capturing users' long-term preferences. However, user behaviors within advertising domains are inherently sparse, posing a significant barrier to constructing long behavioral sequences using data from a single advertising domain alone. This motivates us to collect users' behaviors not only across diverse advertising scenarios, but also beyond the boundaries of the advertising domain into content domains-thereby constructing unified commercial behavior trajectories. This cross-domain or cross-scenario integration gives rise to the following challenges: (1) feature taxonomy gaps between distinct scenarios and domains, (2) inter-field interference arising from irrelevant feature field pairs, and (3) target-wise interference in temporal and semantic patterns when optimizing for different advertising targets. To address these challenges, we propose several practical approaches within the two-stage framework for long-sequence modeling. In the first (search) stage, we design a hierarchical hard search method for handling complex feature taxonomy hierarchies, alongside a decoupled embedding-based soft search to alleviate conflicts between attention mechanisms and feature representation. In the second (sequence modeling) stage, we introduce: (a) Decoupled Side Information Temporal Interest Networks (TIN) to mitigate inter-field conflicts; (b) Target-Decoupled Positional Encoding and Target-Decoupled SASRec to address target-wise interference; and (c) Stacked TIN to model high-order behavioral correlations. Deployed in production on Tencent's large-scale advertising platforms, our innovations delivered significant performance gains: an overall 4.22% GMV lift in WeChat Channels and an overall 1.96% GMV increase in WeChat Moments.

cs.IR↗

arXiv2025

Magnetic phases and electron-phonon coupling in La$_3$Ni$_2$O$_7$ under pressure

Motivated by recent reports of pressure-induced superconductivity in bilayer nickelate La$_3$Ni$_2$O$_7$, we present a comprehensive investigation into the structural, electronic, magnetic, and phonon properties of this compound across a pressure range of 0 to 29.5 GPa. DFT+U calculations reveal that the A-type antiferromagnetic ground state of La$_3$Ni$_2$O$_7$ persists throughout the studied pressure range. Electronic structure analysis shows that the Ni-$d_{xy}$ and Ni-$d_{z^2}$ orbitals dominate near the Fermi level in both the $Fmmm$ and $Amam$ phases of La$_3$Ni$_2$O$_7$. Phonon dispersion calculations for the $Fmmm$ phase reveal no imaginary modes from 12 to 29.5 GPa, confirming its dynamical stability in this pressure range. The vibrational frequencies of O atoms are substantially higher than those of Ni and La atoms, primarily due to the lower mass of oxygen. At 29.5 GPa, the electron-phonon coupling constant $λ$ for the $Fmmm$ phase is calculated to be 0.13. This small value suggests that conventional electron-phonon coupling is insufficient to explain the reported superconductivity in La$_3$Ni$_2$O$_7$, indicating a potentially unconventional mechanism. The study offers nuanced, actionable insights that can strategically inform and direct subsequent experimental investigations into the design and optimization of nickel-based superconducting materials.

cond-mat.supr-con↗

arXiv2025

Prediction of high-temperature ambient-pressure superconductivity in hexagonal boron-rich clathrates

Inspired by recent predictions of superconductivity in B-C framework clathrates, we employ density functional theory to explore potential superconductors among hexagonal hydride-substituted compounds with compositions XB$_8$C, XB$_7$C$_2$, XB$_6$C$_3$, XB$_3$C$_6$, XB$_2$C$_7$, and XBC$_8$. Our high-throughput calculations on 96 compounds reveal several dynamically stable candidates exhibiting superconductivity at ambient pressure. Analysis of electronic structures and electron-phonon coupling demonstrates that CaB$_8$C, SrB$_8$C, and BaB$_8$C possess superconducting transition temperatures ($T_c$) exceeding 50 K, with CaB$_8$C exhibiting the highest predicted $T_c$ of 77.1 K among all stable compounds studied. These findings expand the family of B-C clathrate superconductors and provide valuable insights for experimental efforts aimed at discovering novel superconducting materials.

cond-mat.supr-con↗

arXiv2024

Theoretical Prediction of High-Temperature Superconductivity in SrAuH$_3$ at Ambient Pressure

We present a comprehensive computational investigation of electron-phonon interactions in MXH$_3$ hydride compounds, where $M$ represents alkali and post-transition metals, and $X$ denotes 3$d$, 4$d$, and 5$d$ transition metals. Our density functional theory calculations identify 17 dynamically stable compounds. Notably, SrAuH$_3$ and SrZnH$_3$ emerge as theoretical ambient-pressure superconductors with predicted critical temperatures ($T_c$) exceeding 100 K. Analysis of the electronic structure reveals that the $X$ component dominates the density of states at the Fermi level, playing a crucial role in determining electron-phonon coupling strength and superconducting properties. We elucidate the underlying mechanisms governing these properties through detailed examination of the electronic and vibrational spectra. Our findings may challenge the prevailing notion that high-$T_c$ superconductivity in hydrides requires extreme pressures, potentially paving the way for practical applications. This study also provides valuable insights to guide future experimental efforts in the synthesis of ambient-pressure hydride superconductors.

cond-mat.supr-con↗

arXiv2020

Distributed Equivalent Substitution Training for Large-Scale Recommender Systems

We present Distributed Equivalent Substitution (DES) training, a novel distributed training framework for large-scale recommender systems with dynamic sparse features. DES introduces fully synchronous training to large-scale recommendation system for the first time by reducing communication, thus making the training of commercial recommender systems converge faster and reach better CTR. DES requires much less communication by substituting the weights-rich operators with the computationally equivalent sub-operators and aggregating partial results instead of transmitting the huge sparse weights directly through the network. Due to the use of synchronous training on large-scale Deep Learning Recommendation Models (DLRMs), DES achieves higher AUC(Area Under ROC). We successfully apply DES training on multiple popular DLRMs of industrial scenarios. Experiments show that our implementation outperforms the state-of-the-art PS-based training framework, achieving up to 68.7% communication savings and higher throughput compared to other PS-based recommender systems.

cs.LG↗

arXiv2020

On the Bound of Cumulative Return in Trading Series and the Verification Using Technical Trading Rules

Although there is a wide use of technical trading rules in stock markets, the profitability of them still remains controversial. This paper first presents and proves the upper bound of cumulative return, and then introduces many of conventional technical trading rules. Furthermore, with the help of bootstrap methodology, we investigate the profitability of technical trading rules on different international stock markets, including developed markets and emerging markets. At last, the results show that the technical trading rules are hard to beat the market, and even less profitable than the random trading strategy.

q-fin.ST↗

arXiv2018

Neural Machine Translation with Key-Value Memory-Augmented Attention

Although attention-based Neural Machine Translation (NMT) has achieved remarkable progress in recent years, it still suffers from issues of repeating and dropping translations. To alleviate these issues, we propose a novel key-value memory-augmented attention model for NMT, called KVMEMATT. Specifically, we maintain a timely updated keymemory to keep track of attention history and a fixed value-memory to store the representation of source sentence throughout the whole translation process. Via nontrivial transformations and iterative interactions between the two memories, the decoder focuses on more appropriate source word(s) for predicting the next target word at each decoding step, therefore can improve the adequacy of translations. Experimental results on Chinese=>English and WMT17 German<=>English translation tasks demonstrate the superiority of the proposed model.

cs.CL↗

arXiv2018

Towards Robust Neural Machine Translation

Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation (NMT) models. In this paper, we propose to improve the robustness of NMT models with adversarial stability training. The basic idea is to make both the encoder and decoder in NMT models robust against input perturbations by enabling them to behave similarly for the original input and its perturbed counterpart. Experimental results on Chinese-English, English-German and English-French translation tasks show that our approaches can not only achieve significant improvements over strong NMT systems but also improve the robustness of NMT models.

cs.CL↗