SearcharxivSearch

arXiv subjects

Xingyuan Wang

Publications and source records attributed to Xingyuan Wang.

4 recordsLinked to original sources

MISO: Model-Internal-State-Guided Optimization for Ranking Models

Ranking models are repeatedly refined within established model families, yet the choice of which component to scale, replace, or retire is often guided by expensive trial-and-error. We present Model Internal State Optimization (MISO), a systems workflow that uses model internal states (MIS), including parameters, activations, gradients, and normalization statistics, to prioritize such local optimization decisions. MISO extracts MIS from a trained ranking model, aggregates them into ranking, alignment, and comparison signals, and converts those signals into a small set of interpretable candidate edits. Because MIS are re-extracted after each retraining cycle, MISO naturally supports an adaptive optimization workflow that tracks evolving model behavior as data distributions and system requirements shift over time. In an ads ranking case study, MISO improves normalized entropy while requiring substantially fewer validation runs than expert-driven and black-box scaling workflows, offering a practical middle ground between manual tuning and opaque automated search.

cs.IR

External Large Foundation Model: How to Efficiently Serve Trillions of Parameters for Online Ads Recommendation

Ads recommendation is a prominent service of online advertising systems and has been actively studied. Recent studies indicate that scaling-up and advanced design of the recommendation model can bring significant performance improvement. However, with a larger model scale, such prior studies have a significantly increasing gap from industry as they often neglect two fundamental challenges in industrial-scale applications. First, training and inference budgets are restricted for the model to be served, exceeding which may incur latency and impair user experience. Second, large-volume data arrive in a streaming mode with data distributions dynamically shifting, as new users/ads join and existing users/ads leave the system. We propose the External Large Foundation Model (ExFM) framework to address the overlooked challenges. Specifically, we develop external distillation and a data augmentation system (DAS) to control the computational cost of training/inference while maintaining high performance. We design the teacher in a way like a foundation model (FM) that can serve multiple students as vertical models (VMs) to amortize its building cost. We propose Auxiliary Head and Student Adapter to mitigate the data distribution gap between FM and VMs caused by the streaming data issue. Comprehensive experiments on internal industrial-scale applications and public datasets demonstrate significant performance gain by ExFM.

cs.IR

Ultra-compact beam steering nanolasers

The miniaturization and integration of beam steering devices have consistently been the focus of the field. Conventional methods alter the eigenmode of the optical cavity by regulating the refractive index. Due to the weak nonlinear effect of the optical system, the device must be sufficiently large to achieve sufficient light modulation. The effective method for miniaturizing beam steering devices currently in use is based on metasurfaces. However, this type of device necessitates the input of a laser source, which precludes the simultaneous generation and control of light in a single device. Here we propose a miniaturized beam steering device that employs mode selection between different bound states in the continuum (BIC) states through phase change material. The device is capable of simultaneously achieving both light generation and beam steering (33°) in a single device with a size of only 25 μm and with a low threshold of 8.9 kW cm-2. Furthermore,it is possible to achieve a significant degree of dynamic wavelength tunability, with a range extending up to 296 nm. This method achieves high-efficient regulation of light properties by dynamically controlling the system's topological charge, circumventing the problem of weak nonlinearity in traditional methods. Furthermore, the integration of phase change materials with nanolasers enables the direct alteration of lasing properties, which provides a novel idea for dynamic light control. The device process scheme based on phase change materials is straightforward, direct, and highly compatible, which will be advantageous for its intended application.

physics.optics

Cryptanalyze and design strong S-Box using 2D chaotic map and apply to irreversible key expansion

Cryptanalysis result of key expansion algorithms in AES and SM4 revealed that, (1) there exist weaknesses in their S-Boxes, and (2) the round key expansion algorithm is reversible, i.e., the initial key can be recovered from any round key, which may be an exploitable weakness by attacker. To solve these problems, first we constructed a non-degenerate 2D exponential hyper chaotic map (2D-ECM), derived the recursion formula to calculate the number of S-Boxes that satisfied three conditions, and designed a strong S-Box construction algorithm without weakness. Then based on 2D-ECM and S-Box, we designed an irreversible key expansion algorithm, to transform the initial key into independent round keys, to make the initial key can not be recovered from any round key. Security and statistical analysis demonstrated the flexible and effectiveness of the proposed irreversible key expansion algorithm.

cs.CR