SearcharxivSearch

arXiv subjects

Hao Wan

Publications and source records attributed to Hao Wan.

14 recordsLinked to original sources

Prompt Generation Technical Report

Generative retrieval has become an increasingly adopted paradigm for industrial search, recommendation, and advertising systems, delivering significant online gains. Most existing work combines user behavior sequences with large language models (LLMs) to model user preferences. In practice, feature engineering remains critical to model effectiveness, yet its complexity slows offline iteration and makes online deployment heavy and hard to reuse, all under tight online latency budgets. The root cause is a tight coupling between feature-processing logic and model architecture, where every feature change touches the training and serving code and resists reuse across scenarios. To break this coupling, we present Prompt Generation (PG), a high-level tokenizer and configuration-driven framework that decouples feature-processing logic from model architecture through two declarative JSON files, which serve as the single source of truth for both offline training and online serving, ensuring feature consistency across the two stages. Organizing features under four types with three composable processing components to assemble and compress heterogeneous features, PG delivers acceleration at three levels: (1)fast training iteration: feature experiments require only configuration changes, with built-in token compression for ultra-long sequences; (2)fast deployment: a new scenario only needs to conform to the PG schema and plug into a universal pipeline, with no scenario-specific engineering; (3)fast online inference: engine applies unified optimizations over the standardized configuration, reducing PG's overhead to a negligible level. PG has been deployed on Taobao Search with statistically significant online A/B uplifts of +0.47% in transaction count and +0.51% in GMV, and has been applied across multiple Taobao search and recommendation teams as the iteration framework for generative retrieval.

cs.IR

Dual-Process Atomic Skill Learning: Decoupling Semantic Reasoning and Real-Time Control

Language-conditioned Imitation Learning (IL) is essential for enabling robots to perform complex tasks following natural language instructions. However, generalizing to multi-step compositional tasks remains a significant challenge. While hierarchical approaches attempt to address this by decomposing tasks into atomic skills, existing methods often suffer from training instability and codebook collapse due to the tight coupling between high-level skill reasoning and low-level action generation in joint training paradigms. Inspired by the Dual-Process Theory of cognition, we propose Dual-Process Atomic Skill Learning (DASL), a novel asynchronous hierarchical imitation learning framework that decouples slow semantic reasoning from fast, real-time motion control. DASL comprises a Slow-Frequency Policy that predicts interpretable, discrete skills via Vector Quantization, and a High-Frequency Policy that leverages a latent diffusion model and a Decision Transformer to generate precise actions conditioned on these latent skills. By asynchronously coordinating these modules and utilizing diffusion to structure the latent space, our framework mitigates the skill codebook interference problem common in joint training paradigms. Evaluations across simulation benchmarks and experiment demonstrate that DASL significantly outperforms state-of-the-art baselines, excelling in skill acquisition and compositional generalization to unseen instructions. GitHub page: https://github.com/Hatakekaka/DASL

cs.RO

Action-Prior Denoising for Smooth Real-Time Chunking

Real-time chunking (RTC) lets chunked action policies operate under inference delay by conditioning a newly generated action chunk on actions already committed by the previous chunk. Training-time RTC simulates this delay during learning and avoids expensive guidance at deployment, but its binary prefix mask treats all non-prefix tokens as fully unconstrained. This under-models asynchronous execution: early overlap actions are fixed, while later overlap actions remain editable but should still stay close to the previous plan. We propose Soft RTC, a training-time RTC generalization based on action-prior denoising. Soft RTC constructs corrupted overlap tokens from partially denoised states instead of pure noise and injects the aligned previous chunk as the same prior during inference through a lightweight token-wise blending rule. On the 12 released large Kinetix levels, a short soft window nearly matches hard training-time RTC in overall solve rate (0.809 vs. 0.815), while a medium window reduces high-delay action delta and jerk by 9.1% and 9.6% relative to hard RTC. Both variants keep near-naive runtime, unlike inference-time RTC baselines. A small preliminary real-robot sorting study provides additional evidence that training-time RTC can improve completion and that Soft RTC gives the lowest commanded-action finite-difference metrics among the tested policies.

cs.RO

Building informative materials datasets beyond targeted objectives

Materials science data collection can be expensive, making the reuse and long-term utility of datasets critical important for future discovery campaigns. In practice, researchers prioritize a subset of properties due to research interests. However, ignoring a subset of outcomes in data collection campaigns potentially generate datasets poorly suited for future learning tasks. Here, we present a framework for dataset construction that maximizes informativeness for target properties of interest while preserving performance on untargeted ones. Our approach uses diversity-aware selection to ensure broad coverage of the materials space. In noisy experimental dataset construction, we find that without our diversity-aware framework, prediction performance on untargeted properties can degrade by up to 40% relative to random sampling, whereas applying our framework yields improvements of up to 10% . For targeted properties, performance can degrade with respect to random sampling by up to 12.5% without diversity, while our framework achieves gains of up to 25%. Incorporating diversity into dataset construction not only preserves informativeness for the targeted properties, but also improves materials coverage for potential future objectives. As a result, the constructed datasets remain broadly informative across considered and unconsidered outcomes, ensuring unbiased quality entries and mitigating cold-start limitations in subsequent modeling and discovery campaigns.

cond-mat.mtrl-sci

Two Teachers Better Than One: Hardware-Physics Co-Guided Distributed Scientific Machine Learning

Scientific machine learning (SciML) is increasingly applied to in-field processing, controlling, and monitoring; however, wide-area sensing, real-time demands, and strict energy and reliability constraints make centralized SciML implementation impractical. Most SciML models assume raw data aggregation at a central node, incurring prohibitively high communication latency and energy costs; yet, distributing models developed for general-purpose ML often breaks essential physical principles, resulting in degraded performance. To address these challenges, we introduce EPIC, a hardware- and physics-co-guided distributed SciML framework, using full-waveform inversion (FWI) as a representative task. EPIC performs lightweight local encoding on end devices and physics-aware decoding at a central node. By transmitting compact latent features rather than high-volume raw data and by using cross-attention to capture inter-receiver wavefield coupling, EPIC significantly reduces communication cost while preserving physical fidelity. Evaluated on a distributed testbed with five end devices and one central node, and across 10 datasets from OpenFWI, EPIC reduces latency by 8.9$\times$ and communication energy by 33.8$\times$, while even improving reconstruction fidelity on 8 out of 10 datasets.

cs.LG

Sculpting 2D Crystals via Membrane Contractions before and during Solidification

When phospholipids crystallize within the otherwise fluid membranes of giant unilamellar vesicles, the resulting molecularly-thin "2D" solids exhibit great variety in their morphology evolution. For instance within membranes containing moderate amounts of the crystallizing component, crystals grow with a fixed morphology depending on vesicle size. Conversely for membranes containing large amounts of the crystallizing species, we find small compact crystals on vesicles of all sizes. However on large vesicles, growing crystals sprout flower petals that lengthen progressively. These behaviors result from two combined mechanisms: First, like other 2D solids, the shear rigidity of phospholipid crystals renders them intolerant to morphologies with non-zero Gaussian curvature. As a result and especially at elevated membrane tension, the cost of bending elasticity is reduced, at the expense of line energy, by the formation of flowers as opposed to compact crystals. Second, the composition-dependent tension rise during cooling relaxes via water permeation of the membrane with a time constant scaling as $R^2$. The amount of crystal formed for a small decrease in temperature determines this composition-dependent increase in stress from thermal contractions versus solidification. Surface Evolver computations motivated using the predicted tension evolution to develop a processing space that maps to experimental observations for initial and growing crystal morphology. Important variable groups are identified, including a scaled ratio of bending to line energy, a vesicle size-independent group for membrane contractions, and a time constant for stress relaxation. Though processing stresses ultimately relax, the crystal morphology persists well beyond the processing window.

cond-mat.soft

When Active Learning Fails, Uncalibrated Out of Distribution Uncertainty Quantification Might Be the Problem

Efficiently and meaningfully estimating prediction uncertainty is important for exploration in active learning campaigns in materials discovery, where samples with high uncertainty are interpreted as containing information missing from the model. In this work, the effect of different uncertainty estimation and calibration methods are evaluated for active learning when using ensembles of ALIGNN, eXtreme Gradient Boost, Random Forest, and Neural Network model architectures. We compare uncertainty estimates from ALIGNN deep ensembles to loss landscape uncertainty estimates obtained for solubility, bandgap, and formation energy prediction tasks. We then evaluate how the quality of the uncertainty estimate impacts an active learning campaign that seeks model generalization to out-of-distribution data. Uncertainty calibration methods were found to variably generalize from in-domain data to out-of-domain data. Furthermore, calibrated uncertainties were generally unsuccessful in reducing the amount of data required by a model to improve during an active learning campaign on out-of-distribution data when compared to random sampling and uncalibrated uncertainties. The impact of poor-quality uncertainty persists for random forest and eXtreme Gradient Boosting models trained on the same data for the same tasks, indicating that this is at least partially intrinsic to the data and not due to model capacity alone. Analysis of the target, in-distribution uncertainty, out-of-distribution uncertainty, and training residual distributions suggest that future work focus on understanding empirical uncertainties in the feature input space for cases where ensemble prediction variances do not accurately capture the missing information required for the model to generalize.

cond-mat.mtrl-sci

TMetaNet: Topological Meta-Learning Framework for Dynamic Link Prediction

Dynamic graphs evolve continuously, presenting challenges for traditional graph learning due to their changing structures and temporal dependencies. Recent advancements have shown potential in addressing these challenges by developing suitable meta-learning-based dynamic graph neural network models. However, most meta-learning approaches for dynamic graphs rely on fixed weight update parameters, neglecting the essential intrinsic complex high-order topological information of dynamically evolving graphs. We have designed Dowker Zigzag Persistence (DZP), an efficient and stable dynamic graph persistent homology representation method based on Dowker complex and zigzag persistence, to capture the high-order features of dynamic graphs. Armed with the DZP ideas, we propose TMetaNet, a new meta-learning parameter update model based on dynamic topological features. By utilizing the distances between high-order topological features, TMetaNet enables more effective adaptation across snapshots. Experiments on real-world datasets demonstrate TMetaNet's state-of-the-art performance and resilience to graph noise, illustrating its high potential for meta-learning and dynamic graph analysis. Our code is available at https://github.com/Lihaogx/TMetaNet.

cs.LG

Self-adjoint operators in Z-stable C$^*$-algebras with prescribed spectral data

We consider the variety of spectral measures that are induced by quasitraces on the spectrum of a self-adjoint operator in a simple separable unital and Z-stable C$^*$-algebra. This amounts to a continuous map from the simplex of quasitraces of the C$^*$-algebra into regular Borel probability measures on the spectrum of the operator under consideration. In the case of a connected spectrum this data determines the unitary equivalence class of the operator, and may be reduced to to the case of an operator with spectrum equal to the closed unit interval. We prove that any continuous map from the simplex of quasitraces with the topology of pointwise convergence into regular faithful Borel probability measures on $[0,1]$ with the Levy-Prokhorov metric is realized by some self-adjoint operator in the C$^*$-algebra.

math.OA

The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims

In order to solve the problem of insufficient generation quality caused by traditional patent text abstract generation models only originating from patent specifications, the problem of new terminology OOV caused by rapid patent updates, and the problem of information redundancy caused by insufficient consideration of the high professionalism, accuracy, and uniqueness of patent texts, we proposes a patent text abstract generation model (MSEA) based on a master-slave encoder architecture; Firstly, the MSEA model designs a master-slave encoder, which combines the instructions in the patent text with the claims as input, and fully explores the characteristics and details between the two through the master-slave encoder; Then, the model enhances the consideration of new technical terms in the input sequence based on the pointer network, and further enhances the correlation with the input text by re weighing the "remembered" and "for-gotten" parts of the input sequence from the encoder; Finally, an enhanced repetition suppression mechanism for patent text was introduced to ensure accurate and non redundant abstracts generated. On a publicly available patent text dataset, compared to the state-of-the-art model, Improved Multi-Head Attention Mechanism (IMHAM), the MSEA model achieves an improvement of 0.006, 0.005, and 0.005 in Rouge-1, Rouge-2, and Rouge-L scores, respectively. MSEA leverages the characteristics of patent texts to effectively enhance the quality of patent text generation, demonstrating its advancement and effectiveness in the experiments.

cs.CL

Thermal Preconditioning of Membrane Stress to Control the Shapes of Ultrathin Crystals

We employ the phospholipid bilayer membranes of giant unilamellar vesicles as a free-standing environment for the growth of membrane-integrated ultrathin phospholipid crystals possessing a variety of shapes with 6-fold symmetry. Crystal growth within vesicle membranes, where more elaborate shapes grow on larger vesicles is dominated by the bending energy of the membrane itself, creating a means to manipulate crystal morphology. Here we demonstrate how cooling rate preconditions the membrane tension before nucleation, in turn regulating nucleation and growth, and directing the morphology of crystals by the time they are large enough to be visualized. The crystals retain their shapes during further growth through the two phase region. Experiments demonstrate this behavior for single crystals growing within the membrane of each vesicle, ultimately comprising up to 13% of the vesicle area and length scales of up to 50 microns. A model for stress evolution, employing only physical property data, reveals how the competition between thermal membrane contraction and water diffusion from tensed vesicles produces a size- and time-dependence of the membrane tension as a result of cooling history. The tension, critical in the contribution of bending energy in the fluid membrane regions, in turn selects for crystal shape for vesicles of a given size. The model reveals unanticipated behaviors including a low steady state tension on small vesicles that allows compact domains to develop, rapid tension development on large vesicles producing flower-shaped domains, and a stress relaxation through water diffusion across the membrane with a time constant scaling as the square of the vesicle radius, consistent with measurable tensions only in the largest vesicles.

cond-mat.soft

Shape equilibria of vesicles with rigid planar inclusions

Motivated by recent studies of two-phase lipid vesicles possessing 2D solid domains integrated within a fluid bilayer phase, we study the shape equilibria of closed vesicles possessing a single planar, circular inclusion. While 2D solid elasticity tends to expel Gaussian curvature, topology requires closed vesicles to maintain an average, non-zero Gaussian curvature leading to an elementary mechanism of shape frustration that increases with inclusion size. We study elastic ground states of the Helfrich model of the planar-fluid composite vesicles, analytically and computationally, as a function of planar fraction and reduced volume. Notably, we show that incorporation of a planar inclusion of only a few percent dramatically shifts the ground state shapes of vesicles from predominantly {\it prolate} to {\it oblate}, and moreover, shifts the optimal surface to volume ratio far from spherical shapes. We show that for sufficiently small planar inclusions, the elastic ground states break symmetry via a complex variety of asymmetric oblate, prolate, and triaxial shapes, while inclusion sizes above about $8\%$ drive composite vesicles to adopt axisymmetric oblate shapes. These predictions cast useful light on the emergent shape and mechanical responses of fluid-solid composite vesicles.

cond-mat.soft

Flowering of Developable 2D Crystal Shapes in Closed, Fluid Membranes

The morphologies of two-dimensional (2D) crystals, nucleated, grown, and integrated within 2D elastic fluids, for instance in giant vesicle membranes, are dictated by an interplay of mechanics, permeability, and thermal contraction. Mitigation of solid strain drives formation of crystals with developable shapes (e.g. planar or cylindrical) that expel Gaussian curvature into the 2D fluid. However, upon cooling to grow the crystals, large vesicles sustain greater inflation and tension because their small area to volume ratio slows water permeation. As a result, more elaborate shapes, for instance flowers with bendable but inextensible petals form on large vesicles despite their more gradual curvature, while small vesicles harbor compact planar crystals. This size dependence runs counter to the known cumulative growth of strain energy of 2D colloidal crystals on rigid spherical templates. This interplay of intra-membrane mechanics and processing points to the scalable production of flexible molecular crystals of controllable complex shape.

cond-mat.soft

Reward Shaping for User Satisfaction in a REINFORCE Recommender

How might we design Reinforcement Learning (RL)-based recommenders that encourage aligning user trajectories with the underlying user satisfaction? Three research questions are key: (1) measuring user satisfaction, (2) combatting sparsity of satisfaction signals, and (3) adapting the training of the recommender agent to maximize satisfaction. For measurement, it has been found that surveys explicitly asking users to rate their experience with consumed items can provide valuable orthogonal information to the engagement/interaction data, acting as a proxy to the underlying user satisfaction. For sparsity, i.e, only being able to observe how satisfied users are with a tiny fraction of user-item interactions, imputation models can be useful in predicting satisfaction level for all items users have consumed. For learning satisfying recommender policies, we postulate that reward shaping in RL recommender agents is powerful for driving satisfying user experiences. Putting everything together, we propose to jointly learn a policy network and a satisfaction imputation network: The role of the imputation network is to learn which actions are satisfying to the user; while the policy network, built on top of REINFORCE, decides which items to recommend, with the reward utilizing the imputed satisfaction. We use both offline analysis and live experiments in an industrial large-scale recommendation platform to demonstrate the promise of our approach for satisfying user experiences.

cs.IR