arXiv subjects

Jinan Pang

Publications and source records attributed to Jinan Pang.

4 recordsLinked to original sources

arXiv2026

HOBA: Hierarchical On-Policy Bidding Agents for Adaptive Online Advertising

Online advertising bidding systems typically deploy multiple offline-trained expert models (e.g., PID controllers, model predictive control, offline RL policies) but face two critical limitations: lack of online adaptability to non-stationary auction markets, and reliance on costly manual tuning of hyperparameters such as bid bounds and budget pacing constraints. We propose HOBA (Hierarchical On-policy Bidding Agents), a hierarchical reinforcement learning framework that decouples strategic reasoning, model selection, and bid execution across three time scales. At the high level, a large language model infers hyperparameters from contextual signals through a Think-Act-Observe-Reflect loop with historical experience retrieval. At the mid level, a SARSA agent dynamically selects among expert models, incorporating causal adjustment to eliminate selection bias. At the low level, a dynamic expert pool (PID, MPC, IQL, Decision Transformer) executes bids under high-level constraints. This design confines online learning to discrete expert selection rather than continuous bid optimization, significantly reducing exploration risk while maintaining adaptability. Experiments on the AuctionNet benchmark and a large-scale A/B test demonstrate consistent improvements over state-of-the-art baselines. In a large-scale online deployment, HOBA delivered substantial business value, achieving a +3.6\% increase in target cost, proving the effectiveness of our hierarchical multi-agent bidding paradigm.

cs.AI↗

arXiv2026

R&F-Inventory: A Large-Scale Dataset for Monotonic Inventory Estimation in Reach and Frequency Advertising

Reach and Frequency (R&F) contract advertising is an important form of widely used brand advertising. Unlike performance advertising, R&F contracts emphasize controllable delivery of UV and PV under given targeting, scheduling, and frequency control constraints. In practical systems, advertisers typically need to view the UV, PV change curves at different budget levels in real time when creating an R&F contract. However, most existing publicly available advertising datasets are based on independent samples, lacking a characterization of the core structure of the "budget-performance curve" (including UV and PV) in R&F contracts.This paper proposes and releases a large-scale R&F contract inventory estimation dataset. This dataset uses the R&F contract context consisting of "targeting-scheduling-frequency control" as the basic context, providing observations of UV and PV corresponding to multiple budget points within the same context, thus forming a complete budget-performance curve. The dataset explicitly includes a time-window-based frequency control mechanism (e.g.,"no more than 3 times within 5 days") and naturally satisfies the monotonicity and diminishing marginal returns characteristics in the budget and scheduling dimensions. We further derive the theoretical maximum exposure ceiling and use it as a consistency check to evaluate data quality and the feasibility of model predictions. Using this data set, this paper defines two standardized benchmark tasks: single-point performance prediction and reconstruction of budget-performance curves, and provides a set of reproducible baseline methods and evaluation protocols. This dataset can support systematic research on problems such as structural constraint learning, monotonic regression, curve consistency modeling, and R&F contract planning.The code for our experiments can be found at https://github.com/pengyunshan/RF-Inventory.

cs.LG↗

arXiv2025

Expert-Guided Diffusion Planner for Auto-Bidding

Auto-bidding is widely used in advertising systems, serving a diverse range of advertisers. Generative bidding is increasingly gaining traction due to its strong planning capabilities and generalizability. Unlike traditional reinforcement learning-based bidding, generative bidding does not depend on the Markov Decision Process (MDP), thereby exhibiting superior planning performance in long-horizon scenarios. Conditional diffusion modeling approaches have shown significant promise in the field of auto-bidding. However, relying solely on return as the optimality criterion is insufficient to guarantee the generation of truly optimal decision sequences, as it lacks personalized structural information. Moreover, the auto-regressive generation mechanism of diffusion models inherently introduces timeliness risks. To address these challenges, we introduce a novel conditional diffusion modeling approach that integrates expert trajectory guidance with a skip-step sampling strategy to improve generation efficiency. The efficacy of this method has been demonstrated through comprehensive offline experiments and further substantiated by statistically significant outcomes in online A/B testing, yielding an 11.29% increase in conversions and a 12.36% growth in revenue relative to the baseline.

cs.LG↗

arXiv2024

A discussion on the critical electric Rayleigh number for AC electrokinetic flow of binary fluids in a divergent microchannel

Electrokinetic (EK) flow is a type of flow driven or manipulated by electric body forces, influenced by various factors such as electric field intensity, electric field form, frequency, electric permittivity/conductivity, fluid viscosity and etc. The diversity of dimensionless control parameters, such as the electric Rayleigh number, complicates the comparison of EK flow stability. Consequently, comparing the performance and cost of micromixers or reactors based on EK flow is challenging, posing an obstacle to their industrial and engineering applications. In this investigation, we theoretically derived a new electric Rayleigh number ($Ra_e$) that quantifies the relationship among electric body forces, fluid viscosity, and ion diffusivity, based on a tanh model of electric conductivity distribution. The calculation results indicate that the new $Ra_e$ exhibits richer variation with the control parameters and better consistency with previous experimental reports. We further conducted experimental studies on the critical electric Rayleigh number ($Ra_{ec}$) of AC EK flow of binary fluids in a divergent microchannel. The experimental variations align well with the theoretical predictions, particularly the existence of an optimal AC frequency and electric conductivity ratio, demonstrating that the tanh model can better elucidate the underlying physics of EK flow. With the new electric Rayleigh number, we found that EK flow in the designed divergent microchannel has a much smaller $Ra_{ec}$ than previously reported, indicating that EK flow is more unstable and thus more suitable for applications in micromixers or reactors in industry and engineering.

physics.flu-dyn↗