Searcharxiv⌕ Search

arXiv subjects

Yitian Pang

Publications and source records attributed to Yitian Pang.

2 recordsLinked to original sources

BrowseFlow: Sparse Event Flow Matching for Generative User Simulation

User simulation aims to reproduce how users interact with content and products across online platforms. Recent generative approaches have enriched user simulation with behavioral history and contextual information. However, realistic browsing simulation still faces two challenges. (i) Stochastic Responses: Even with the same recommendation feed, the same user may produce different browsing responses, yielding distinct behavioral trajectories. A logged trajectory records only one such realization. (ii) Sparse Key Events: Clicks and likes provide important feedback but occur sparsely within browsing trajectories dominated by progression actions such as scrolling. Many stepwise simulators predict these actions in a dense sequence, where key events contribute relatively few training targets. To address these challenges, we propose BrowseFlow, a conditional discrete flow matching method for generative user simulation. For Sparse Key Events, BrowseFlow represents each response by its browsing extent and an ordered sequence of key events, directly modeling their counts and locations under exposure constraints. BrowseFlow learns the conditional distribution of complete browsing responses through probabilistic extent prediction and discrete flow matching over key events. Random event retention defines probability paths over partial event sequences, while transition rate matching learns stochastic insertion dynamics. For Stochastic Responses, we use the energy score, a proper scoring rule, to evaluate response fidelity and generated variability, complemented by the Wasserstein distance between key event count distributions. We further introduce TaobaoBrowse, a benchmark pairing real recommendation contexts with fine-grained browsing trajectories. Experiments across three datasets demonstrate that BrowseFlow consistently achieves the best distributional performance.

cs.IR↗

TTP: Test-Time Padding for Adversarial Detection and Robust Adaptation on Vision-Language Models

Vision-Language Models (VLMs), such as CLIP, have achieved impressive zero-shot recognition performance but remain highly susceptible to adversarial perturbations, posing significant risks in safety-critical scenarios. Previous training-time defenses rely on adversarial fine-tuning, which requires labeled data and costly retraining, while existing test-time strategies fail to reliably distinguish between clean and adversarial inputs, thereby preventing both adversarial robustness and clean accuracy from reaching their optimum. To address these limitations, we propose Test-Time Padding (TTP), a lightweight defense framework that performs adversarial detection followed by targeted adaptation at inference. TTP identifies adversarial inputs via the cosine similarity shift between CLIP feature embeddings computed before and after spatial padding, yielding a universal threshold for reliable detection across architectures and datasets. For detected adversarial cases, TTP employs trainable padding to restore disrupted attention patterns, coupled with a similarity-aware ensemble strategy for a more robust final prediction. For clean inputs, TTP leaves them unchanged by default or optionally integrates existing test-time adaptation techniques for further accuracy gains. Comprehensive experiments on diverse CLIP backbones and fine-grained benchmarks show that TTP consistently surpasses state-of-the-art test-time defenses, delivering substantial improvements in adversarial robustness without compromising clean accuracy. The code for this paper will be released soon.

cs.CV↗