Shanshan Zheng | Searcharxiv

arXiv2024

Optimal Diffusion Auctions

Diffusion auction design is a new trend in mechanism design for which the main goal is to incentivize existing buyers to invite new buyers, who are their neighbors on a social network, to join an auction even though they are competitors. With more buyers, a diffusion auction will be able to give a more efficient allocation and receive higher revenue. Existing studies have proposed many interesting diffusion auctions to attract more buyers, but the seller's revenue is not optimized. Hence, in this study, we investigate what optimal revenue the seller can achieve by attracting more buyers. Different from the traditional setting, the revenue that can be achieved in a diffusion auction highly relies on the structure of the network. Hence, we focus on optimal auctions with given classes of underlying networks. We propose a class of mechanisms, where for any given structure, an optimal diffusion mechanism can be found. We point out that it implies an idea of "reserve structure". Moreover, we show that an optimal mechanism that handles all structures does not exist. Therefore, we also propose mechanisms that have bounded approximations of the optimal revenue in all structures.

cs.GT↗

arXiv2023

CLIP-guided Federated Learning on Heterogeneous and Long-Tailed Data

Federated learning (FL) provides a decentralized machine learning paradigm where a server collaborates with a group of clients to learn a global model without accessing the clients' data. User heterogeneity is a significant challenge for FL, which together with the class-distribution imbalance further enhances the difficulty of FL. Great progress has been made in large vision-language models, such as Contrastive Language-Image Pre-training (CLIP), which paves a new way for image classification and object recognition. Inspired by the success of CLIP on few-shot and zero-shot learning, we use CLIP to optimize the federated learning between server and client models under its vision-language supervision. It is promising to mitigate the user heterogeneity and class-distribution balance due to the powerful cross-modality representation and rich open-vocabulary prior knowledge. In this paper, we propose the CLIP-guided FL (CLIP2FL) method on heterogeneous and long-tailed data. In CLIP2FL, the knowledge of the off-the-shelf CLIP model is transferred to the client-server models, and a bridge is built between the client and server. Specifically, for client-side learning, knowledge distillation is conducted between client models and CLIP to improve the ability of client-side feature representation. For server-side learning, in order to mitigate the heterogeneity and class-distribution imbalance, we generate federated features to retrain the server model. A prototype contrastive learning with the supervision of the text encoder of CLIP is introduced to generate federated features depending on the client-side gradients, and they are used to retrain a balanced server classifier.

cs.CV↗