SearcharxivSearch

arXiv subjects

Wenjing Wei

Publications and source records attributed to Wenjing Wei.

3 recordsLinked to original sources

An Adaptive Gradient Clipping and Noise Injection Mechanism for Differentially Private Federated Learning

Differentially private federated learning must balance privacy protection against model accuracy and training efficiency. Static gradient clipping applies a fixed threshold throughout training and across model layers, which can cause excessive clipping when the threshold is too small or unnecessarily large noise when it is too large. This paper presents DDP-SA-adaptive, an adaptive gradient clipping and noise adding mechanism for differentially private federated learning with secure aggregation. At each communication round, every client determines a separate clipping threshold for each model layer from the median of its per-sample gradient norms. The resulting layer-wise thresholds adapt to the evolving gradient distributions and calibrate the Laplace noise added before the updates are encoded and secret-shared among intermediate aggregation servers. We evaluate the proposed mechanism on a federated regression task in terms of efficiency, accuracy, privacy, convergence, clipping norm, and noise magnitude. Compared with the static DDP-SA baseline, DDP-SA-adaptive reduces the number of communication rounds by 6.81%, total training time by 19.21%, and average per-round training time by 13.33%, leading to improved training efficiency. It also reduces test loss by 98.74% and increases test R2 by 3.41%, leading to improved model accuracy. To attain R2 = 0.99, the adaptive mechanism operates with a privacy budget of approximately epsilon = 0.1, compared with epsilon = 0.4 for static DDP-SA, thus providing stronger privacy protection and achieving stronger privacy guarantees. These results demonstrate that round-wise, layer-wise adaptation can improve the privacy-accuracy-efficiency trade-off of differentially private federated learning.

cs.CR

Semantic-Aided Iterative Decoding for Uplink Non-Orthogonal Transmission

This paper proposes semantic-aided iterative decoding (Sem-IR) for uplink non-orthogonal transmission of a shared natural-language source. K users each hold one segment of a common sentence and superimpose low-density parity-check (LDPC) coded transmissions over an additive white Gaussian noise (AWGN) channel. At the base station, an iterative elementary signal estimator (ESE) and K parallel LDPC decoders progressively cancel inter-user interference. As high-power users pass both parity and language-plausibility checks earlier, their decoded bytes form a reliable linguistic prefix for the remaining users; a fine-tuned ByT5 byte-level language model exploits this prefix to predict byte posteriors for the unconverged user. The byte posteriors are marginalized to bit-level log-likelihood ratios and convex-combined with the LDPC posteriors inside the iterative loop. The resulting feedback closes the loop between the language model and the physical-layer iteration. Simulations show that Sem-IR outperforms orthogonal time-division access (TDMA) and the same NOMA receiver without semantic feedback in block error rate (BLER), yielding an order-of-magnitude reduction over NOMA at 8 dB.

cs.IT

Scalable and Private Federated Learning Using Distributed Differential Privacy and Secure Aggregation

This article presents DDP-SA, a scalable privacy-preserving federated learning framework that jointly leverages client-side local differential privacy (LDP) and full-threshold additive secret sharing (ASS) for secure aggregation. Unlike existing methods that rely solely on differential privacy or on secure multi-party computation (MPC), DDP-SA integrates both techniques to deliver stronger end-to-end privacy guarantees while remaining computationally practical. The framework introduces a two-stage protection mechanism: clients first perturb their local gradients with calibrated Laplace noise, then decompose the noisy gradients into additive secret shares that are distributed across multiple intermediate servers. This design ensures that (i) no single compromised server or communication channel can reveal any information about individual client updates, and (ii) the parameter server reconstructs only the aggregated noisy gradient, never any client-specific contribution. Extensive experiments show that DDP-SA achieves substantially higher model accuracy than standalone LDP while providing stronger privacy protection than MPC-only approaches. The proposed framework scales linearly with the number of participants and offers a practical, privacy-preserving solution for federated learning applications with controllable computational and communication overhead.

cs.CR