Searcharxiv⌕ Search

arXiv subjects

Wenhao Yuan

Publications and source records attributed to Wenhao Yuan.

22 records · Page 2Linked to original sources

Adaptive Federated Learning via New Entropy Approach

Federated Learning (FL) has emerged as a prominent distributed machine learning framework that enables geographically discrete clients to train a global model collaboratively while preserving their privacy-sensitive data. However, due to the non-independent-and-identically-distributed (Non-IID) data generated by heterogeneous clients, the performances of the conventional federated optimization schemes such as FedAvg and its variants deteriorate, requiring the design to adaptively adjust specific model parameters to alleviate the negative influence of heterogeneity. In this paper, by leveraging entropy as a new metric for assessing the degree of system disorder, we propose an adaptive FEDerated learning algorithm based on ENTropy theory (FedEnt) to alleviate the parameter deviation among heterogeneous clients and achieve fast convergence. Nevertheless, given the data disparity and parameter deviation of heterogeneous clients, determining the optimal dynamic learning rate for each client becomes a challenging task as there is no communication among participating clients during the local training epochs. To enable a decentralized learning rate for each participating client, we first introduce the mean-field terms to estimate the components associated with other clients' local parameters. Furthermore, we provide rigorous theoretical analysis on the existence and determination of the mean-field estimators. Based on the mean-field estimators, the closed-form adaptive learning rate for each client is derived by constructing the Hamilton equation. Moreover, the convergence rate of our proposed FedEnt is proved. The extensive experimental results on the real-world datasets (i.e., MNIST, EMNIST-L, CIFAR10, and CIFAR100) show that our FedEnt algorithm surpasses FedAvg and its variants (i.e., FedAdam, FedProx, and FedDyn) under Non-IID settings and achieves a faster convergence rate.

cs.DC↗

QI-DPFL: Quality-Aware and Incentive-Boosted Federated Learning with Differential Privacy

Federated Learning (FL) has increasingly been recognized as an innovative and secure distributed model training paradigm, aiming to coordinate multiple edge clients to collaboratively train a shared model without uploading their private datasets. The challenge of encouraging mobile edge devices to participate zealously in FL model training procedures, while mitigating the privacy leakage risks during wireless transmission, remains comparatively unexplored so far. In this paper, we propose a novel approach, named QI-DPFL (Quality-Aware and Incentive-Boosted Federated Learning with Differential Privacy), to address the aforementioned intractable issue. To select clients with high-quality datasets, we first propose a quality-aware client selection mechanism based on the Earth Mover's Distance (EMD) metric. Furthermore, to attract high-quality data contributors, we design an incentive-boosted mechanism that constructs the interactions between the central server and the selected clients as a two-stage Stackelberg game, where the central server designs the time-dependent reward to minimize its cost by considering the trade-off between accuracy loss and total reward allocated, and each selected client decides the privacy budget to maximize its utility. The Nash Equilibrium of the Stackelberg game is derived to find the optimal solution in each global iteration. The extensive experimental results on different real-world datasets demonstrate the effectiveness of our proposed FL framework, by realizing the goal of privacy protection and incentive compatibility.

cs.GT↗

Characterization of an $\rm ^{27}Al^+$ ion optical clock laser with three independent methods

We report on the development and performance evaluation of an ultra-stable clock laser for an $\rm ^{27}Al^+$ optical clock. The thermal noise limited ultra-stable laser is developed based on a 30 cm long ultra-stable cavity. Three independent evaluation methods, including the frequency noise summation method, the three-cornered hat (TCH) method, and the optical clock transition detection method, are used to evaluate the clock laser performance. The summation result of various frequency noise terms is compared with the result of the TCH method. In addition, the $\rm ^{27}Al^+$ ion optical clock transition with ultra-narrow linewidth is also used to detect the frequency noise of the laser at lower Fourier frequencies. The results of the three methods show good agreements, showing a frequency instability level of $1.3\times10^{-16}$, and giving us confidence that these evaluation methods may provides guidance for accurate evaluations of high stability laser sources.

physics.atom-ph↗

Ultraviolet laser spectroscopy of aluminum atoms in hollow-cathode lamp

We report precision measurement of aluminum atoms ${^{2}P_{1/2}}-{^{2}S_{1/2}}$ transition at 394 nm and ${^{2}P_{3/2}}-{^{2}S_{1/2}}$ transition at 396 nm in a hollow-cathode lamp (HCL). Both absorption spectroscopy and saturated absorption spectroscopy (SAS) are performed. From the absorption spectroscopy the Doppler linewidth is estimated to be 2.6 GHz. The SAS spectroscopy is analyzed based on the velocity-changing-effect model. With a frequency comb calibrated wavemeter, the frequencies of ${^{2}P_{1/2}},{F=3}-{^{2}S_{1/2}},{F=2}$ transition and ${^{2}P_{3/2}},{F=4}-{^{2}S_{1/2}},{F=3}$ transition are measured to be 759.905401(10) THz and 756.547403(10) THz, respectively. The hyperfine structure constants of aluminum atoms are determined and compared with previously reported measurement results and theoretical calculation. Reasonable agreement is found for the magnetic dipole constant (A constant), while the electric quadrupole constant (B constant) has a large deviation.

physics.atom-ph↗