SearcharxivSearch

arXiv subjects

Boyu Fan

Publications and source records attributed to Boyu Fan.

9 recordsLinked to original sources

PCS-UQ: Uncertainty Quantification via the Predictability-Computability-Stability Framework

As machine learning (ML) enters high-stakes domains, trustworthy uncertainty quantification (UQ) is essential for safety. In this paper we introduce PCS-UQ, a framework based on the Predictability, Computability, and Stability (PCS) principles for veridical data science. Starting with a candidate set of models or algorithms, PCS-UQ integrates a rigorous prediction-check to screen out unsuitable models in the set and utilizes bootstrap samples in order to capture both inter-sample variability and algorithmic instability for the prediction-checked algorithms. We then introduce a novel multiplicative calibration scheme to enhance local adaptivity, which can be viewed as a new score in conformal prediction. Moreover, we produce a compilation of 17 real-world regression datasets with manually constructed subgroups. On this benchmark, PCS-UQ maintains the target coverage while outperforming or matching conformal methods equipped with oracle-selected algorithms in interval width. PCS-UQ achieves consistent subgroup coverage, outperforming these oracle-selected conformal methods. Notably, PCS-UQ stands out in achieving both competitive interval widths and consistent subgroup coverage. Across 6 classification datasets, PCS-UQ reduces prediction set sizes by 20\%. To scale the framework for deep learning, we propose computationally efficient variants that bypass expensive retraining. On three computer vision benchmarks, these variants reduce prediction set sizes by 20\% over conformal baselines. Finally, we provide a theoretical proof that a modified PCS-UQ algorithm preserves valid coverage under exchangeability as a form of split conformal inference.

stat.ML

Command A: An Enterprise-Ready Large Language Model

In this report we describe the development of Command A, a powerful large language model purpose-built to excel at real-world enterprise use cases. Command A is an agent-optimised and multilingual-capable model, with support for 23 languages of global business, and a novel hybrid architecture balancing efficiency with top of the range performance. It offers best-in-class Retrieval Augmented Generation (RAG) capabilities with grounding and tool use to automate sophisticated business processes. These abilities are achieved through a decentralised training approach, including self-refinement algorithms and model merging techniques. We also include results for Command R7B which shares capability and architectural similarities to Command A. Weights for both models have been released for research purposes. This technical report details our original training pipeline and presents an extensive evaluation of our models across a suite of enterprise-relevant tasks and public benchmarks, demonstrating excellent performance and efficiency.

cs.CL

LESnets (Large-Eddy Simulation nets): Physics-informed neural operator for large-eddy simulation of turbulence

Acquisition of large datasets for three-dimensional (3D) partial differential equations (PDE) is usually very expensive. Physics-informed neural operator (PINO) eliminates the high costs associated with generation of training datasets, and shows great potential in a variety of partial differential equations. In this work, we employ physics-informed neural operator, encoding the large-eddy simulation (LES) equations directly into the neural operator for simulating three-dimensional incompressible turbulent flows. We develop the LESnets (Large-Eddy Simulation nets) by adding large-eddy simulation equations to two different data-driven models, including Fourier neural operator (FNO) and implicit Fourier neural operator (IFNO) without using label data. Notably, by leveraging only PDE constraints to learn the spatio-temporal dynamics, LESnets models retain the computational efficiency of data-driven approaches while obviating the necessity for data. Meanwhile, using LES equations as PDE constraints makes it possible to efficiently predict complex turbulence at coarse grids. We investigate the performance of the LESnets models with two standard three-dimensional turbulent flows: decaying homogeneous isotropic turbulence and temporally evolving turbulent mixing layer. In the numerical experiments, the LESnets models show similar accuracy as compared to traditional large-eddy simulation and data-driven models including FNO and IFNO, and exhibits a robust generalization ability to unseen regime of flow fields. By integrating a single set of flow data, the LESnets models can automatically learn the coefficient of the subgrid scale (SGS) model during the training of the neural operator. Moreover, the well-trained LESnets models are significantly faster than traditional LES, and exhibits comparable computational efficiency to the data-driven FNO and IFNO models.

physics.flu-dyn

Integrated spectrally multiplexed light-matter interface at telecom band

Light-matter interface is an important building block for long-distance quantum networks. Towards a scalable quantum network with high-rate quantum information processing, it requires to develop integrated light-matter interfaces with broadband and multiplexing capacities. Here we demonstrate a light-matter interface at telecom band in an integrated system. A five-spectral-channel atomic-frequency-comb photonic memory is prepared on a laser-written Er3+:LiNbO3 chip. The bandwidth of each channel is 4 GHz with a channel spacing of 15 GHz. The signal photons from time-bin entangled photon pairs at telecom band are sent into the on-chip memory and recalled after a storage time of 152 ns. The entanglement-preserving nature of our integrated quantum interface is assessed by an input/output fidelity of >92% for all the five spectral channels. Our light-matter interfaces constitute a notable step forward toward a high-rate quantum network involving integrated device.

quant-ph

FedTSA: A Cluster-based Two-Stage Aggregation Method for Model-heterogeneous Federated Learning

Despite extensive research into data heterogeneity in federated learning (FL), system heterogeneity remains a significant yet often overlooked challenge. Traditional FL approaches typically assume homogeneous hardware resources across FL clients, implying that clients can train a global model within a comparable time frame. However, in practical FL systems, clients often have heterogeneous resources, which impacts their training capacity. This discrepancy underscores the importance of exploring model-heterogeneous FL, a paradigm allowing clients to train different models based on their resource capabilities. To address this challenge, we introduce FedTSA, a cluster-based two-stage aggregation method tailored for system heterogeneity in FL. FedTSA begins by clustering clients based on their capabilities, then performs a two-stage aggregation: conventional weight averaging for homogeneous models in Stage 1, and deep mutual learning with a diffusion model for aggregating heterogeneous models in Stage 2. Extensive experiments demonstrate that FedTSA not only outperforms the baselines but also explores various factors influencing model performance, validating FedTSA as a promising approach for model-heterogeneous FL.

cs.LG

A Survey on Model-heterogeneous Federated Learning: Problems, Methods, and Prospects

As privacy concerns continue to grow, federated learning (FL) has gained significant attention as a promising privacy-preserving technology, leading to considerable advancements in recent years. Unlike traditional machine learning, which requires central data collection, FL keeps data localized on user devices. However, conventional FL assumes that all clients operate with identical model structures initialized by the server. In real-world applications, system heterogeneity is common, with clients possessing varying computational capabilities. This disparity can hinder training for resource-limited clients and result in inefficient resource use for those with greater processing power. To address this challenge, model-heterogeneous FL has been introduced, enabling clients to train models of varying complexity based on their hardware resources. This paper reviews state-of-the-art approaches in model-heterogeneous FL, analyzing their strengths and weaknesses, while identifying open challenges and future research directions. To the best of our knowledge, this is the first survey to specifically focus on model-heterogeneous FL.

cs.DC

EmgAuth: Unlocking Smartphones with EMG Signals

Screen lock is a critical security feature for smartphones to prevent unauthorized access. Although various screen unlocking technologies, including fingerprint and facial recognition, have been widely adopted, they still have some limitations. For example, fingerprints can be stolen by special material stickers and facial recognition systems can be cheated by 3D-printed head models. In this paper, we propose EmgAuth, a novel electromyography(EMG)-based smartphone unlocking system based on the Siamese network. EmgAuth enables users to unlock their smartphones by leveraging the EMG data of the smartphone users collected from Myo armbands. When training the Siamese network, we design a special data augmentation technique to make the system resilient to the rotation of the armband, which makes EmgAuth free of calibration. We conduct extensive experiments including 53 participants and the evaluation results verify that EmgAuth can effectively authenticate users with an average true acceptance rate of 91.81% while keeping the average false acceptance rate of 7.43%. In addition, we also demonstrate that EmgAuth can work well for smartphones with different screen sizes and for different scenarios when users are placing smartphones at different locations and with different orientations. EmgAuth shows great promise to serve as a good supplement for existing screen unlocking systems to improve the safety of smartphones.

cs.CR

Perturbation theory for Maxwell's equations in anisotropic materials with shifting boundaries

Perturbation theory is a kind of estimation method based on theorem of Taylor expansion, and is useful to investigate electromagnetic solutions of small changes. By considering a sharp boundary as a limit of smoothed systems, previous study has solved the problem when applying standard perturbation theory to Maxwell's equations for small shifts in isotropic dielectric interfaces. However, when dealing with anisotropic materials, an approximation is conducted and leads to an unsatisfactory error. Here we develop a modified perturbation theory for small shifts in anisotropically dielectric interfaces. By using optimized smoothing function for each component of permittivity, we obtain a method to calculate the intrinsic frequency shifts of anisotropic permittivity field when boundaries shift, without approximation. Our method shows accurate results when calculating eigenfrequency's shifts in strong-anisotropy materials, and can be widely used for small shifts in anisotropically dielectric interfaces.

physics.comp-ph

Effect of morphology on the large-amplitude flapping dynamics of an inverted flag in a uniform flow

The stability of a cantilevered elastic sheet in a uniform flow has been studied extensively due to its importance in engineering and its prevalence in natural structures. Varying the flow speed can give rise to a range of dynamics including limit cycle behaviour and chaotic motion of the cantilevered sheet. Recently, the "inverted flag" configuration - a cantilevered elastic sheet aligned with the flow impinging on its free edge - has been observed to produce large-amplitude flapping over a finite band of flow speeds. This flapping phenomenon has been found to be a vortex-induced vibration, and only occurs at sufficiently large Reynolds numbers. In all cases studied, the inverted flag has been formed from a cantilevered sheet of rectangular morphology, i.e. the planform of its elastic sheet is a rectangle. Here, we investigate the effect of the inverted flag's morphology on its resulting stability and dynamics. We choose a trapezoidal planform which is explored using experiment and an analytical theory for the divergence instability of an inverted flag of arbitrary morphology. Strikingly, for this planform we observe that the flow speed range over which flapping occurs scales approximately with the flow speed at which the divergence instability occurs. This provides a means by which to predict and control flapping. In a biological setting, leaves in a wind can also align themselves in an inverted flag configuration. Motivated by this natural occurrence we also study the effect of adding an artificial "petiole" (a thin elastic stalk that connects the sheet to the clamp) on the inverted flag's dynamics. We find that the petiole serves to partially decouple fluid forces from elastic forces and increases the freedom by which the flapping dynamics can be tuned. These results highlight the intricacies of the flapping instability and account for some of the varied dynamics of leaves in nature.

physics.flu-dyn