SearcharxivSearch

arXiv subjects

Alejandro Dopico-Castro

Publications and source records attributed to Alejandro Dopico-Castro.

3 recordsLinked to original sources

Closing the Alignment-Maturity Gap in Federated Prototype Learning

Learning discriminative visual representations from distributed, heterogeneous data is a fundamental challenge in Federated Learning (FL). Prototype-based methods address statistical heterogeneity by sharing class-level representations across clients but create a distance-dependent gradient pressure that is particularly severe during early training rounds: alignment pressure applied to immature global prototypes, aggregated from noisy local representations, generates large gradients that suppress the emergence of local discriminative structure. The result is a poorly organized embedding space and degraded recognition performance, particularly under severe non-IID conditions. We propose FedSAP, a framework that stabilises federated representation learning through two complementary mechanisms: a deterministic alignment curriculum that delays global alignment until local representations become stable and a geometry-driven proxy separation loss that enforces inter-class structure on the unit hypersphere using the existing prototype bank without introducing additional parameters or communication overhead. Together, these mechanisms produce compact, well-separated class clusters without altering the underlying communication protocol between federation's participants. Experiments across three benchmarks and varying degrees of heterogeneity show gains of up to 4 percentage points over the prototype-based baselines evaluated, with improvements most pronounced under high heterogeneity. The representational nature of our framework further enables a straightforward extension to semi-supervised settings, where unlabelled data is incorporated with minimal modification, underscoring the generality of scheduled alignment as a design principle.

cs.LG

FedHENet: A Frugal Federated Learning Framework for Heterogeneous Environments

Federated Learning (FL) enables collaborative training without centralizing data, essential for privacy compliance in real-world scenarios involving sensitive visual information. Most FL approaches rely on expensive, iterative deep network optimization, which still risks privacy via shared gradients. In this work, we propose FedHENet, extending the FedHEONN framework to image classification. By using a fixed, pre-trained feature extractor and learning only a single output layer, we avoid costly local fine-tuning. This layer is learned by analytically aggregating client knowledge in a single round of communication using homomorphic encryption (HE). Experiments show that FedHENet achieves competitive accuracy compared to iterative FL baselines while demonstrating superior stability performance and up to 70\% better energy efficiency. Crucially, our method is hyperparameter-free, removing the carbon footprint associated with hyperparameter tuning in standard FL. Code available in https://github.com/AlejandroDopico2/FedHENet/

cs.CV

CIFNet: An Analytic Neural Learning Framework for Efficient and Calibrated Class-Incremental Learning

Class-Incremental Learning (CIL) in deep neural networks is conventionally framed as an iterative gradient-based optimization problem, incurring high computational cost, hyperparameter sensitivity, and risk of catastrophic forgetting. In this work, we demonstrate that when leveraging frozen pre-trained representations, CIL can be solved as a sequence of deterministic, closed-form classifier adaptations without backpropagation or iterative convergence. We propose CIFNet, an analytic neural learning framework built upon Regularised Recursive Least-Squares (RRLS). CIFNet updates classifier weights via an exact, closed-form ridge-regression solution operating in a stationary embedding space. To counteract the structural initialisation bias that arises when newly expanded output neurons are introduced without exposure to past-class evidence, CIFNet incorporates a lightweight calibration buffer in latent space alongside density-aware oversampling, ensuring globally balanced decision boundaries without raw image storage or gradient updates. Extensive evaluations across CIFAR-100, ImageNet-100, and CORe50 show that CIFNet achieves predictive accuracy competitive with iterative CIL baselines while maintaining strictly monotonic, smooth learning trajectories free from intermediate performance collapse. Furthermore, by replacing epoch-wise backpropagation with closed-form moment accumulation, CIFNet achieves up to 20$\times$ reduction in energy consumption. These findings establish calibrated analytic learning as an efficient, stable, and mathematically grounded paradigm for continual adaptation in neural networks.

cs.LG