arXiv · 2603.25374
Supercharging Federated Intelligence Retrieval
Abstract
RAG typically assumes centralized access to documents, which breaks down when knowledge is distributed across private data silos. We propose a secure Federated RAG system built using Flower that performs local silo retrieval, while server-side aggregation and text generation run inside an attested, confidential compute environment, enabling confidential remote LLM inference even in the presence of honest-but-curious or compromised servers. We also propose a cascading inference approach that incorporates a non-confidential third-party model (e.g., Amazon Nova) as auxiliary context without weakening confidentiality.
Explore related subjects
Keep this discovery
Dimitris Stripelis, Patrick Foley, Mohammad Naseri, William Lindskog-Münzing, Chong Shen Ng, Daniel Janes Beutel, Nicholas D. Lane. 2026-03-26. Supercharging Federated Intelligence Retrieval. https://arxiv.org/abs/2603.25374
Cite the original work for its findings. Save a collection to share your selection of sources.