arXiv · 2406.09421
Towards Disaggregation-Native Data Streaming between Devices
Abstract
Disaggregation is an ongoing trend to increase flexibility in datacenters. With interconnect technologies like CXL, pools of CPUs, accelerators, and memory can be connected via a datacenter fabric. Applications can then pick from those pools the resources necessary for their specific workload. However, this vision becomes less clear when we consider data movement. Workloads often require data to be streamed through chains of multiple devices, but typically, these data streams physically do not directly flow device-to-device, but are staged in memory by a CPU hosting device protocol logic. We show that augmenting devices with a disaggregation-native and device-independent data streaming facility can improve processing latencies by enabling data flows directly between arbitrary devices.
Explore related subjects
Keep this discovery
Nils Asmussen, Michael Roitzsch. 2024-03-28. Towards Disaggregation-Native Data Streaming between Devices. https://arxiv.org/abs/2406.09421
Cite the original work for its findings. Save a collection to share your selection of sources.