arXiv · 1507.00391
Partitioning Uncertain Workflows
Abstract
It is common practice to partition complex workflows into separate channels in order to speed up their completion times. When this is done within a distributed environment, unavoidable fluctuations make individual realizations depart from the expected average gains. We present a method for breaking any complex workflow into several workloads in such a way that once their outputs are joined, their full completion takes less time and exhibit smaller variance than when running in only one channel. We demonstrate the effectiveness of this method in two different scenarios; the optimization of a convex function and the transmission of a large computer file over the Internet.
Explore related subjects
Keep this discovery
Bernardo A. Huberman, Freddy C. Chua. 2015-07-01. Partitioning Uncertain Workflows. https://arxiv.org/abs/1507.00391
Cite the original work for its findings. Save a collection to share your selection of sources.