arXiv · 1812.03967
ProIO: An Event-Based I/O Stream Format for Protobuf Messages
Abstract
ProIO is a new event-oriented streaming data format which utilizes Google's Protocol Buffers (protobuf) to be flexible and highly language-neutral. The ProIO concept is described here along with its software implementations. The performance of the ProIO concept for a dataset with Monte-Carlo event records used in high-energy physics was benchmarked and compared/contrasted with ROOT I/O. Various combinations of general-purpose compression and variable-length integer encoding available in protobuf were used to investigate the relationship between I/O performance and size-on-disk in a few key scenarios.
Explore related subjects
Keep this discovery
D. Blyth, J. Alcaraz, S. Binet, S. V. Chekanov. 2018-12-10. ProIO: An Event-Based I/O Stream Format for Protobuf Messages. https://doi.org/10.1016/j.cpc.2019.03.018
Cite the original work for its findings. Save a collection to share your selection of sources.