arXiv · 2104.13193
Scalable Microservice Forensics and Stability Assessment Using Variational Autoencoders
Abstract
We present a deep learning based approach to containerized application runtime stability analysis, and an intelligent publishing algorithm that can dynamically adjust the depth of process-level forensics published to a backend incident analysis repository. The approach applies variational autoencoders (VAEs) to learn the stable runtime patterns of container images, and then instantiates these container-specific VAEs to implement stability detection and adaptive forensics publishing. In performance comparisons using a 50-instance container workload, a VAE-optimized service versus a conventional eBPF-based forensic publisher demonstrates 2 orders of magnitude (OM) CPU performance improvement, a 3 OM reduction in network transport volume, and a 4 OM reduction in Elasticsearch storage costs. We evaluate the VAE-based stability detection technique against two attacks, CPUMiner and HTTP-flood attack, finding that it is effective in isolating both anomalies. We believe this technique provides a novel approach to integrating fine-grained process monitoring and digital-forensic services into large container ecosystems that today simply cannot be monitored by conventional techniques
Explore related subjects
Keep this discovery
Prakhar Sharma, Phillip Porras, Steven Cheung, James Carpenter, Vinod Yegneswaran. 2021-04-23. Scalable Microservice Forensics and Stability Assessment Using Variational Autoencoders. https://arxiv.org/abs/2104.13193
Cite the original work for its findings. Save a collection to share your selection of sources.