arXiv · 2106.11755
Sphynx: ReLU-Efficient Network Design for Private Inference
Abstract
The emergence of deep learning has been accompanied by privacy concerns surrounding users' data and service providers' models. We focus on private inference (PI), where the goal is to perform inference on a user's data sample using a service provider's model. Existing PI methods for deep networks enable cryptographically secure inference with little drop in functionality; however, they incur severe latency costs, primarily caused by non-linear network operations (such as ReLUs). This paper presents Sphynx, a ReLU-efficient network design method based on micro-search strategies for convolutional cell design. Sphynx achieves Pareto dominance over all existing private inference methods on CIFAR-100. We also design large-scale networks that support cryptographically private inference on Tiny-ImageNet and ImageNet.
Explore related subjects
Keep this discovery
Minsu Cho, Zahra Ghodsi, Brandon Reagen, Siddharth Garg, Chinmay Hegde. 2021-06-17. Sphynx: ReLU-Efficient Network Design for Private Inference. https://doi.org/10.1109/msec.2022.3165475
Cite the original work for its findings. Save a collection to share your selection of sources.