arXiv · 1805.08743
CascadeCNN: Pushing the performance limits of quantisation
Abstract
This work presents CascadeCNN, an automated toolflow that pushes the quantisation limits of any given CNN model, to perform high-throughput inference by exploiting the computation time-accuracy trade-off. Without the need for retraining, a two-stage architecture tailored for any given FPGA device is generated, consisting of a low- and a high-precision unit. A confidence evaluation unit is employed between them to identify misclassified cases at run time and forward them to the high-precision unit or terminate computation. Experiments demonstrate that CascadeCNN achieves a performance boost of up to 55% for VGG-16 and 48% for AlexNet over the baseline design for the same resource budget and accuracy.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Alexandros Kouris, Stylianos I. Venieris, Christos-Savvas Bouganis. 2018-05-22. CascadeCNN: Pushing the performance limits of quantisation. https://arxiv.org/abs/1805.08743
Cite the original work for its findings. Save a collection to share your selection of sources.