arXiv · 2510.04044
Quantization Range Estimation for Convolutional Neural Networks
Abstract
Post-training quantization for reducing the storage of deep neural network models has been demonstrated to be an effective way in various tasks. However, low-bit quantization while maintaining model accuracy is a challenging problem. In this paper, we present a range estimation method to improve the quantization performance for post-training quantization. We model the range estimation into an optimization problem of minimizing quantization errors by layer-wise local minima. We prove this problem is locally convex and present an efficient search algorithm to find the optimal solution. We propose the application of the above search algorithm to the transformed weights space to do further improvement in practice. Our experiments demonstrate that our method outperforms state-of-the-art performance generally on top-1 accuracy for image classification tasks on the ResNet series models and Inception-v3 model. The experimental results show that the proposed method has almost no loss of top-1 accuracy in 8-bit and 6-bit settings for image classifications, and the accuracy of 4-bit quantization is also significantly improved. The code is available at https://github.com/codeiscommitting/REQuant.
Explore related subjects
Keep this discovery
Bingtao Yang, Yujia Wang, Mengzhi Jiao, Hongwei Huo. 2025-10-05. Quantization Range Estimation for Convolutional Neural Networks. https://arxiv.org/abs/2510.04044
Cite the original work for its findings. Save a collection to share your selection of sources.