arXiv · 2611.11076
ADC-RANet: Improving Resolution Adaptive Neural Networks with Attention, Distillation and Calibration
Abstract
Dynamic neural networks are a class of adaptive models in which the computation assigned to each input sample is determined dynamically, potentially reducing computational cost while maintaining similar performance. For image classification, the Resolution Adaptive Network (RANet) is a strong approach that progressively allocates computational resources across input scales based on sample difficulty. In this work, we introduce RANet with Attention, Distillation and Calibration (ADC-RANet), an enhanced version of RANet that improves performance across all computational budgets. Our approach combines three tightly connected components: bottom-up channel attention, top-down cascaded knowledge distillation, and overconfidence correction using MixUp, in a synergistic design that coordinates both pathways. Experiments on CIFAR-100 and ImageNet datasets show consistent gains while preserving the efficiency of RANet. Our code is available: https://github.com/jefersonseverino/ADC-RANet
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Jeferson Severino de Araujo, Lilian Hollard, Eric Granger, Marco Pedersoli. 2026-11-08. ADC-RANet: Improving Resolution Adaptive Neural Networks with Attention, Distillation and Calibration. https://searcharxiv.com/abs/2611.11076
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.