FG-DSA: Frequency-Guided Depthwise Separable Attention for Efficient Dense Prediction
Dense prediction and generative modeling remain challenging in resource-constrained environments, particularly because repeated downsampling can lead to the loss of spatial details and less accurate object boundaries. Although attention mechanisms have been widely adopted to address semantic ambiguity, preserving high-frequency information while maintaining computational efficiency remains an important challenge. To address this issue, we propose Frequency-Guided Depthwise Separable Attention for Efficient Dense Prediction (FG-DSA), a framework that integrates frequency-domain information into lightweight vision architectures for dense visual understanding and generation. Specifically, FG-DSA uses a 2D Fast Fourier Transform (FFT)-based high-pass filtering module to guide spatial attention, aiming to retain fine-grained features and improve object-boundary representation. Experimental results show that FG-DSA can improve boundary-related performance in semantic segmentation under the evaluated setting. Beyond discriminative tasks, we also examine its application in a generative U-Net for single-step image restoration. The results suggest that incorporating FG-DSA can enhance reconstruction quality and help preserve high-frequency details.