论文标题
降级图像超级分辨率的封闭式融合网络
Gated Fusion Network for Degraded Image Super Resolution
论文作者
论文摘要
单图超级分辨率旨在增强图像质量在空间内容方面,这是计算机视觉中的基本任务。在这项工作中,我们通过图像降解的存在(例如模糊,雾霾或雨水条纹)解决了单帧超级分辨率的任务。由于框架捕获和形成过程的局限性,图像降解是不可避免的,并且超级分辨率方法将加剧伪影。为了解决这个问题,我们提出了一个双分支卷积神经网络,以分别提取基本特征和恢复功能。基本功能包含输入图像的本地和全局信息。另一方面,恢复的功能集中在退化的区域上,并用于去除降解。然后,这些特征通过递归门模块融合,以获得超级分辨率的尖锐特征。通过将特征提取步骤分解为两个独立于任务的流,双分支模型可以通过避免学习混合降解且全合一地来促进训练过程,从而增强最终的高分辨率预测结果。我们在三种降解方案中评估了提出的方法。在这些情况下进行的实验表明,该建议的方法对基准数据集上的最新方法更有效,更有利。
Single image super resolution aims to enhance image quality with respect to spatial content, which is a fundamental task in computer vision. In this work, we address the task of single frame super resolution with the presence of image degradation, e.g., blur, haze, or rain streaks. Due to the limitations of frame capturing and formation processes, image degradation is inevitable, and the artifacts would be exacerbated by super resolution methods. To address this problem, we propose a dual-branch convolutional neural network to extract base features and recovered features separately. The base features contain local and global information of the input image. On the other hand, the recovered features focus on the degraded regions and are used to remove the degradation. Those features are then fused through a recursive gate module to obtain sharp features for super resolution. By decomposing the feature extraction step into two task-independent streams, the dual-branch model can facilitate the training process by avoiding learning the mixed degradation all-in-one and thus enhance the final high-resolution prediction results. We evaluate the proposed method in three degradation scenarios. Experiments on these scenarios demonstrate that the proposed method performs more efficiently and favorably against the state-of-the-art approaches on benchmark datasets.