论文标题

Uformer-ICS:用于图像压缩传感服务的U形变压器

Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

论文作者

Zhang, Kuiyuan, Hua, Zhongyun, Li, Yuanman, Zhang, Yushu, Zhou, Yicong

论文摘要

许多服务计算应用程序都需要从多个设备的实时数据集收集,需要有效的采样技术来减少带宽和存储压力。压缩传感(CS)在图像采集和重建中发现了广泛的应用。最近,为CS任务引入了许多深度学习方法。但是,从测量值中准确重建图像仍然是一个重大挑战,尤其是在较低的采样率下。在本文中,我们通过将CS的内部特征引入变压器体系结构中,将Uformer-ICS作为图像CS任务的新型U形变压器。为了利用图像块的稀疏性分布不平,我们设计了一种自适应采样体系结构,该体系结构根据估计的块稀疏性分配了测量资源,从而使压缩结果可以保留原始图像中的最大信息。此外,我们引入了一个受传统CS优化方法启发的多通道投影(MCP)模块。通过将MCP模块集成到变压器块中,我们构建了基于投影的变压器块,然后使用这些块和残余卷积块形成对称重建模型。因此,我们的重建模型可以同时利用图像的局部特征和远程依赖性以及CS理论的先前投影知识。 实验结果表明,其重建性能明显优于基于深度学习的CS方法。

Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this paper, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源