基于混合注意力模块改进StarGAN的水下图像增强

Enhancement of underwater images on improved StarGAN by mixed attention module

  • 摘要: 围绕水下图像色偏和模糊的特点,针对不同浑浊度的水下图像差异较大问题,提出了一种基于混合注意力模块 (Convolutional Block Attention Module, CBAM) 改进的星型生成对抗网络 (Unified Generative Adversarial Networks, StarGAN) 用于水下多浑浊图像增强。首先使用水下相机采集实验室和养殖平台环境2组水下多浊度图像数据集;其次优化StarGAN,在每个ResidualBlock模块后引入一个由通道注意力模块和空间注意力模块串联组成的CBAM;最后进行消融实验,并与其他方法比较,使用水下图像质量评估 (Underwater Image Quality Measurement, UIQM)、水下彩色图像质量评估 (Underwater Color Image Quality Evaluation,UCIQE) 和图像熵作为图像质量评价指标。结果表明,实验室数据集增强后,UIQM达到1.18,图像熵达到12.83,UCIQE达到30.13;养殖平台数据集增强后,UIQM达到0.52,图像熵达到9.94,UCIQE达到10.35。所提方法对实验室和养殖平台环境中不同浑浊度的图像增强均有较好的效果,在消融实验中以及与其他方法比较中,该方法的得分均为最高。

     

    Abstract: Based on the characteristics of color cast and blur in underwater images, we proposed a StarGAN based on CBAM improvement for underwater multi turbidity image enhancement to address the problem of significant differences in underwater images with different turbidity levels. First, we collected two sets of underwater turbidity image datasets from laboratory and aquaculture platform environments by using an underwater camera. Secondly, we optimized StarGAN by introducing a CBAM consisting of a channel attention module and a spatial attention module in series after each ResidualBlock module. Finally, we conducted ablation experiments and compared them with other methods by using UIQM, UCIQE and Image entropy as image quality evaluation indicators. The results indicate that UIQM reached 1.18, Image entropy reached 12.83, and UCIQE reached 30.13 of the enhanced laboratory dataset. UIQM reached 0.52, Image entropy reached 9.94, and UCIQE reached 10.35 of the enhanced aquaculture platform dataset. The experimental results show that in ablation experiments and compared with other methods, this method has a good effect on enhancing multi turbidity images, with the highest scores.

     

/

返回文章
返回