增强局部注意力的生成对抗网络壁画修复

MURAL RESTORING BASED ON A GENERATIVE ADVERSARIAL NETWORK WITH ENHANCED LOCAL ATTENTION MECHANISM

  • 摘要: 壁画图像色彩丰富,图像不同部分纹理差别较大,针对传统方法修复壁画图像后色彩、观感不佳及大区域破损壁画修复效果差等问题,提出一种增强局部注意力生成对抗网络的壁画图像修复方法。在传统生成对抗网络结构基础上重新设计,并引入提出的局部注意力模块,可以更好地对壁画图像进行修复。经过对人工处理后的待修复壁画图像以及真实五台山壁画进行数字化修复后,实验结果表明,该算法能很好地改善深度学习方法修复图像时造成的局部模糊以及纹理缺失问题,在主观观感上优于其他对比算法,并且修复后的壁画在客观评价峰值信噪比(PSNR)及结构相似度(SSIM)指标上也优于其他对比算法。

     

    Abstract: The mural image is rich in color, and the texture of different parts of the image is quite different. Aimed at the problems of poor color and appearance after traditional methods of restoring mural images, and poor restore effect of large-area damaged murals, a mural image restore method with enhanced local attention generative adversarial network is proposed. Redesigning on the basis of traditional generative adversarial network structure, and introducing the local attention mechanism proposed in this paper, it could better restore mural images. After digitally restoring the artificially processed mural images to be restored and the real Wutai Mountain murals, the experimental results show that the algorithm can well improve the local blur and texture loss problems caused by the deep learning method when restoring images, and has better subjective perception. Compared with other comparison algorithms, the restored murals are also better than other comparison algorithms in objective evaluation of peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) indicators.

     

/

返回文章
返回