融合交叉注意力机制的街景实时语义分割

STREET SCENE REAL-TIME SEMANTIC SEGMENTATION WITH FUSION CROSS ATTENTION

  • 摘要: 为了提高街景语义分割的边缘清晰度和小目标识别率,提出一种街景实时语义分割网络(CitySeNet)。该网络基于BiseNetV2,用交叉卷积块增强细节分支,用十字交叉注意力机制优化语义分支,并将两个分支的特征有效融合。在Cityscapes数据集上的实验结果显示,CitySeNet网络的平均交并比(mIoU)为77%,其中行人和自行车这两类小目标的交并比分别为82%和77%。语义分割的可视化结果表明,该网络能够更清晰地分割出目标边缘,有效地解决了边缘模糊和小目标识别不准确的问题,满足实时分割的需求。

     

    Abstract: To improve the edge sharpness and small object recognition rate of street scene semantic segmentation, this paper proposes a street scene real-time semantic segmentation network(CitySeNet). The network was based on BiseNet V2, enhanced the detail branch with cross convolution blocks, optimized the semantic branch with cross-cross attention mechanism, and effectively fused the features of the two branches. The experimental results on the Cityscapes dataset show that the mean intersection over union(mIoU) of CitySeNet network is 77%, and the intersection over union of pedestrians and bicycles are 82% and 77% respectively. The visualization results of semantic segmentation show that the network can segment target edges more clearly, effectively solve the problems of edge blurring and inaccurate small object recognition, and meet the requirements of real-time segmentation.

     

/

返回文章
返回