融合CNN和注意力机制的宽度学习系统

A BROAD LEARNING SYSTEM INTEGRATING CNN AND ATTENTION MECHANISM

  • 摘要: 宽度学习系统(BroadLearningSystem,BLS)是近年来提出的一种快速有效的新型神经网络模型。然而,BLS的浅层结构导致模型特征提取不充分从而限制了其分类性能。为此,提出一种融合CNN和注意力机制的宽度学习系统(CNN-Attention BLS,CA-BLS)。CA-BLS以BLS为基础,利用CNN局部连接和权值共享的特性来提取样本中不同层次的局部特征信息。同时引入注意力机制来动态调整卷积过程中不同特征通道的权值,使得模型能够更加关注样本中的全局特征,从而进一步提高模型的分类性能。实验结果表明:CA-BLS模型的分类精度优于其他对比方法,并通过消融实验验证了所融合方法的有效性。

     

    Abstract: The broad learning system (BLS) is a fast and effective neural network model recently proposed. However, the shallow structure of BLS limits its feature extraction capability, consequently affecting its classification performance. To address this, we introduce a broad learning system called CNN- Attention BLS (CA- BLS), which combines CNN and an attention mechanism. CA- BLS built upon BLS and leveraged the local connectivity and weight sharing properties of CNN to extract local feature information at various levels in the samples. Simultaneously, we incorporated the attention mechanism to dynamically adjust feature channel weights during the convolution process, enabling the model to focus on global features in the samples and thereby enhancing classification performance. Experimental results demonstrate that the classification accuracy of the CA- BLS model surpasses that of other comparative methods, and the effectiveness of this fusion approach is validated through ablation experiments.

     

/

返回文章
返回