基于多层掩码Transformer的服装兼容性预测

FASHION COMPATIBILITY PREDICTION BASED ON MULTI-LAYER MASK TRANSFORMER

  • 摘要: 针对服装兼容方法不能很好融合套装内部单品间复杂关系特征,导致准确度不高的问题,提出一种多层掩码Transformer模型(MLMT)来解决服装兼容问题。提出一种基于Transformer的编码器来融合套装内部所有单品的风格信息;提出一种掩码模型通过比较单品间的相关性进而判断服装的兼容性。在polyvore-T公开数据集上进行验证,并通过实验与现有方法进行了比较,证明了该方法的有效性。

     

    Abstract: In order to solve the problem that the clothing compatibility method cannot fuse the complex relationship features among the items inside the suit well, resulting in low accuracy, this paper proposes a multi-layer mask Transformer model (MLMT) to solve the clothing compatibility problem. We proposed a Transformer-based encoder to fuse the style information of all items inside the suit, and we proposed a mask model to determine the compatibility of garments by comparing the correlation between items. It is validated on the polyvore-T public dataset, and the effectiveness of this method is demonstrated by comparing it with existing methods through experiments.

     

/

返回文章
返回