面向模式映射的短文本相似度计算方法

SHORT TEXT SIMILARITY COMPUTATION METHOD FOR SCHEMA MAPPING

  • 摘要: 模式映射是实现数据标准化管理、确保数据质量与合规性的主要方法之一,现有模式映射的字段匹配方法难以应对专业语境中专业术语多、文本长度短、语义理解难等挑战。提出一种基于预训练语言模型的短文本相似度计算方法(SSCM),能够有效提升模式映射中对应字段识别匹配的准确度,避免在专业语境下发生字符级偏差引起的字段匹配错误。基于BankFieldSim数据集的实验结果表明,该方法优于基线模型方法,能够满足数据治理、数据集成等场景下对模式映射的高准确性要求。

     

    Abstract: Schema mapping is one of the primary methods for achieving standardized data management and ensuring data quality and compliance. Existing field matching methods for schema mapping struggle to address the challenges in professional contexts, such as a large number of technical terms, short text lengths and difficulties in semantic understanding. This paper proposes a short text similarity computation method(SSCM) based on pre-trained language models, which can effectively improve the accuracy of corresponding field identification and matching in schema mapping and avoid field matching errors caused by character-level deviations in professional scenarios. Experimental results on the BankFieldSim dataset demonstrate that this method outperforms baseline models and can meet the high accuracy requirements for schema mapping in scenarios such as data governance and data integration.

     

/

返回文章
返回