论文标题
OAEI的知识图轨道 - 金标准，基线和金锤偏见
The Knowledge Graph Track at OAEI -- Gold Standards, Baselines, and the Golden Hammer Bias
论文作者
论文摘要
本体一致评估计划（OAEI）是对本体匹配工具的年度评估。在2018年，我们启动了知识图轨道，其目标是评估大规模知识图的实体和模式的同时匹配。在本文中，我们讨论了曲目的设计和两种不同的黄金标准创建策略。我们分析了在曲目的第一版中获得的结果和经验，并通过揭示隐藏的任务，我们表明，提交给曲目的所有工具（可能也可能是其他曲目）都遭受偏见，我们将金锤偏见命名为偏见。
The Ontology Alignment Evaluation Initiative (OAEI) is an annual evaluation of ontology matching tools. In 2018, we have started the Knowledge Graph track, whose goal is to evaluate the simultaneous matching of entities and schemas of large-scale knowledge graphs. In this paper, we discuss the design of the track and two different strategies of gold standard creation. We analyze results and experiences obtained in first editions of the track, and, by revealing a hidden task, we show that all tools submitted to the track (and probably also to other tracks) suffer from a bias which we name the golden hammer bias.
