A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data
Zhu, HJ (Zhu, Hui-Juan); Zhu, ZW (Zhu, Zheng-Wei); Jiang, TH (Jiang, Tong-Hai); Cheng, L (Cheng, Li); Shi, WL (Shi, Wei-Lei); Zhou, X (Zhou, Xi); Zhao, F (Zhao, Fan); Ma, B (Ma, Bo)
刊名JOURNAL OF SENSORS
2018
卷号2018期号:1页码:1-12
ISSN号1687-725X
DOI10.1155/2018/2094696
英文摘要

In data integration, entity resolution is an important technique to improve data quality. Existing researches typically assume that the target dataset only contain string-type data and use single similarity metric. For larger high-dimensional dataset, redundant information needs to be verified using traditional blocking or windowing techniques. In this work, we propose a novel ER-resolving method using a hybrid approach, including type-based multiblocks, varying window size, and more flexible similarity metrics. In our new ER workflow, we reduce the searching space for entity pairs by the constraint of redundant attributes and matching likelihood. We develop a reference implementation of our proposed approach and validate its performance using real-life dataset from one Internet of Things project. We evaluate the data processing system using five standard metrics including effectiveness, efficiency, accuracy, recall, and precision. Experimental results indicate that the proposed approach could be a promising alternative for entity resolution and could be feasibly applied in real-world data cleaning for large datasets.

WOS记录号WOS:000424828300001
内容类型期刊论文
源URL[http://ir.xjipc.cas.cn/handle/365002/5221]  
专题新疆理化技术研究所_多语种信息技术研究室
通讯作者Jiang, TH (Jiang, Tong-Hai)
作者单位1.Changzhou Univ, Sch Informat Sci & Engn, Changzhou 213164, Peoples R China
2.Chinese Acad Sci, Xinjiang Tech Inst Phys & Chem, Urumqi 830011, Peoples R China
3.Xinjiang Lab Minor Speech & Language Informat Pro, Urumqi 830011, Peoples R China
推荐引用方式
GB/T 7714
Zhu, HJ ,Zhu, ZW ,Jiang, TH ,et al. A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data[J]. JOURNAL OF SENSORS,2018,2018(1):1-12.
APA Zhu, HJ .,Zhu, ZW .,Jiang, TH .,Cheng, L .,Shi, WL .,...&Ma, B .(2018).A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data.JOURNAL OF SENSORS,2018(1),1-12.
MLA Zhu, HJ ,et al."A Type-Based Blocking Technique for Efficient Entity Resolution over Large-Scale Data".JOURNAL OF SENSORS 2018.1(2018):1-12.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace