CORC  > 北京大学  > 信息科学技术学院
Effective Time Ratio: A Measure for Web Search Engines with Document Snippets
He, Jing ; Shu, Baihan ; Li, Xiaoming ; Yan, Hongfei
2010
关键词Information retrieval evaluation metric snippet RETRIEVAL
英文摘要The dominant method for evaluating search engines is the Cranfield paradigm, but the existing metrics do not consider sonic modern search engines features, such as document snippets. In this paper, we propose a new metric effective time ratio for search engine evaluation. Effective time ratio measures the ratio between effective time a user spent on getting relevant information and the total search time. For retrieval system without presenting document snippet, its value is identical to precision. For search engine with snippet, some theoretical analysis proves that its value can reflect both retrieval system performance and snippet quality. We further deploy a real user study, showing that effective time ratio can reflect users' satisfaction better than the existing metrics based on document relevance and/or snippet relevance.; Computer Science, Information Systems; Computer Science, Software Engineering; Computer Science, Theory & Methods; EI; CPCI-S(ISTP); 0
语种英语
DOI标识10.1007/978-3-642-17187-1_7
内容类型其他
源URL[http://ir.pku.edu.cn/handle/20.500.11897/293046]  
专题信息科学技术学院
推荐引用方式
GB/T 7714
He, Jing,Shu, Baihan,Li, Xiaoming,et al. Effective Time Ratio: A Measure for Web Search Engines with Document Snippets. 2010-01-01.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace