Effective Time Ratio: A Measure for Web Search Engines with Document Snippets | |
He, Jing ; Shu, Baihan ; Li, Xiaoming ; Yan, Hongfei | |
2010 | |
关键词 | Information retrieval evaluation metric snippet RETRIEVAL |
英文摘要 | The dominant method for evaluating search engines is the Cranfield paradigm, but the existing metrics do not consider sonic modern search engines features, such as document snippets. In this paper, we propose a new metric effective time ratio for search engine evaluation. Effective time ratio measures the ratio between effective time a user spent on getting relevant information and the total search time. For retrieval system without presenting document snippet, its value is identical to precision. For search engine with snippet, some theoretical analysis proves that its value can reflect both retrieval system performance and snippet quality. We further deploy a real user study, showing that effective time ratio can reflect users' satisfaction better than the existing metrics based on document relevance and/or snippet relevance.; Computer Science, Information Systems; Computer Science, Software Engineering; Computer Science, Theory & Methods; EI; CPCI-S(ISTP); 0 |
语种 | 英语 |
DOI标识 | 10.1007/978-3-642-17187-1_7 |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/293046] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | He, Jing,Shu, Baihan,Li, Xiaoming,et al. Effective Time Ratio: A Measure for Web Search Engines with Document Snippets. 2010-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论