CMQA: A Dataset of Conditional Question Answering with Multiple-Span Answers | |
Ju YM(鞠一鸣); Wang WK(王唯康); Zhang YZ(张元哲); Zheng SC(郑孙聪); Liu K(刘康); Zhao J(赵军) | |
2022-08 | |
会议日期 | October 12-17, 2022 |
会议地点 | Gyeongju, Republic of Korea |
英文摘要 | Forcing the answer of the Question Answering (QA) task to be a single text span might be restrictive since the answer can be multiple spans in the context. Moreover, we found that multi-span answers often appear with two characteristics when building the QA system for a real-world application. First, multi-span answers might be caused by users lacking domain knowledge and asking ambiguous questions, which makes the question need to be answered with conditions. Second, there might be hierarchical relations among multiple answer spans. Some recent span-extraction QA datasets include multi-span samples, but they only contain unconditional and parallel answers, which cannot be used to tackle this problem. To bridge the gap, we propose a new task: conditional question answering with hierarchical multi-span answers, where both the hierarchical relations and the conditions need to be extracted. Correspondingly, we introduce CMQA, a Conditional Multiple-span Chinese Question Answering dataset to study the new proposed task. The final release of CMQA consists of 7,861 QA pairs and 113,089 labels, where all samples contain multi-span answers, 50.4% of samples are conditional, and 56.6% of samples are hierarchical. CMQA can serve as a benchmark to study the new proposed task and help study building QA systems for real-world applications. The low performance of models drawn from related literature shows that the new proposed task is challenging for the community to solve. |
内容类型 | 会议论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/52283] |
专题 | 模式识别国家重点实验室_自然语言处理 |
通讯作者 | Zhao J(赵军) |
作者单位 | 1.School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China 2.National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China |
推荐引用方式 GB/T 7714 | Ju YM,Wang WK,Zhang YZ,et al. CMQA: A Dataset of Conditional Question Answering with Multiple-Span Answers[C]. 见:. Gyeongju, Republic of Korea. October 12-17, 2022. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论