Open AccessPosted Content
Know What You Don't Know: Unanswerable Questions for SQuAD
TL;DR: SQuadRUn is a new dataset that combines the existing Stanford Question Answering Dataset (SQuAD) with over 50,000 unanswerable questions written adversarially by crowdworkers to look similar to answerable ones.
read more
Abstract: Extractive reading comprehension systems can often locate the correct answer to a question in a context document, but they also tend to make unreliable guesses on questions for which the correct answer is not stated in the context. Existing datasets either focus exclusively on answerable questions, or use automatically generated unanswerable questions that are easy to identify. To address these weaknesses, we present SQuAD 2.0, the latest version of the Stanford Question Answering Dataset (SQuAD). SQuAD 2.0 combines existing SQuAD data with over 50,000 unanswerable questions written adversarially by crowdworkers to look similar to answerable ones. To do well on SQuAD 2.0, systems must not only answer questions when possible, but also determine when no answer is supported by the paragraph and abstain from answering. SQuAD 2.0 is a challenging natural language understanding task for existing models: a strong neural system that gets 86% F1 on SQuAD 1.1 achieves only 66% F1 on SQuAD 2.0.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
CAVE: Correcting Attribute Values in E-commerce Profiles
Kassem Al Sabeh,Mouna Kacimi,Johann Gamper +2 more
- 17 Oct 2022
TL;DR: CAVE is the first system that allows users to experiment with a number of powerful QA models and compare their performances on attribute values correction using real-word datasets and has the capability to enrich existing product descriptions with new attribute values extracted from titles.
6
Ner4Opt: Named Entity Recognition for Optimization Modelling from Natural Language
Parag Pravin Dakle,Serdar Kadioglu,Regina Politi,Preethi Raghavan,Sai Krishna Rallabandi,Ravisutha Sakrepatna Srinivasamurthy +5 more
TL;DR: Ner4Opt as mentioned in this paper uses named entity recognition to capture components of optimization models such as the objective, variables, and constraints from free-form natural language text, and shows how to solve Ner4Opt using classical techniques based on morphological and grammatical properties.
6
•Posted Content
Weakly supervised one-stage vision and language disease detection using large scale pneumonia and pneumothorax studies
TL;DR: A challenging new set of radiologist paired bounding box and natural language annotations on the publicly available MIMIC-CXR dataset especially focussed on pneumonia and pneumothorax is presented.
6
Towards multi-document summarization in the open-domain
20 Dec 2022
TL;DR: In this article , the authors study the problem of multi-document summarization in the open-domain setting and show that summarizers are sensitive to duplicate documents and the order of retrieved documents, but highly sensitive to irrelevant documents.
Journal Article
SleepQA: A Health Coaching Dataset on Sleep for Extractive Question Answering
Iva Bojic,Qi Chwen Ong,Meghraj Thakkar,Esha Kamran,Irving Yu Le Shua,Jaime Rei Ern Pang,Jessica Chen,Vaaruni Nayak,Shafiq Joty,Josip Car +9 more
TL;DR: In this paper , a domain-specific QA pipeline for sleep coaching is proposed, which can support health coaches in facilitating clients' lifestyle behavior changes (e.g., in adopting healthy sleep habits).
5
References
•Posted Content
SQuAD: 100,000+ Questions for Machine Comprehension of Text
TL;DR: The Stanford Question Answering Dataset (SQuAD) as mentioned in this paper is a reading comprehension dataset consisting of 100,000+ questions posed by crowdworkers on a set of Wikipedia articles, where the answer to each question is a segment of text from the corresponding reading passage.
5.8K
•Proceedings Article
Teaching machines to read and comprehend
Karl Moritz Hermann,Tomáš Kočiský,Edward Grefenstette,Lasse Espeholt,Will Kay,Mustafa Suleyman,Phil Blunsom +6 more
- 07 Dec 2015
TL;DR: A new methodology is defined that resolves this bottleneck and provides large scale supervised reading comprehension data that allows a class of attention based deep neural networks that learn to read real documents and answer complex questions with minimal prior knowledge of language structure to be developed.
•Proceedings Article
Bidirectional Attention Flow for Machine Comprehension
Minjoon Seo,Aniruddha Kembhavi,Ali Farhadi,Hannaneh Hajishirzi +3 more
- 04 Nov 2016
TL;DR: The BIDAF network is introduced, a multi-stage hierarchical process that represents the context at different levels of granularity and uses bi-directional attention flow mechanism to obtain a query-aware context representation without early summarization.
2.1K
•Proceedings Article
MS MARCO: A Human Generated MAchine Reading COmprehension Dataset.
Tri Nguyen,Mir Rosenberg,Xia Song,Jianfeng Gao,Saurabh Tiwary,Rangan Majumder,Li Deng +6 more
- 04 Nov 2016
TL;DR: MS MARCO as mentioned in this paper is a large scale dataset for reading comprehension and question answering, where all questions are sampled from real anonymized user queries and context passages from which answers in the dataset are derived from real web documents using the most advanced version of the Bing search engine.
WikiQA: A Challenge Dataset for Open-Domain Question Answering
Yi Yang,Wen-tau Yih,Christopher Meek +2 more
- 21 Sep 2015
TL;DR: The WIKIQA dataset is described, a new publicly available set of question and sentence pairs, collected and annotated for research on open-domain question answering, which is more than an order of magnitude larger than the previous dataset.