Proceedings Article10.1145/2736277.2741626
GERBIL: General Entity Annotator Benchmarking Framework
Ricardo Usbeck,Michael Röder,Axel-Cyrille Ngonga Ngomo,Ciro Baron,Andreas Both,Martin Brümmer,Diego Ceccarelli,Marco Cornolti,Didier Cherix,Bernd Eickmann,Paolo Ferragina,Christiane Lemke,Andrea Moro,Roberto Navigli,Francesco Piccinno,Giuseppe Rizzo,Harald Sack,René Speck,Raphaël Troncy,Jörg Waitelonis,Lars Wesemann +20 more
- 18 May 2015
- pp 1133-1143
TL;DR: GERBIL aims to become a focal point for the state of the art, driving the research agenda of the community by presenting comparable objective evaluation results.
read more
Abstract: We present GERBIL, an evaluation framework for semantic entity annotation. The rationale behind our framework is to provide developers, end users and researchers with easy-to-use interfaces that allow for the agile, fine-grained and uniform evaluation of annotation tools on multiple datasets. By these means, we aim to ensure that both tool developers and end users can derive meaningful insights pertaining to the extension, integration and use of annotation applications. In particular, GERBIL provides comparable results to tool developers so as to allow them to easily discover the strengths and weaknesses of their implementations with respect to the state of the art. With the permanent experiment URIs provided by our framework, we ensure the reproducibility and archiving of evaluation results. Moreover, the framework generates data in machine-processable format, allowing for the efficient querying and post-processing of evaluation results. Finally, the tool diagnostics provided by GERBIL allows deriving insights pertaining to the areas in which tools should be further refined, thus allowing developers to create an informed agenda for extensions and end users to detect the right tools for their purposes. GERBIL aims to become a focal point for the state of the art, driving the research agenda of the community by presenting comparable objective evaluation results.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Survey on Aspect-Level Sentiment Analysis
Kim Schouten,Flavius Frasincar +1 more
TL;DR: An in-depth overview of the current state-of-the-art of aspect-level sentiment analysis is given, showing the tremendous progress that has been made in finding both the target, which can be an entity as such, or some aspect of it, and the corresponding sentiment.
811
TabEL: Entity Linking in Web Tables
Chandra Bhagavatula,Thanapon Noraset,Doug Downey +2 more
- 11 Oct 2015
TL;DR: TabEL differs from previous work by weakening the assumption that the semantics of a table can be mapped to pre-defined types and relations found in the target KB, and enforces soft constraints in the form of a graphical model that assigns higher likelihood to sets of entities that tend to co-occur in Wikipedia documents and tables.
Information extraction meets the semantic web: a survey
TL;DR: Millennium Institute for Foundational Research on Data (IMFD) Comision Nacional de Investigacion Cientifica y Tecnologica (CONICYT), CONICyT FONDECYT: 1181896
222
Named Entity Extraction for Knowledge Graphs: A Literature Overview
TL;DR: The paper presents an overview of recent advances in this area, covering: Named Entity Recognition (NER), Named Entity Disambiguation (NED), and Named Entity Linking (NEL), and observes that NEL has recently moved from being stepwise and isolated into an integrated process along two dimensions.
Robust named entity disambiguation with random walks
Zhaochen Guo,Denilson Barbosa +1 more
TL;DR: This article presents two novel approaches guided by a natural notion of semantic similarity for the collective disambiguation of all entities mentioned in a document at the same time based on learning-to-rank.
190
References
WordNet : an electronic lexical database
TL;DR: The lexical database: nouns in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
14.4K
Introduction to the CoNLL-2003 shared task: language-independent named entity recognition
Erik Tjong Kim Sang,Fien De Meulder +1 more
- 31 May 2003
TL;DR: The CoNLL-2003 shared task on NER as mentioned in this paper was the first NER task with language-independent named entity recognition (NER) data sets and evaluation method, and a general overview of the systems that participated in the task and their performance.
BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network
TL;DR: An automatic approach to the construction of BabelNet, a very large, wide-coverage multilingual semantic network, key to this approach is the integration of lexicographic and encyclopedic knowledge from WordNet and Wikipedia.
1.8K
Reproducible Research in Computational Science
TL;DR: This work states that reproducibility has the potential to serve as a minimum standard for judging scientific claims when full independent replication of a study is not possible.
Learning to link with wikipedia
David Milne,Ian H. Witten +1 more
- 26 Oct 2008
TL;DR: This paper explains how machine learning can be used to identify significant terms within unstructured text, and enrich it with links to the appropriate Wikipedia articles, and performs very well, with recall and precision of almost 75%.