TL;DR: This work proposes to masquerade the core tasks of weaving the Semantic Web behind online, multi-player game scenarios, in order to create proper incentives for human users to get involved.
Abstract: Most of the challenges faced when building the Semantic Web require a substantial amount of human labor and intelligence. Despite significant advancement in ontology learning and human language technology, the tasks of ontology construction, semantic annotation, and establishing alignments between multiple ontologies remain highly dependent on human intelligence. This means that individuals need to contribute time and sometimes other resources. Unfortunately, we observe a serious lack of user involvement in the aforementioned tasks, which may be due to the absence of motivations for people who contribute. As a novel solution, we (1) propose to masquerade the core tasks of weaving the Semantic Web behind online, multi-player game scenarios, in order to create proper incentives for human users to get involved. Doing so, we adopt the findings from the already famous "games with a purpose" by von Ahn, who has shown that presenting a useful task, which requires human intelligence, in the form of an online game can motivate a large amount of people to work heavily on this task, and this for free. Then, we (2) describe our generic OntoGame platform, and (3) several gaming scenarios for various tasks plus our respective prototypes. Based on the analysis of user data and interviews with players, we provide preliminary evidence that users (4) enjoy the games and are willing to dedicate their time to those games, (5) are able to produce high-quality conceptual choices. Eventually we show how users entertaining themselves by online games can unknowingly help weave and maintain the Semantic Web.
TL;DR: SpotTheLink is presented, the latest release of the OntoGame framework, which allows for the definition of mappings between Semantic Web ontologies as part of a collaborative game experience, and the game background mechanics by which players’ inputs are translated into SKOS-based ontology mappings.
Abstract: The interoperability of data depends on the availability of alignments among different ontologies. Various approaches to match, merge and integrate ontologies and, more recently, to interlink RDF data sets were developed over. Even though the research area has matured, the full automation of the ontology alignment process is not feasible and the human user is indispensable. Such tasks involve mainly bootstrapping the underlying methods and for validating and enhancing their results. The question of acquiring such input still remains to be solved, in particular when it comes to the motivators and incentives that are likely to make people dedicate labor to ontology alignment tasks. In this paper we build on previous work of ours on using casual games to tackle this problem. We present SpotTheLink, the latest release of the OntoGame framework, which allows for the definition of mappings between Semantic Web ontologies as part of a collaborative game experience.We illustrate the idea of SpotTheLink in an instance of the game aiming to align DBpedia and PROTON, and explain the game background mechanics by which players’ inputs are translated into SKOS-based ontology mappings. A summary of findings of SpotTheLink user evaluation and the experiences we gained throughout the entire life span of OntoGame allow us to derive a number of best practices and guidelines for the design of incentives-minded semantic-content-authoring technology, in which human and computational intelligence are smoothly interwoven.
TL;DR: This work proposes to masquerade collaborative ontology engineering behind on-line, multi-player game scenarios, in order to create proper incentives for humans to help building ontologies for the Semantic Web.
Abstract: Despite significant advancement in ontology learning, building ontologies remains a task that highly depends on human intelligence, both as a source of domain expertise and for producing a consensual conceptualization. This means that individuals need to contribute time, and sometimes other resources, to an ontology project. Now, we can observe a sharp contrast in user interest in two branches of Web activity: While the "Web 2.0" movement lives from an unprecedented amount of contributions from Web users, we witness a substantial lack of user involvement in ontology projects for the Semantic Web. We assume that one cause of the latter is a lack of proper incentive structures of ontology projects, i.e., settings in which the perceived benefits outweigh the efforts for people to contribute.
As a novel solution, we (1) propose to masquerade collaborative ontology engineering behind on-line, multi-player game scenarios, in order to create proper incentives for humans to help building ontologies for the Semantic Web. Doing so, we adopt the findings from the already famous "games with a purpose" by von Ahn, who has shown that pres-enting a useful task, which requires human intelligence, in the form of an on-line game can motivate a large amount of people to work heavily on this task, and this for free. Then, we (2) describe our OntoGame prototype, and (3) prov-ide preliminary evidence that users are willing to invest a lot of time into those games, and, by doing so, unknowingly weave ontologies for the Semantic Web.
TL;DR: This paper presents the newest release of the OntoGame series, called SpotTheLink, which addresses the challenge in the area of ontology alignment.
Abstract: A large share of tasks in semantic-content authoring crucially rely on human intelligence [4]. This holds for many aspects of ontology engineering, but also for ontology-based annotation, be that for data-oriented resources, such as images, audio and video content, or for functionality, such as Web services and APIs. In previous work of ours we have extensively discussed the importance of motivators and incentive mechanisms to encourage a critical mass of Internet users - in particular, users beyond the boundaries of the semantic-technologies community - to contribute to such inherently human-driven tasks. Through OntoGame we have provided a framework for casual games which capitalizes on fun and competition as two key motivators for people to willingly invest their valuable time and effort in semantic-technologies-related tasks, whose technical details hide behind an entertaining collaboratively game experience [2]. This paper presents the newest release of the OntoGame series, called SpotTheLink, which addresses this challenge in the area of ontology alignment.
TL;DR: The SeaFish game and demo, a game for collaborative image annotation and interlinking without text, is outlined in this paper and is published as Linked Data on the Web.
Abstract: Many tasks in semantic content creation, from building and aligning vocabularies to annotation or data interlinking, still require human intervention. Even though automatic methods addressing the aforementioned challenges have reached a certain level of maturity, user input is still required at many ends of these processes. The idea of human computation is to rely on the human user for problems that are impossible to solve for computers. However, users need clear incentives in order to dedicate their time and manual labor to tasks. The OntoGame series uses games to hide abstract tasks behind entertaining user interfaces and gaming experiences in order to collect knowledge. SeaFish is a game for collaborative image annotation and interlinking without text. In this latest release of the OntoGame series, players have to select images that are related to a concept that is represented by an image (from DBpedia) from a collection of images (produced by querying flickrTMwrappr with the respective concept). The data collected by SeaFish is published as Linked Data on the Web. In this paper we outline the SeaFish game and demo.