This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge of the authors; (2) the application areas that have already been transformed by the successful use of deep learning technology, such as speech recognition and computer vision; and (3) the application areas that have the potential to be impacted significantly by deep learning and that have been experiencing research growth, including natural language and text processing, information retrieval, and multimodal information processing empowered by multi-task deep learning.

/pdf/deep-learning-methods-and-applications-5cyi610sjz.pdf

Deep Learning: Methods and Applications

Exploring the Use of Eye Gaze Controlled Interfaces in Automotive Environments

Education has become a key component of any society since it is the means by which humanity functions and governs itself. It allows individuals to appropriately integrate into a given community. For this reason, new ways of interaction between students and educational contents are emerging in order to improve the quality of education. In this context, devices such as computers, smartphones, or electronic tablets represent new ways of accessing educational resources which do not limit students to their usage merely inside the classroom since these devices are available anywhere. Nowadays, television has become one of these technological tools able to support the teaching–learning process through documentary films or movies, among others. However, two main issues appear. First, some of these educational contents are not those needed by a professor since information is restricted, and second, the development of TV-based applications requires an integrative approach involving the support of several specialist...

AthenaTV: an authoring tool of educational applications for TV using android-based interface design patterns

TV service providers now offer a variety of features, including broadcast-related ones like electronic programme guides, catch-up and recording features, but also Internet access and a variety of TV applications. These new features turn TV devices into more versatile and interesting platforms, but also clog the screen with more content than ever. Since this content is mainly visual, this means that TVs have even more inaccessible content for visually impaired people. This paper presents the design of a solution that audio renders the TV application’s user interface through a mobile device. Resorting to a mix of accessibility experts and user studies, we compared multiple feedback versions containing different contextual information. Participants reported that the use of repetitive sentences should be avoided; concise feedback feels smoother and quicker but, for some, lacks information while extended feedback can be annoying and take too much time though is appropriate for learning phases. For menus, most participants suggested to include the position of an element and the number of elements. The results helped to identify the critical information to convey to the user and to tailor two modes differing in the amount of contextual information provided, suitable for differently skilled users. Additionally, we condensed the findings into a list of design guidelines which can be generalized to other auditory interfaces meant to be operated by a VI user.

Audio rendering smart TV apps through mobile devices

Researchers in computer science and
computer engineering devote a significant part of their efforts on communication
and interaction between man and machine. Indeed, with the advent of multimedia
and multimodal processing in real time, the computer is no longer considered
only as a computational tool, but as a machine for processing, communication, collection and control. Many
machines assist and support many activities in daily life. The main objective
of this paper is to propose a new methodological solution by modeling an
architecture that facilitates the work of multimodal system especially for a
fission module. To realize such systems, we rely on ontology to integrate data
semantically. Ontologies provide a structured vocabulary usedas support for
data representation. This paper provides a better understanding of the fission
system and multimodal interaction. We present our architecture and the
description of the detection of optimal modalities. This is done by using an
ontological model that contains different applicable scenarios and describes
the environment where a multimodal system exists.

/pdf/modeling-rules-fission-and-modality-selection-using-ontology-4x2gm0d876.pdf

Modeling Rules Fission and Modality Selection Using Ontology

Multimodal adaptive systems have typically been resource consuming systems, due to the requirements of processing recognition based modalities, and computing and applying adaptations based on users and context properties. In this chapter, we describe how we were able to design and implement an adaptive multimodal system, capable of performing in a resource constrained environment such as a Set-top Box. The presented approach endows standard non-adaptive, non-multimodal applications with adaptive multimodal capabilities, with limited extra effort demanded of their developers. Our approach has been deployed for Web applications, although it is applicable to other application environments. This chapter details the application interface interpretation, multimodal fusion and multimodal fission components of our framework.

Building an Adaptive Multimodal Framework for Resource Constrained Systems

Multimodal interfaces offer its users the possibility of interacting with computers, in a transparent, natural way, by means of various modalities. Fusion engines are key components in multimodal systems, responsible for combining information from different sources and extract a semantic meaning from them. This fusion process allows many modalities to be effectively used at once and therefore allowing a natural communication between user and machine. Elderly users, whom can possess several accessibility issues, can benefit greatly from this kind of interaction. By developing fusion engines that are capable of adapting, taking into account the characteristics of these users, it is possible to make multimodal systems cope with the needs of impaired users.

/pdf/adaptive-multimodal-fusion-17qjlt46k3.pdf

Adaptive multimodal fusion

The design of multimodal adaptive applications should be strongly supported by a user centred methodology. This paper presents an analysis of the results of user trials conducted with a prototype of a multimodal system in order to elicit requirements for multimodal interaction and adaptation mechanisms that are being developed in order to design a framework to support the development of accessible ICT applications. Factors related to visual and audio perception, and motor skills are considered, as well as multimodal integration patterns.

/pdf/eliciting-interaction-requirements-for-adaptive-multimodal-3svqpd1ihw.pdf

Eliciting interaction requirements for adaptive multimodal TV based applications

Outdoor activities are a major component of Social Competency Training, as part of psychotherapy, for children and teenagers. Goals such as talking to someone or visiting a specific place are set by a therapist and patients are required to complete them usually following a certain sequence. Currently, therapists are unable to control this process as the procedures are usually supported by paper artifacts and, most of the times, take place outside the office. This leads to the therapist's inability to promote collaborative efforts and to reinforce positive attitudes, affecting both the therapy process and its results.In this paper we present a software system that relies on mobile devices to support geo-referenced collaborative in-situ group therapy. We describe the concept, the system and its features and discuss future work directions.

Ubiquitous geo-referenced social skills therapy

The development of new digital TV systems and the design practices adopted in the development of new TV based applications often isolate elderly and disabled users. By considering them as users with special needs and not taking their problems into account during the design phase of an application, developers are creating new accessibility problems or just keeping bad old habits. In this paper, we describe a novel adaptive accessibility approach on how to develop accessible TV applications, by making use of multimodal interaction techniques and without requiring too much effort from the developers. By putting user-centered design techniques in practice, and supporting the use of multimodal interfaces with several input and output devices, we confront users, developers and manufactures with new interaction and design paradigms. From their evaluation, new techniques are created capable of helping in the development of accessible TV

/pdf/building-bridges-between-elderly-and-tv-application-1okchx1lpl.pdf

Building Bridges Between Elderly and TV Application Developers

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Pedro Feiteira

Author Tools

Chat about Author