Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive direct manipulation of objects with a 3D volumetric display. Motion tracking of the user's fingers provides for direct gestural interaction with the virtual objects, through manipulations on and around the display's hemispheric enclosure. Our techniques leverage the unique features of volumetric displays, including a 360° viewing volume that enables manipulation from any viewpoint around the display, as well as natural and accurate perception of true depth information in the displayed 3D scene. We demonstrate our techniques within a prototype 3D geometric model building application.

Multi-Finger Gestural Interaction with 3D Volumetric Displays

Bare hand interaction (BHI) allows users to use their hands and fingers to interact with digital content without any attached devices or accessories. For BHI to realize widespread adoption, interaction techniques for fundamental operations, like grasp-and-release, need to be identified and optimized. This paper presents a controlled usability evaluation of four common visual feedback techniques in grasp-and-release tasks using bare hand interaction (BHI). The techniques are ‘object coloring,’ ‘connecting line,’ ‘shadow’ and ‘object halo.’ The usability was examined in terms of task time, accuracy, errors and user satisfaction. A software test bed was developed for two interface configurations: using the Leap Motion controller alone (desktop configuration) and using the Leap with Oculus Rift (virtual reality (VR) configuration). Participants (n 32) performed four trials × five feedback techniques × two UI (user interface) configurations, i.e., a total of 1280 trials. The results can be summarized into: (a) user performance is significantly better in the VR configuration compared to the desktop; (b) coloring techniques for visual feedback (‘object coloring’ and ‘object halo’) are more usable than ‘connecting line’ regardless of UI; (c) in the VR, coloring techniques remain more usable, while in the desktop interface the ‘shadow’ technique is also usable and preferred by users, (d) the ‘connecting line’ technique often distracts users from grasp-and-release tasks on static targets. (e) Some visual feedback is always preferred by users than none in both VR and desktop. We discuss these findings in terms of design recommendations for bare hands interactions that involve grasp-and-release tasks.

Evaluation of visual feedback techniques for virtual grasping with bare hands using Leap Motion and Oculus Rift

A significant increase in multi-touch interactions is notable with the expanded use of smartphones, tablets, and tabletops. Multi-touch systems are software that uses the user's fingers to perform some action. These systems need evaluation before being available in the market to improve the interaction and general user experience. In this context, User eXperience (UX) and Usability are relevant criteria related to multi-touch systems quality. Therefore, we performed a Systematic Mapping Study (SMS) seeking to identify evaluation technologies used by professionals and researchers to evaluate the aspects of Usability and UX in multi-touch systems. After the selection process, 65 out of 622 identified papers were selected for data extraction. As a result, 29 different evaluation technologies were identified. Besides, we also obtained characteristics of these technologies, empirical studies, and the multi-touch systems presented in the papers. Our study shows a lack of evaluation technologies focused on the multi-touch context; most do not evaluate Usability and UX concepts jointly; none go under an empirical evaluation since researchers tend to create their technologies to assess their aspects. This SMS presents data about the evaluation technologies extracted and the gaps found over the researched topic, contributing to the scientific and industrial community that evaluates the Usability and UX of multi-touch systems.

A systematic mapping study on usability and user eXperience evaluation of multi-touch systems

Each software context has its specificities. One specfic type of context is the multi-touch, where two or more touches are recognized by the software at the same time. Still in this context, User eXperience (UX) and Usability are relevant criteria related to multi-touch systems quality, and evaluation technologies are used to assess this quality. But which are these technologies? This is the central question that the Systematic Mapping Study (SMS) seeks to answer. Besides this question, another 18 sub-questions were addressed to find out more about the peculiarities of the technologies and how they can affect the state of the art of evaluating multi-touch systems. This SMS returned 622 papers, which were analyzed using two filters. Finally, 65 papers had their data extracted through the 18 sub-questions. These extractions raised information such as the software used, data collection methods, and aspects evaluated by the technologies. Through these data, we noticed an absence of technologies explicitly built for the multi-touch context. Other gaps were also perceived, such as the need for technologies that jointly assess quantitative and qualitative data; and technologies that focus on jointly evaluating Usability and UX. Perceiving the lack of synthesized content and characteristics about the questionnaires, we also performed a benchmark over the questionnaires identified in the SMS to serve as a future guide when applicators must choose the better technology for their context. 

Usability and User Experience of Multi-touch Systems: A Systematic Mapping Study and Benchmark

This study investigated whether the audio-visual spatial design could improve and how it improved the user experience of bare-hand interaction (BHI) in virtual reality (VR), by adjusting spatial audio accordingly (no sound, audiovisual spatial congruency, audio-visual spatial in congruency). We asked 32 participants to complete the grasping task in two interaction scenarios with three audio-visual spatial conditions. We evaluated the user experience in terms of both intrinsic cognitive load and usability through four metrics: subjective cognitive load scores, HbO2 data in the corresponding brain regions, task time, and user satisfaction. The results showed that in near range interaction, although there was no significant difference between audio-visual spatial in congruency and congruency in terms of cognitive load and usability, they both significantly improved the user experience compared to the no sound group. In distant range interaction, audio-visual spatial in congruency significantly reduced the cognitive load and increased usability, thus improving the user experience. 

The Effect of Audiovisual Spatial Design on User Experience of Bare-Hand Interaction in VR

Playing toy blocks can greatly help children develop various abilities such as spatial, mathematical, creative problem solving etc. Developing a computer-aided block building system would benefit a lot in recreational and educational applications. Providing a natural user interface to increase the user’s sense of immersion is very important for the success of such kind system. In this paper, we develop a virtual toy block assembly system targeting on children’s preschool education. With the help of leap motion controller, child only need to make various hand gestures to play toy blocks similar to how they do in real scenario. A block snapping interface is designed to help quickly place block at the appropriate position. Our system demonstrate great potential in education area.

Learning to Assemble Building Blocks with a Leap Motion Controller

Image composition is a basic process in digital image editing. Its objective is to enable convenient image object copy-and-paste to generate new images which look natural and realistic. Seamless image composition systems often require users to successively choose a rough region of the inserted object and the target location for automatic which is rather tedious for using 2D input devices like mouse. We propose a new system that efficiently combines direct multi-touch interaction with seamless image composition. In sharp contrast to previous interfaces, we develop a family of multi-touch gestures, allowing users to simultaneously operate multiple inserted objects and also to interactively edit and tune inserted objects positions and geometry. Experiments show that our system not only brings novel painting experience to users but also provides a practical and effective tool for inserted objects design.

A multi-touch interface for natural and seamless image composition

File retrieval is a frequently adopted primitive operation for most computer users. As the dominant way for file retrieval, file navigation is yet quite inefficient. Lots Efforts have been made to either enhance the navigation interface or provide alternative. However, they all suffer from the challenge of switching users from their preferred interface to a totally unfamiliar new one. In this paper, we try to avoid such switch by incorporating multi-touch interface into file navigation. We provide a rich set of gestures to support various navigation actions. The natural and comfortable manner of multi-touch can help user to get started much more easily.

A multi-touch based file navigation interface

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Wei Yang

Author Tools

Chat about Author

Papers

Learning to Assemble Building Blocks with a Leap Motion Controller

A multi-touch interface for natural and seamless image composition

A multi-touch based file navigation interface