Organic user interface

Abstract: We introduce the term shape resolution, which adds to the existing definitions of screen and touch resolution. We propose a framework, based on a geometric model (Non-Uniform Rational B-splines), which defines a metric for shape resolution in ten features. We illustrate it by comparing the current related work of shape changing devices. We then propose the concept of Morphees that are self-actuated flexible mobile devices adapting their shapes on their own to the context of use in order to offer better affordances. For instance, when a game is launched, the mobile device morphs into a console-like shape by curling two opposite edges to be better grasped with two hands. We then create preliminary prototypes of Morphees in order to explore six different building strategies using advanced shape changing materials (dielectric electro active polymers and shape memory alloys). By comparing the shape resolution of our prototypes, we generate insights to help designers toward creating high shape resolution Morphees.

Abstract: This paper presents Foldable User Interfaces (FUI), a combination of a 3D GUI with windows imbued with the physics of paper, and Foldable Input Devices (FIDs) FIDs are sheets of paper that allow realistic transformations of graphical sheets in the FUI Foldable input devices are made out of construction paper augmented with IR reflectors, and tracked by computer vision Window sheets can be picked up and flexed with simple movements and deformations of the FID FIDs allow a diverse lexicon of one-handed and two-handed interaction techniques, including folding, bending, flipping and stacking We show how these can be used to ease the creation of simple 3D models, but also for tasks such as page navigation

Abstract: Over the past few years, there has been a quiet revolution in display manufacturing technology. One that is only comparable in scope to that of the invention of the first LCD, which led to DynaBook and the modern laptop. E-ink electrophoretic pixel technology, combined with advances in organic thin-film circuit substrates, have led to displays that are so thin and flexible they are beginning to resemble paper. Soon displays will completely mimic the high contrast, low power consumption and flexibility of printed media. As with the invention of the first LCD, this means we are on the brink of a new paradigm in computer user interface design: one in which computers can have any organic form or shape. One where any object, no matter how complex, dynamic or flexible its structure, may display information. One where the deformation of shape is a main source of input. This new paradigm of Organic User Interface (Oui!) requires a new set of design guidelines, which I will discuss in this presentation. These guidelines were inspired by architecture, which went through a similar transformation decades ago. In Oui! The Input Device Is The Output Device (TIDISTOD), Form dynamically follows Flow of activities of the human body, and Function equals Form. I will give an overview of technologies that led to Organic UI, such as Tangible UI and Digital Desks, after which I will discuss some of the first real Oui! interfaces, which include Gummi and PaperWindows. PaperWindows, which was developed at HML, is the first real paper computer. It uses computer vision to track sheets of real paper in real time. Page shape is modeled in 3D, textured with windows and projected back onto the paper, making for a wireless hi-res flexible color display. Interactions with PaperWindows take place through hand gestures and paper folding techniques.

Abstract: Bend gestures have a large number of degrees of freedom and therefore offer a rich interaction language. We propose a classification scheme for bend gestures, and explore how users perform these bend gestures along four classification criterion: location, direction, size, and angle. We collected 36 unique bend gestures performed three times by each participant. The results suggest a strong agreement among participants for preferences of location and direction. Size and angle were difficult for users to differentiate. Finally, users performed and perceived two distinct levels of magnitude. We propose recommendations for designing bend gestures with flexible displays.