What is the main reason for the flexibility of Substance?

Flexibility also stems from the data-oriented model of Substance, and in particular the ability to easily replace facets, even at run-time.

What would make SubstanceCanvas difficult to implement?

Relying solely on web technology would make SubstanceCanvas difficult to implement since the renderers would need to refetch the scene graph representation from the server on each redraw.

What is the purpose of Shared Substance2?

Shared Substance2 is a middleware and run-time environment that the authors have created to support the development of multi-surface applications.

What is the distribution model of Shared Substance?

The distributed application model of Shared Substance relies on announcing and accessing shared subtrees and their facets, and replicating and/or mounting them for remote access.

What devices can be used to share the scene graph?

Both content providers and instruments can run on any device with which the scene graph can be shared, including smartphones, laptops and tablets.

What is the technical level of Shared Substance?

At the technical level, the authors are building on SubstanceCanvas to create a GUI toolkit supporting multi-surface rendering and interaction instruments.

What is the main drawback of mounting?

One main drawback is that mounting currently does not support listening to value changes, which can be useful in a service-oriented approach.

How do they interact with the content on the wall and table?

The scientists then cooperatively manipulate, annotate and interact with the content on the wall and table in various ways: by direct touch on the table, using an iPhone or iPad whose position in the room is tracked as both a laser pointer to select content on the display surfaces and as a personal user interface to interact with that content.

What was the main drawback of the workshop?

The workshopsshowed that while developers quickly understood and took advantage of sharing, they needed more time and experience to assess the best trade-off given the limitations of their implementation.

Open AccessProceedings Article10.1145/1978942.1979446

Shared substance: developing flexible multi-surface applications

Tony Gjerlufsen, +4 more

- 07 May 2011

- pp 3383-3392

TL;DR: The finding is that the combination of a data-oriented programming model with middleware support for sharing data and functionality provides a flexible, robust solution with low viscosity at both design-time and run-time.

Abstract: This paper presents a novel middleware for developing flexible interactive multi-surface applications. Using a scenario-based approach, we identify the requirements for this type of applications. We then introduce Substance, a data-oriented framework that decouples functionality from data, and Shared Substance, a middleware implemented in Substance that provides powerful sharing abstractions. We describe our implementation of two applications with Shared Substance and discuss the insights gained from these experiments. Our finding is that the combination of a data-oriented programming model with middleware support for sharing data and functionality provides a flexible, robust solution with low viscosity at both design-time and run-time.

AI Agents for this Paper

Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps

Most frequently asked questions

1. What is the way to display the shape of objects?

As long as they include meta-data such as position, shape and dimension, their generic renderers can display the shape of the objects.

2. What workshops were held to assess the ability of developers to use the concepts effectively?

Substance and Shared Substance were developed through a series of participatory design and development workshops, where the authors assessed whether developers used to object-oriented programming would be able to use the concepts effectively.

3. What is the main purpose of the master canvas?

The master canvas provides a facet on the scene graph that instruments can use for picking, i. e. translating canvas coordinates into a reference to a graphical element.

4. What did the workshops help us identify?

The workshops also helped us identify counter-intuitive or heavy syntax, e. g., explicit declaration of path objects or explicit unpacking of events, which led to a much better integration with the host language (Python).

Figure 4. Sharing of the scene graph in SubstanceCanvas (circles are nodes and triangles are facets).

Figure 1. The WILD room: 32-monitor wall display showing 64 brain scans, multi-touch table, motion tracking system.

Figure 5. SubstanceCanvas: A) The canvas spans 32 screens and a multi-touch table. B) Interaction on the wall with a motion tracked iPod, C) Live annotation with a digital pen, D) A live window from a laptop is shared with the canvas. E) A photograph is sent to the canvas

Figure 6. SubstanceGrise: Controlling the camera on 64 different brains (left). Reordering the brains on the multi-touch table (right).

Figure 7. The environments of SubstanceGrise (circles are nodes and triangles are facets).

Figure 2. Object-orientation vs. data-orientation. In OO, data and behavior are merged into the Object, which is the primary structuring mechanism of a program. In DO, data and behavior are separated and loosely coupled. Data nodes act as the primary structuring mechanism.

Citations

•Proceedings Article•10.1145/3290605.3300792

Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices

Frederik Brudy, +6 more

- 02 May 2019

TL;DR: An analysis and taxonomy of a corpus of 510 papers in the cross-device computing domain is contributed to create a unified terminology and common understanding for researchers in order to facilitate and stimulate future cross- device research.

...read moreread less

231

•Journal Article•10.1109/MC.2012.110

Multisurface Interaction in the WILD Room

Michel Beaudouin-Lafon, +11 more

- 01 Apr 2012

- IEEE Computer

TL;DR: The WILD (wall-sized interaction with large datasets) room serves as a testbed for exploring the next generation of interactive systems by distributing interaction across diverse computing devices, enabling multiple users to easily and seamlessly create, share, and manipulate digital content.

...read moreread less

•Book Chapter•10.1007/978-3-030-01388-2_8

Collaborative immersive analytics

Mark Billinghurst, +3 more

- 18 Oct 2018

TL;DR: This chapter introduces the concept of Collaborative Immersive Analytics (CIA) and reviews how immersive technologies can be combined with Visual Analytics to facilitate co-located and remote collaboration.

...read moreread less

Proceedings Article•10.1145/2607023.2607024

XDKinect: development framework for cross-device interaction using kinect

Michael Nebeling, +3 more

- 17 Jun 2014

TL;DR: XDKinect is presented--a lightweight framework that facilitates development of cross-device applications using Kinect to mediate user interactions and features its simplicity, adaptability and extensibility based on a flexible client-server architecture.

...read moreread less

•Proceedings Article•10.1145/3313831.3376652

"In VR, everything is possible!": Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual Reality

Hans-Christian Jetter, +5 more

- 21 Apr 2020

TL;DR: Using virtual reality (VR) as a design tool for sketching and simulating spatially-aware interactive spaces and playful design explorations as key opportunities is proposed.

...read moreread less

...

Expand

References

Proceedings Article•10.1145/503209.503260

Aspect-oriented programming

Gregor Kiczales, +1 more

- 01 Sep 2001

TL;DR: This tutorial shows how to use AOP to implement crosscutting conerns in a concise modular way and includes a description of their underlying model, in terms of which a wide range of AOP languages can be understood.

...read moreread less

5.6K

Journal Article•10.1145/2363.2433

Generative communication in Linda

David Gelernter

- 02 Jan 1985

- ACM Transactions on Programming Language...

TL;DR: This work is particularly concerned with implementation of the dynamic global name space that the generative communication model requires, and its implications for systems programming in distributed settings generally and on integrated network computers in particular.

...read moreread less

2.6K

Journal Article•10.1109/4236.991449

Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDI

Francisco Curbera, +5 more

- 01 Mar 2002

- IEEE Internet Computing

TL;DR: This tutorial explores the most salient and stable specifications in each of the three major areas of the emerging Web services framework, which are the simple object access protocol, the Web Services Description Language and the Universal Description, Discovery, and Integration directory.

...read moreread less

1.5K

Journal Article•10.1145/383845.383853

Aspect-oriented programming: Introduction

Tzilla Elrad, +2 more

- 01 Oct 2001

- Communications of The ACM

TL;DR: Object-orientation brings together behavior and data into a single conceptual (and physical) entity.

...read moreread less

643

Journal Article•10.1145/306549.306582

The Jini architecture for network-centric computing

James H. Waldo

- 01 Jul 1999

- Communications of The ACM

TL;DR: Jini technology assumes a changing network, in terms of both the components that make up the network and the way these components interact, which makes it increasingly difficult to upgrade as a single entity.

...read moreread less

528

...

Expand

Shared substance: developing flexible multi-surface applications

Chat with Paper

AI Agents for this Paper

Most frequently asked questions

1. What is the way to display the shape of objects?

2. What workshops were held to assess the ability of developers to use the concepts effectively?

3. What is the main purpose of the master canvas?

4. What did the workshops help us identify?

5. What is the main reason for the flexibility of Substance?

6. What would make SubstanceCanvas difficult to implement?

7. What is the purpose of Shared Substance2?

8. What is the distribution model of Shared Substance?

9. What devices can be used to share the scene graph?

10. What is the technical level of Shared Substance?

11. What is the main drawback of mounting?

12. How do they interact with the content on the wall and table?

13. What was the main drawback of the workshop?

Figures

Citations

Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices

Multisurface Interaction in the WILD Room

Collaborative immersive analytics

XDKinect: development framework for cross-device interaction using kinect

"In VR, everything is possible!": Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual Reality

References

Aspect-oriented programming

Generative communication in Linda

Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDI

Aspect-oriented programming: Introduction

The Jini architecture for network-centric computing

Related Papers (5)

Cross-device interaction via micro-mobility and f-formations

The Computer for the 21st Century

Pick-and-drop: a direct manipulation technique for multiple computer environments

Conductor: enabling and understanding cross-device interaction

VIGO: instrumental interaction in multi-surface environments