Abstract: This paper explores a user interface technique which augments an immersive head tracked display with a hand-held miniature copy of the virtual environment We call this interface technique the Worlds in Miniature (WIM) metaphor By establishing a direct relationship between life-size objects in the virtual world and miniature objects in the WIM, we can use the WIM as a tool for manipulating objects in the virtual environment In addition to describing object manipulation, this paper explores ways in which Worlds in Miniature can act as a single unifying metaphor for such application independent interaction techniques as object selection, navigation, path planning, and visualization The WIM metaphor naturally offers multiple points of view and multiple scales at which the user can operate, all without requiring explicit modes or commands Informal user observation indicates that users adapt to the Worlds in Miniature metaphor quickly and that physical props are helpful in manipulating the WIM and other objects in the environment

Abstract: Partial table of contents: Work Processes: Scenarios as a Preliminary Vocabulary (K. Kuutti). Creating Contexts for Design (M. Kyng). Scenario Use in the Design of a Speech Recognition System (J. Karat). Usage Representations for Reuse of Design Insights: A Case Study of Access to On-Line Books (T. Carey & M. Rusli). Design Space Analysis and Use Representations (A. MacLean & D. McKerlie). Rapid Prototyping of User Interfaces Driven by Task Models (P. Johnson, et al.). Generating Object-Oriented Design Representations via Scenario Queries (S. Robertson). The Use-Case Construct in Object-Oriented Software Engineering (I. Jacobson). Discussion: Scenarios as Engines of Design (R. Mack). Some Reflections on Scenarios (B. Nardi). Index.

Abstract: An interactive network provides music to subscribers. A "more like" function allows a subscriber to use a seed song to identify other songs that are similar to the seed song, and to add the new songs to the current playlist. The similarity between songs is based on the subjective content of the songs, as reflected in style tables prepared by editors. The subscriber may control the closeness of the match by adjusting a style slider provided by the user interface. A style equalizer employs eight faders that indicate the predominant styles of the songs in the playlist. A subscriber may use the style equalizer to see what types of songs are included in the playlist, and to adjust the mix of songs that are played from the playlist.

Abstract: Current interactive user interface construction tools are often more of a hindrance than a benefit during the early stages of user interface design. These tools take too much time to use and force designers to specify more of the design details than they wish to at this early stage. Most interface designers, especially those who have a background in graphic design, prefer to sketch early interface ideas on paper or on a white-board. We are developing an interactive tool that allows designers to quickly sketch an interface using an electronic pad and stylus. Our tool preserves the important properties of paper: A rough drawing can be produced very quickly and the medium is very flexible. However, unlike a paper sketch this electronic sketch can easily be exercised and modified. In addition, our system allows designers to examine, annotate, and edit a complete history of the design. When the designer is satisfied with this early prototype, the system can transform the sketch into a complete, finished interface in a specified look-and-feel. This transformation takes place with the guidance of the designer. By supporting the early design phases of the software life-cycle, our tool should both ease the prototyping of user interfaces and improve the speed with which a final interface can be created.

Abstract: While a large fraction of application code is devoted to graphical user interface (GUI) functions, support for reuse in this domain has largely been confined to the creation of GUI toolkits ("widgets"). We present a novel architectural style directed at supporting larger grain reuse and flexible system composition. Moreover, the style supports design of distributed, concurrent applications. Asynchronous notification messages and asynchronous request messages are the sole basis for intercomponent communication. A key aspect of the style is that components are not built with any dependencies on what typically would be considered lower-level components, such as user interface toolkits. Indeed, all components are oblivious to the existence of any components to which notification messages are sent. While our focus has been on applications involving graphical user interfaces, the style has the potential for broader applicability. Several trial applications using the style are described.

Abstract: An apparatus and a method for an improved user interface for communicating with implantable medical devices are described. An integrated digitizer display screen and a digitizer pen serve as the primary input devices to a tablet computer adapted to receive real-time and stored medical data. The pen is used to select programming options by tapping portions of the digitizer based on visual images on the display. Additionally, the pen may be used to manipulate the medical data through the use of gestures, or be used to enter free form annotations concerning the medical data. An additional aspect of the user interface is the use of a questionnaire card to input information into the tablet computer by tapping the pen on the marked answers on the questionnaire card.

Abstract: A practical system and method for the remote distribution of financial services (e.g., home banking and bill-paying) involves distributing portable terminals to a user base. The terminals include a multi-line display, keys "pointing to" lines on the display, and additional keys. Contact is established between the terminals and a central computer operated by a service provider, preferably over a dial-up telephone line and a packet data network. Information exchange between the central computer and the terminal solicits information from the terminal user related to requested financial services (e.g., for billpaying, the user provides payee selection and amount and his bank account PIN number). The central computer then transmits a message over a conventional ATM network debiting the user's bank account in real time, and may pay the specified payees the specified amount electronically or in other ways as appropriate. Payments and transfers may be scheduled in advance or on a periodic basis. Because the central computer interacts with the user's bank as a standard POS or ATM network node, no significant software changes are required at the banks' computers. The terminal interface is extremely user-friendly and incorporates some features of standard ATM user interfaces so as to reduce new user anxiety.

Abstract: A system and method for providing a tactile virtual reality to a user is present. The position and orientation of the user is utilized to generate a virtual reality force field. Forces are in turn generated on the user as a function of this force field. A six-axis manipulator is presented for providing a user interface to such a system. This manipulator provides a unique kinematic structure with two constant force springs which provide gravity compensation so that the manipulator effectively floats.

Abstract: The system of the present invention provides actual interactive choices to members of an audience in the form of three dimensional (3D) objects in space, and after each member of the audience reaches out at, points at, or looks at the 3D object of choice, the system responds and alters the audio and/or video feedback to each member. Specifically, a 3D video production is presented on a screen and at several points during the presentation a character or person, appearing on the screen, requests each user to respond to a question by physically selecting one of several possible 3D objects, the 3D objects appearing through the 3D effect to be floating directly in front of each user. The 3D answer options could be three 3D characters, for example. Selection of one of these objects is facilitated through a unique user interface unit, embodied in either a helmet, gun, or wand configuration. Each of these alternative user interface units allow the interactive selection to be made by physical gestures. The user interface unit is comprised of a detection device, a processor and associated circuitry, and attached headphones. Immediately upon making a selection, the user interface unit determines the choice made by the user, matches the choice with a distinct prerecorded audio feedback response, and presents to the user a distinct and individualized audio response. These personalized feedback responses are seamlessly communicated to each user through a set of headphones, and thus, amount to minimally perceived alterations from the common audio presentation. Interactive realism is enhanced through the preferred lip synching of the audio feedback response to the video character's mouth movements.

Abstract: A method and apparatus for storing and retrieving images of documents, e.g. checks. The method comprises placing a plurality of documents in a document imaging machine and forming an electronic image of each document, storing each electronic image in an electronic storage device, providing at least one user interface device in communication on a communication link with the electronic storage device, placing a request for at least one document image on the user interface device, transmitting the request by the communication link to the electronic storage device, searching the electronic storage device for the requested electronic image of the document, retrieving the at least one electronic image or providing an indication that the image was not found, storing the electronic image, if found, in an electronic file, for transmission to the user interface device at user option, providing the electronic image to the user interface device at command of a user at the user interface device for storage at the user interface device and displaying the requested electronic image on a display of the user interface device. Preferably, the electronic, images are stored with embedded identifying information in a TIFF file format and the check images can be displayed on a display device which permits the user to view both sides of the checks simultaneously and perform functions such as zooming and rotation of the images.

Abstract: Publisher Summary This chapter describes the way in which usable systems can be designed. Usability is a combination of many factors, each of which is often developed independently. User-interface code is becoming an increasingly large percentage of the total system code. Standards are beginning to emerge for user interface design. Establishing standards for software aspects of the user interface is probably premature. There are lots of guidelines for a good system design. However, these are not enough for the design of good systems. One should at the beginning and throughout development focus on prospective users and their work. It is often heard that people buy computer systems for the functions in them. One is unlikely to figure out what the functions should be without talking with users. One should continuously measure each aspect of usability, and then iterate in a hill-climbing way toward a better system. All aspects of usability should begin evolving from the beginning and should be under one focus.

Abstract: An improved information retrieval system user interface for retrieving information from a plurality of sources and for storing information source descriptions in a knowledge base. The user interface includes a hypertext browser and a knowledge base browser/editor. The hypertext browser allows a user to browse an unstructured information space through the use of interactive hypertext links. The knowledge base browser/editor displays a directed graph representing a generalization taxonomy of the knowledge base, with the nodes representing concepts and edges representing relationships between concepts. The system allows users to store information source descriptions in the knowledge base via graphical pointing means. By dragging an iconic representation of an information source from the hypertext browser to a node in the directed graph, the system will store an information source description object in the knowledge base. The knowledge base browser/editor is also used to browse the information source descriptions previously stored in the knowledge base. The result of such browsing is an interactive list of information source descriptions which may be used to retrieve documents into the hypertext browser. The system also allows for querying a structured information source and using query results to focus the hypertext browser on the most relevant unstructured data sources.

Abstract: A viewer interface is disclosed for use in an interactive television network operative for providing an animated focus item in association with a control item to indicate that the control item is in a state responsive to commands from a user input device. An "animation" is any form of highlighting that is non-static, including but not limited to flashing, varying illumination, varying size, varying shape, varying position, varying color, varying display components, a moving and/or changing cartoon type image, a video image, a sound track, or a combination of these elements. Selection of the control item to receive focus and selection of options presented by control items having focus are accomplished by viewer interaction with the remote control unit, and such selections do not require a keyboard or mouse to indicate the viewer's desire to change the focus from one control item to another or to select an option. The user interface is also suitable for use in a general computing environment as well as in an interactive television environment.

Abstract: The paper describes a system for the solution of a static dial-a-ride routing and scheduling problem with time windows (DARPTW). The problem statement and initialization of the development project was made by the Copenhagen Fire-Fighting Service (CFFS). The CFFS needed a new system for scheduling elderly and disabled persons, involving about 50.000 requests per year. The problem is characterized by, among other things, multiple capacities and multiple objectives. The capacities refer to the fact that a vehicle may be equipped with e.g. normal seats, children seats or wheel chair places. The objectives relate to a number of concerns such as e.g. short driving time, high vehicle utilization or low costs. A solution algorithm REBUS based on an insertion heuristics was developed. The algorithm permits in a flexible way weighting of the various goals such that the solution reflects the user's preferences. The algorithm is implemented in a dynamic environment intended for on-line scheduling. Thus, a new request for service is treated in less than 1 second, permitting an interactive user interface.

Abstract: A FIM system integrates data from a plurality of interconnected local databases to provide users with access to a virtual database. The FIM includes a user interface for generating a global query to search the virtual database, a smart dictionary database (SDD) that contains configuration data, a data information manager (DIM) that decomposes the global query into local queries, and a plurality of local information managers (LIMs) that execute the local queries to search for and retrieve data from the enumerated databases. A filter generates a list of those local databases that contain information relevant to the global query. As a result, the DIM only generates local queries for the enumerated local databases. An input translator converts the global query into the respective local formats for the local databases so that the FIM provides true integration of heterogeneous databases. An output translator converts the data retrieved from each local database into a uniform i/o format so that the data presented to the user is integrated. The user typically selects the i/o format as his or her local format or a global format associated with the virtual database.

Abstract: A system for the capture and playback of temporal data representing a collaborative activity such as a meeting. Such temporal data is captured by one or more capture devices (e.g. audio recordings or an electronic whiteboard). Temporal data is comprised of timestreams and events. Timestreams are sets of timestamped data which represent some recordable aspect of the meeting. Events are contained within a timestream that represent natural activities that occurred during the course of the session. Events are used to create indices which provide direct access to a point or span in time during the collaborative activity. Playback of a session is performed under the control of a session access device. Coupled to the session access device are a plurality of players for playing back timestreams. The session access device utilizes event information to create a user interface for controlling session replay. The user interface is comprised of a plurality of windows. Each window may represent a player, a playback controller or an editor.

Abstract: A method and apparatus for control of a handheld miniature personal digital assistant, based on a user interface with a menu and thumbwheel. The device consists of a microprocessor, memory, display, thumbwheel, and button. The display presents a sequence of menu items, with one such item designated as tentatively selected by displaying it in reverse video. Rotating the thumbwheel results in moving the designation of an item in the menu, while pressing the button selects an item. The thumbwheel itself can serve as the button if it is pressed rather than rotated. The use of complex menus that display items in two dimensions allows the use of sophisticated applications, including those that require the entry of alphanumeric data, such as a telephone and address directory and datebook. The approach makes such applications feasible in a credit-card-sized package; without the necessity of a keyboard, allowing most of the surface area of the package to be devoted to a display.

Abstract: In a computer system, an improved tool and method for debugging complex computer programs is disclosed. The tool extracts critical debugging information from computer memory and/or remote storage memory and uses this information to graphically depict call relationships among various functions comprising the program which is the subject of the debugging operation. Debug commands are accepted by the tool through a graphical user interface using operations performed by the user directly on the graphical representation of program functions. The ability of the tool to accept user commands through the graphical user interface and to display critical debugging information using this same interface greatly facilitates program debugging.

Abstract: Disclosed herein is an interactive entertainment distribution network including a headend which is connected to provide programs to a plurality of user interface units in individual homes. The user interface units are configured to run electronic program guides for displaying available programs categorized by discrete time slots. Each of the programs has a scheduled time period which occupies at least a portion of one or more of the discrete time slots. The headend maintains a database with a plurality of program data records. Each program data record is indexed by one of a plurality of bucket numbers. The bucket numbers correspond respectively to the plurality of discrete time slots. Each particular program is represented by a program data record and associated bucket number for each of the one or more discrete time slots which the program occupies. The electronic program guide requests programming information from the headend by specifying one or more bucket numbers to the headend.

Abstract: The Garnet research project, which is creating a set of tools to aid the design and implementation of highly interactive, graphical, direct-manipulation user interfaces, is discussed. Garnet also helps designers rapidly develop prototypes for different interfaces and explore various user-interface metaphors during early product design. It emphasizes easy specification of object behavior, often by demonstration and without programming. Garnet contains a number of different components grouped into two layers. The Garnet Toolkit (the lower layer) supplies the object-oriented graphics system and constraints, a set of techniques for specifying the objects' interactive behavior in response to the input devices, and a collection of interaction techniques. On top of the Garnet Toolkit layer are a number of tools to make creating user interfaces easier. The components of both layers are described. >

Abstract: The problem of human-computer interaction can be viewed as two powerful information processors (human and computer) attempting to communicate with each other via a narrow-bandwidth, highly constrained interface (Tufte, 1989). To address it, we seek faster, more natural, and more convenient means for users and computers to exchange information. The user’s side is constrained by the nature of human communication organs and abilities; the computer’s is constrained only by input/output devices and interaction techniques that we can invent. Current technology has been stronger in the computer-to-user direction than the user-to-computer, hence today’s user-computer dialogues are rather one-sided, with the bandwidth from the computer to the user far greater than that from user to computer. Using eye movements as a user-to-computer communication medium can help redress this imbalance. This chapter describes the relevant characteristics of the human eye, eye-tracking technology, how to design interaction techniques that incorporate eye movements into the user-computer dialogue in a convenient and natural way, and the relationship between eye-movement interfaces and virtual environments. As with other areas of research and design in human-computer interaction, it is helpful to build on the equipment and skills humans have acquired through evolution and experience and search for ways to apply them to communicating with a computer. Direct manipulation interfaces have enjoyed great success largely because they draw on analogies to existing human skills (pointing, grabbing, moving objects in space), rather than trained behaviors. Similarly, we try to make use of natural eye movements in designing interaction techniques for the eye. Because eye movements are so different from conventional computer inputs, our overall approach in designing interaction techniques is, wherever possible, to obtain information from a user’s natural eye movements while viewing the screen, rather than requiring the user to make specific trained eye movements to actuate the system. This requires careful attention to issues of human design, as will any successful work in virtual environments. The goal is for human-computer interaction to start with studies of the characteristics of human communication channels and skills and then develop devices, interaction techniques, and interfaces that communicate effectively to and from those channels.

Abstract: An interactive trade network is described that integrates distributive messaging using a host computer and telecommunication networks, real-time interactive communications, a hierarchical knowledge matrix containing two familiar and comprehensive indices of classes of goods and classes of establishments and a legend of trade-related, cross-reference terms or parameters, a multiline programmable application, an integrated application program interface, and integrated application programs. The Host System uses each Index Number of each of the indices as a topic board name. The apparatus creates a highly-selective media for either (a) messaging on mutually exclusive indexed topics of trade or (b) engaging in pubic or private real-time conferencing or electronic mail dedicated to any class of indexed economic activity. It enables progressive discussions on, and the retrieval of just the information needed under, discrete indexed topics on trade instantaneously. The interface typically facilitates access to one of thousands of topic boards upon input for, or interpreted to, three key strokes in the selector process. Users may review, broadcast, post or "chain" messages to one party or multiple parties, whether known or anonymous. Messages are cross-referenceable by geographic codes, time and other alpha-numeric descriptors.

Abstract: A random access animation user interface environment referred to as interFACE enabling a user to create and control animated lip-synchronized images or objects utilizing a personal computer for use in the users programs and products. A real-time random-access interface driver (RAVE) together with a descriptive authoring language (RAVEL) is used to provide synthesized actors ("synactors"). The synactors may represent real or imaginary persons or animated characters, objects or scenes. The synactors may be created and programmed to perform actions including speech which are not sequentially pre-stored records of previously enacted events. Furthermore, animation and sound synchronization may be produced automatically and in real-time. Sounds and visual images of a real or imaginary person or animated character associated with those sounds are input to a system and may be decomposed into constituent parts to produce fragmentary images and sounds. A set of characteristics is utilized to define a digital model of the motions and sounds of a particular synactor. The general purpose system is provided for random access and display of synactor images on a frame-by-frame basis, which is organized and synchronized with sound. Both synthetic speech and digitized recording may provide the speech for synactors.

Abstract: A system for controlling the playback of a recorded session utilizing a window acting as a player for playing back a timestream for a shared representation media, such as an electronic whiteboard. Timestream and event information for the session is captured by one or more recording devices. Playback of a session is performed under the control of a session access device which utilizes event information to create a user interface for controlling session replay. The user interface includes the window for playing back the timestream of a shared representation media. Each graphical object in the window is associated with one or more events (e.g. a creation event, an editing event, a move event or a deletion event). Selection of a graphical object enables playback time to be moved to the time for one of the associated events. Selection may also be made on an area of the window. This will enable the user to view all events related to graphical objects in the selected area (as some graphical objects may be erased or moved).

Abstract: A video conference platform includes a graphical user interface for configuration and control of a video conference. In particular, the graphical user interface allows for "windows" type operations to control various aspects of the video conference, including initial configuration, camera control, and data transmission.

Abstract: A digital replacement for an analog audio tape recorder can record audio programming digitally in a faster than real time format and can play back audio programming, where such programming has been digitized and stored in data files using a variety of compression/decompression algorithms. Audio programming is stored digitally on a non-volatile medium, such as a hard drive, or in a flash EPROM, or other solid state non-volatile memory. The device includes a hard drive, a modem for connection to a data base via an on-line service, a keyboard, a display, and an audio system. The device uniquely combines the remote data access capability resident in a personal computer with a set of tailored, streamlined control functions to simplify, automate, and render seamless the process of selecting audio program material; ordering the program material from a service; receiving acknowledgment of the order and receiving the program material via automatic download for storage in a hard drive; playback of the program material when and where the user desires, with fully streamlined control functions; and control of the user interface functionality on the keyboard through a setup mode of operation.

Abstract: A message driven processor (450) operates as middleware between clients (400) and back-end hosts or servers (440) in a large client-server system to reduce the number of concurrent sessions required to be supported by the network and to allow a common client user interface to divergent back-end systems. High level requests from a client (400) in support of a business function are translated into workflows which may involve multiple requests to back-end servers by the message driven processor (450). Information resulting from workflows and information retrieved from back-end servers may be integrated into a single reply message to the requesting client (400).

Abstract: A computerized data processing system includes an external data interface (6) for communicating with nonuser outside sources (14) of investment data and processing such data and delivering such data to a server (4) which processes and stores such investment data in a central databank (101). Users (22) may access the data stored in the central database which is supported by the server through an external user interface (2). The receiving, processing, creating and disseminating of data is a shared responsibility which is divided between the external user interface (2) and the server (4). Multiple users may access the server simultaneously. The preferred embodiments employ a relational database, dynamically linked libraries, and multiple compliance capabilities. The system is particularly suited for use with mutual fund portfolio management and transactional information. The system may combine investment data relating to mutual funds or portions thereof or separate portions of a single fund for purposes of transactions, portfolio management or modeling.

Abstract: A method and apparatus for providing force feedback to a user operating a human/computer interface device in conjunction with a graphical user interface (GUI) displayed by a host computer system. A physical object, such as a joystick or a mouse, controls a graphical object, such as a cursor, within the GUI. The GUI allows the user to interface with operating system functions implemented by the computer system. A signal is output from the host computer to the interface device to apply a force sensation to the physical object using one or more actuators. This desired force sensation is associated with at least one of the graphical objects and operating system functions of the graphical user interface and is determined by a location of the cursor in the GUI with respect to targets that are associated with the graphical objects. The graphical objects include icons, windows, pull-down menus and menu items, scroll bars (“sliders”), and buttons. The force sensation assists the user to select a desired operating system function or physically informs the user of the graphical objects encountered by the cursor within the GUI. A microprocessor local to the interface apparatus and separate from the host computer can be used to control forces on the physical object.