Abstract: For courses in Human-Computer Interaction. The Sixth Edition of Designing the User Interface provides a comprehensive, authoritative, and up-to-date introduction to the dynamic field of human-computer interaction (HCI) and user experience (UX) design. This classic book has defined and charted the astonishing evolution of user interfaces for three decades. Students and professionals learn practical principles and guidelines needed to develop high quality interface designs that users can understand, predict, and control. The book covers theoretical foundations and design processes such as expert reviews and usability testing. By presenting current research andinnovations in human-computer interaction, the authors strive toinspire students, guide designers, and provoke researchers to seek solutions that improve the experiences of novice and expert users, while achieving universal usability. The authors also provide balanced presentations on controversial topics such as augmented and virtual reality, voice and natural language interfaces, and information visualization. Updates include current HCI design methods, new design examples, and totally revamped coverage of social media, search and voice interaction. Major revisions were made toEVERY chapter, changing almost every figure (170 new color figures) and substantially updating the references.

Abstract: The present invention teaches a variety of methods and systems for providing computer/human interfaces. According to one method, the user interfaces with an electronic device such as a computer system by engaging a sensor with desired regions of an encoded physical medium. The encoded physical medium is preferably chosen to provide intuitive meaning to the user, and is thus an improved metaphor for interfacing with the computer system. Suitable examples of the encoded physical medium include a data-linked book, magazine, globe, or article of clothing. Some or all of the selected regions have had certain information encoded therein, information suitable for interfacing and controlling the computer system. When the user engages the sensor with a region having certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, the sensor or the computer system may provide suitable feedback to the user. The encoded physical medium may have text and/or graphic illustrations that draw the user in or provide meaningful clues or instructions perhaps related to the encoded information. The sensor may have at least one identification number (ID) providing information such as user identity, sensor type, access type, or language type. The sensor can transmit the certain decoded information together with the at least one ID to the computer system.

Abstract: The present invention is a portable client PDA with a touch screen or other equivalent user interface and having a microphone and local central processing unit (CPU) for processing voice commands and for processing biometric data to provide user verification. The PDA also includes a memory for storing financial and personal information of the user and I/O capability for reading and writing information to various cards such as smartcards, magnetic cards, optical cards or EAROM cards. The PDA includes a Universal Card, which is common generic smartcard with a unique imprint provided by a service provider, on which selected financial or personal information stored in the PDA can be downloaded to perform certain consumer transactions. The PDA includes a modem, a serial port and/or a parallel port so as to provide direct communication capability with peripheral devices (such as POS and ATM terminals) and is capable of transmitting or receiving information through wireless communications such as radio frequency (RF) and infrared (IR) communication. The present invention is preferably operated in two modes, i.e., a client/server mode and a local mode.

Abstract: The system and method consistent with the present invention provides a touch-responsive graphical user interface for electronic devices. The graphical user interface determines a pointer size of the object making contact with a display and activates a function corresponding to the pointer size. The graphical user interface may invoke a wide array of functions such as a navigation tool, draw function, an erase function, or a drag function. The graphical user interface of the present invention may be especially useful in portable electronic devices with small displays.

Abstract: The Lumiere Project centers on harnessing probability and utility to provide assistance to computer software users. We review work on Bayesian user models that can be employed to infer a user's needs by considering a user's background, actions, and queries. Several problems were tackled in Lumiere research, including (1) the construction of Bayesian models for reasoning about the time-varying goals of computer users from their observed actions and queries, (2) gaining access to a stream of events from software applications, (3) developing a language for transforming system events into observational variables represented in Bayesian user models, (4) developing persistent profiles to capture changes in a user's expertise, and (5) the development of an overall architecture for an intelligent user interface. Lumiere prototypes served as the basis for the Ofice Assistant in the Microsoft Office '97 suite of productivity applications.

Abstract: Synchronization system and associated methods provide synchronization of an arbitrary number of datasets, including more than two datasets. To achieve this, a reference dataset is used to store a super-set of the latest or most-recent data from all user datasets to provide a repository of information that is available at all times. Therefore, if the user later wishes to synchronize a new user dataset, such as one in a server computer that stores user information, the system already has all the information necessary for synchronizing the new dataset, regardless of whether any of the other datasets are then available. Further, to simplify use, a unified user interface is provided that allows the user to easily determine which of his or her datasets are currently set to be synchronized and allows the user to conveniently alter the current settings to select one, two, or even more than two clients for synchronization. Various “conflict” or “duplicate” resolution strategies are described for intelligently handling complexities resulting from allowing synchronization for an arbitrary number of datasets and allowing synchronization using even data from datasets that are not available. Architectural support for “plug-in” client accessors and type modules is also provided. This allows support to be added for new datasets or new types of data merely by developing and plugging in new, compact client accessors or type modules, without updating or replacing the core synchronization engine.

Abstract: A user interface for a financial advisory system is provided. According to one aspect of the present invention, a user may interactively explore how changes in one or more input decisions such as a risk tolerance, a savings level, and a retirement age affect one or more output values such as a probability of achieving a financial goal or an indication of short-term risk. A first and second visual indication are concurrently displayed. The first visual indication includes input mechanisms, such as slider bars, for receiving the input decisions. The second visual indication includes a set of output values that are based upon the input decisions and a recommended set of financial products. After updated values for the input decisions are received via the input mechanisms, a new recommended set of financial products and a new set of output values may be determined based upon the updated values. The second visual indication may then be updated to reflect the new set of output values. According to another aspect of the present invention, a graphical input mechanism for receiving a desired level of investment risk may be calibrated. A set of available financial products, such as a set of mutual funds, and a predefined volatility, such as the volatility of the Market Portfolio are received. The settings associated with the graphical input mechanism are constrained based upon the set of available financial products. Additionally, the calibration of the units of the graphical input mechanism may be expressed as a relationship between the volatility associated with a setting of the graphical input mechanism and the predefined volatility.

Abstract: The most preferred embodiment of the present invention is a computer-based decision support system that includes three main components: a database mining engine (DME); an advertising optimization mechanism; and a customized user interface that provides access to the various features of the invention. The user interface, in conjunction with the DME, provides a unique and innovative way to store, retrieve and manipulate data from existing databases containing media-related audience access data, which describe the access habits and preferences of the media audience. By using a database with a simplified storage and retrieval protocol, the data contained therein can be effectively manipulated in real time. This means that previously complex and lengthy information retrieval and analysis activities can be accomplished in very short periods of time (typically seconds instead of minutes or even hours). Further, by utilizing the advertising optimization mechanism of the present invention, businesses, networks, and advertising agencies can interactively create, score, rank and compare various proposed or actual advertising strategies in a simple and efficient manner. This allows the decision-makers to more effectively tailor their marketing efforts and successfully reach the desired target market while conserving scarce advertising capital. Finally, the user interface for the system provides access to both the DME and the optimization mechanism in a simple and straightforward manner, significantly reducing training time.

Abstract: A method and system for commanding and controlling diverse home devices. A first home device capable of displaying user interface data is connected to a home network. A second home device stores user interface data that defines a user interface for commanding and controlling the second home device, also connected to the home network. The first device receives the user interface data from the second device over the network. The first device then displays the user interface as defined by the data. The user interacts with the user interface displayed on the first device by a control device. User input is accepted from the user responsive to the interaction. Control and command information is sent from the first home device to the second home device in order to control the second device according to the user input. Since the user interface can be displayed from any device, a single control device may control a plurality of different devices without requiring any change in the mode of operation of the control device.

Abstract: An integrated control system comprises one or more controllers each equipped to perform a control function and to gather data (ordinarily from sensors) relevant to the control function. Each controller contains computer storage means, such as computer memory, for storing the relevant data and instructions, associated with the data, for causing a remote computer to generate a visual display incorporating the data in a predetermined format; and a communication module for establishing contact and facilitating data interchange with the remote computer. The remote computer, in turn, also includes a communication module compatible with the controller-borne module, and which enables the remote computer to download the data and associated instructions from one or more controllers. The remote computer also includes a facility for processing the instructions to create a user interface encoded by the instructions, and which incorporates the data. In this way, controller data is coupled to instructions for displaying that data, and this totality of information is continuously accessible, on a freely selective basis, to the remote computer.

Abstract: In designing the spreadsheet optimizer that is bundled with Microsoft Excel, we and Microsoft made certain choices in designing its user interface, model processing, and solution algorithms for linear, nonlinear, and integer programs. We describe some of the common pitfalls users encounter and remedies available in the latest version of Microsoft Excel. The Solver has many applications and great impact in industry and education.

Abstract: This paper describes the software architecture of an autonomous tour-guideltutor robot. This robot was recently deployed in the "Deutsches Museum Bonn," were it guided hundreds of visitors through the museum during a six-day deployment period. The robot's control software integrates low-level probabilistic reasoning with high-level problem solving embedded in first order logic. A collection of software innovations, described in this paper, enabled the robot to navigate at high speeds through dense crowds, while reliably avoiding collisions with obstacles--some of which could not even be perceived. Also described in this paper is a user interface tailored towards non-expert users, which was essential for the robot's success in the museum. Based on these experiences, this paper argues that time is ripe for the development of AI-based commercial service robots that assist people in everyday life.

Abstract: This essay describes the Model-View-Controller (MVC) programming paradigm and methodology used in the Smalltalk-80TM programming system. MVC programming is the application of a three-way factoring, whereby objects of different classes take over the operations related to the application domain, the display of the application's state, and the user interaction with the model and the view. We present several extended examples of MVC implementations and of the layout of composite application views. The Appendices provide reference materials for the Smalltalk-80 programmer wishing to understand and use MVC better within the Smalltalk-80 system.

Abstract: A web-based online store includes a configurator, a cart, a checkout, and a database, further in which a user interface of the online store enables a custom configuration of a computer system according to an identification of a user belonging to a prescribed customer set. The configurator is provided for configuring a computer system with options selected according to a prescribed user input, the options and a respective pricing for each option being presented on a configurator web page in accordance with the identification of the user belonging to a prescribed customer set. The cart is provided for temporarily storing the customer configured computer system, the cart including a cart web page. The checkout is provided for presenting payment options and for obtaining payment and delivery information, the checkout including a checkout web page. Lastly, the database is provided for dynamically supplying configuration options to the configurator in accordance with the identification of the user belonging to the prescribed customer set. An online store method and user interface are also disclosed.

Abstract: This paper concludes that 4D models are a useful alternative to project scheduling tools like CPM networks and bar charts. They enable more people to understand a schedule quickly and identify potential problems. By developing a 4D model for a commercial construction project, we were able to detect the incompleteness of the original schedule, find inconsistencies in the level of detail among the schedule activities, and discover an impossible schedule sequence. We were also able to anticipate potential time-space conflicts and accessibility problems. The results of the case study show that 4D models are effective in evaluating the executability of a construction schedule. The case study also highlighted the need for improvements to 4D tools. 4D tools should include bar charts, component lists, and annotation tools in their graphical user interface. Automating schedule data preparation and 4D model generation in the design stages of a project can expedite 4D model development and use. Users need to be able to generate 4D models at multiple levels of detail and generate and evaluate alternative scenarios rapidly.

Abstract: LifeLines provide a general visualization environment for personal histories. We explore its use for clinical patient records. A Java user interface is described, which presents a one-screen overview of a computerized patient record using timelines. Problems, diagnoses, test results or medications can be represented as dots or horizontal lines. Zooming provides more details; line color and thickness illustrate relationships or significance. The visual display acts as a giant menu, giving direct access to the data.

Abstract: A system which processes information to identify product choices within a product domain for a user, presents structured data concerning attributes of products in the product domain to the user in a readily understandable and efficient manner, allowing the user to make the best choice according to his or her own personal profile. A user interface (20, 21 and 22) presents a sequence of input prompts to the user to gather preference and requirement data for a plurality of attributes of products in the product domain. A decision engine (10) is coupled to the user interface (20, 21 and 22) and filters the product domain to present a set of products according to the gathered preference and requirement data as product choices to the user.

Abstract: The research we are reporting here is part of our effort to develop a navigation system for the blind Our long-term goal is to create a portable, self-contained system that will allow visually impaired individuals to travel through familiar and unfamiliar environments without the assistance of guides The system, as it exists now, consists of the following functional components: (1) a module for determining the traveler's position and orientation in space, (2) a Geographic Information System comprising a detailed database of our test site and software for route planning and for obtaining information from the database, and (3) the user interface The experiment reported here is concerned with one function of the navigation system: guiding the traveler along a predefined route We evaluate guidance performance as a function of four different display modes: one involving spatialized sound from a virtual acoustic display, and three involving verbal commands issued by a synthetic speech display The virtual display mode fared best in terms of both guidance performance and user preferences

Abstract: A system, method and article of manufacture for facilitating a user in, or creating for a user, a web-based active knowledge management system to facilitate an intelligent agent coordinator. The architecture facilitates delivery of information whenever and where ever a user requires the information in an appropriate format based on characteristics of the user at that instant. Personalization of information is also afforded by taking into account the history of user interactions with various applications and current real time situations, such a time and place, in order to create a plurality of unique user profile. Each unique profile can then be associated with a unique address, as well as being given restriction exclusive to that profile. Associations, such as business rules or databases, can also be related to each such profile. A fast and scalable information prioritization subsystem is also utilized to incorporate intelligent agents coordinator opinion, user preferences, and history of user interactions. In addition, speech recognition and speech synthesis are combined with intelligent agent animated representation and tactile input.

Abstract: A computer implemented method of generating a user product configuration program module from a development environment. The user product configuration program module includes user controls that allow user input of information for use in configuration computations. Methods are disclosed for creating and maintaining the logic for a configuration program module in the form of configuration parameters; creating and maintaining the visual controls and user interface; and linking created visual controls with underlying structure represented by the parameters. Parameters assume values and are indicated as valid or invalid through operation of constraints and queries. Further methods include display of parameter creation and selection windows, and query creation and selection windows for creating SQL queries to access data in external tables. Parameters, queries, and constraints can be displayed in expandable and collapsible hierarchies, and quickly utilized in formulas, queries, and logical expressions by clicking in an expanded hierarchical display. Dependencies occurring in the underlying configuration logic are evaluated in both the forward and reverse direction so as to provide for very fast execution of the resultant configuration program module when a user provides new data via a user control.

Abstract: An electronic reading system is disclosed which allows users to download books and other types of content to a hand-held reader device for viewing. Using software which runs on a personal computer (PC), the user can download titles from Internet sites to the PC. Titles are then automatically transferred to the device when the device is placed in a cradle which is connected to the PC. Using the device's touch-sensitive display and graphical user interface, the user can access various software-implemented features associated with the display and management of the content. One feature is a user-definable hotkey that can be “dragged and dropped” onto a menu item to create a shortcut to that item. Another feature allows the user to tap twice on a displayed word to cause the device to look the word up in a pre-specified or default reference title, such as a dictionary or an encyclopedia. Another feature allows the user to block a passage on the touch-sensitive display and then specify one or more destinations (email addresses, file folders, fax numbers, printers, etc.) for routing the passage; when the device is subsequently placed in the cradle, the passage is automatically retrieved by the PC and routed to the specified destination(s). The device also implements a user interface feature for allowing the user to rapidly and conveniently adjust the orientation of the displayed title.

Abstract: A method and apparatus for checking/updating existing software on a user's computer (100) utilizes a graphical user interface (GUI). The GUI (16) enables the user, without knowing what software exists on the computer, to download a text file from a remote server (14) and check whether the software on the remote server (14) is contained on the user's computer (100). The user can also download and automatically install a new or updated program via the GUI (16).

Abstract: In this paper, we discuss how multiple input modalities may be combined to produce more natural user interfaces. To illustrate this technique, we present a prototype map-based application for a travel planning domain. The application is distinguished by a synergistic combination of handwriting, gesture and speech modalities; access to existing data sources including the World Wide Web; and a mobile handheld interface. To implement the described application, a hierarchical distributed network of heterogeneous software agents was augmented by appropriate functionality for developing synergistic multimodal applications.

Abstract: The invention is directed to a ventilation control system for controlling the ventilation of a patient. The ventilation control system utilizes a user-friendly user interface for the display of patient data and ventilator status. The user interface includes a graphic representation of a breath cycle that displays the breath cycle currently being ventilated, and is also responsive to changes in ventilation settings to assist the user in evaluation the effect of those changes on the ventilator strategy before the changes are implemented.

Abstract: Systems, methods, and apparatus (including computer program apparatus) for a browser-aware application delivery system. The System provides World Wide Web browser extensions based on server processes rather than on plug-in program modules loaded and installed on a user's machine. The system operates like a monitor for a user while the user is browsing the web, and enables the user to obtain and interact with context-sensitive services and information based on the user's browsing activity. The system allows the user to add application tools, which are implemented on servers separate from the user's computer. Third parties can easily add tools to the system by registering application services with the system.

Abstract: Home networks low-cost digital interfaces are introduced that integrate entertainment, communication and computing electronics into consumer multimedia. Normally, these are low-cost, easy to use systems, since they allow the user to remove or add any kind of network devices with the bus being active. To improve the user interface a speech unit (2) is proposed that enables all devices (11) connected to the bus system (31) to be controlled by a single speech recognition device. The properties of this device, e.g. the vocabulary can be dynamically and actively extended by the consumer devices (11) connected to the bus system (31). The proposed technology is independent from a specific bus standard, e.g. the IEEE 1394 standard, and is well-suited for all kinds of wired wireless home networks. The speech unit (2) receives data and messages from the device. The speech unit (2) recognizes speaker-dependent commands. A Speech synthesizer synthesizes messages. A remotely controllable device (11) has access to a medium which may be a CD-ROM. The device may ask for a logical name or identifier.

Abstract: A graphical user interface in which object thumbnails are rendered on a simulated three-dimensional surface which (i) exploits spatial memory and (ii) allows more objects to be rendered on a given screen. The objects may be moved, continuously, on the surface with a two-dimensional input device. Furthermore, the interface determines a degree to which each such object is related, either through similarity or matching, to other such objects and displays an appropriate cue proximate to and associated with the former object to visually signify this degree.

Abstract: A graphical user interface for an entertainment system assists a viewer while navigating channels. The user interface is a channel bar which is displayed together with the currently selected channel. The channel bar has a plurality of linearly arranged channel-related icons for navigating the channels. A viewer-controllable focus is movable along the channel bar to permit the viewer to select and actuate any one of the icons, causing the entertainment system to jump to the channel associated with the selected icon. The entertainment system is a computerized viewing unit which has a processor, memory, and a multitasking operating system that provides a graphical user interface environment which supports presentation of graphical windows. An application executes on the processor to provide the channel bar user interface. An input device--such as a mouse, keyboard, remote control handset, etc.--enables the viewer to invoke the channel bar and to manipulate the focus along the channel bar. The channel bar UI includes a banner which contains information pertaining to the presently selected channel and a recent channels bar which contains linearly-arranged actuatable icons that are associated with channels that have been most recently selected by the viewer. The channel bar UI also includes a favorite channels bar having actuatable icons for channels most preferred by the viewer and a tools bar having actuatable icons that are associated with control features for operating the entertainment system. The tools bar has an icon which permits a viewer to toggle between a television mode, in which programs are displayed full screen, and a windows mode in which the program and channel bar are confined to a window.