Abstract: We survey the research on interactive evolutionary computation (IEC). The IEC is an EC that optimizes systems based on subjective human evaluation. The definition and features of the IEC are first described and then followed by an overview of the IEC research. The overview primarily consists of application research and interface research. In this survey the IEC application fields include graphic arts and animation, 3D computer graphics lighting, music, editorial design, industrial design, facial image generation, speed processing and synthesis, hearing aid fitting, virtual reality, media database retrieval, data mining, image processing, control and robotics, food industry, geophysics, education, entertainment, social system, and so on. The interface research to reduce human fatigue is also included. Finally, we discuss the IEC from the point of the future research direction of computational intelligence. This paper features a survey of about 250 IEC research papers.

Abstract: which centres on responding to contingencies, there is no digression into languages for detecting contingencies-the reader will need to look to the alarm correlation literature, or to event monitoring frameworks such as the University of Cam-bridge's Cambridge Event Architecture (CEA) and Imperial College's Generalized Event Monitor (GEM), here. In order to integrate event detection with planning though, these event detectors will need extensions for event criticality, event probability , response utility determination and scheduling, and resource allocation. The final chapters of the book review some behaviour models , which characterize the underlying attitudes that may influence planning, such as anti-authorative, impulsive, macho, and liability conscious behavioural attitudes. The authors also explain how computer-generated plans may be used to validate human plans and, similarly, how a comparison to human plans may shed light on the suitability and accuracy of a particular computational approach. The target audience for this book is ambitiously described as software managers, higher level managers, project managers, executives, CIO's, managers, entrepreneurs, and software developers. However, the tone of the book is predominantly academic and theoretic in nature, with frequent excursions into mathematical formulae that are probably not of interest to practictioners. Firstly, the authors indulge in a long-winded literature survey of planning systems and provide proofs of necessity , consistency, and optimality of their framework, that practitioners will no doubt find tiresome as the book is given the flavour of a PhD thesis, albeit a thorough and rigorous one. While the book provides comprehensive coverage of planning approaches and prior research, the book tends to be repetitive and long-wlnded. The book's discussion of the Maruti real-time operating system, though applicable, is not likely to be of interest to the intended audience as Maruti is not a pervasive technology in industry. Finally, the use of academic parlance and frequent references to context free grammars, non-terminals, and NP-completeness is ill-suited to the target audience, who expect a straightforward, brief, and direct explanation of critical concepts, and who will find themselves frequently bored by the many tedious academic expositions. Whilst, as claimed in the book's blurb, the techniques described in the book could foreseeably apply to domains as diverse as web-based shopping assistants, the authors do not provide any practical illustrations of this, constraining their applications predominantly to a recurring examples from the aircraft flight planning domain. The enticing but elusive prospect of integrating real-time problem solving languages with existing Internet …

Abstract: A flowchart-based tool can be used to build a logical structure. In the context of a customer relationship management (CRM) system, the logical structure can comprise an ordered set of questions and branching logic that are presented to a customer of the business when the customer contacts the business with an inquiry, such as for a sale or service inquiry or other interaction. An engine can run a session associated with the logical structure, with the session presenting questions, text, graphics, and the like dynamically to customer across a network, such as the Internet and a web site. Branching logic determines the appropriate information to present to the user based on answers to previous questions. The engine allows presentation of the information to the user/customer, by generating hypertext markup language (HTML) files to display the questions or other elements of the logical structure as part of a user interface on a client terminal of the customer.

Abstract: A server federation cooperatively interacts to fulfill service requests by communicating using data structures that follow a schema in which the meaning of the communicated data is implied by the schema. Thus, in addition to the data being communicated, the meaning of the data is also communicated allowing for intelligent decisions and inferences to be made based on the meaning of the data. Cooperative interaction is facilitated over a wide variety of networks by messaging through a common API that supports multiple transport mechanisms. Also, mid-session transfer between client devices is facilitated by schema and the transport-independent messaging structure. The user interfaces of the client devices will appear consistent even if the client devices have different user interface capabilities.

Abstract: This article describes the Java-based version of the magnetic resonance user interface (MRUI) quantitation package. This package allows MR spectroscopists to easily perform time-domain analysis of in vivo MR spectroscopy data. We show that the Java programming language is very well suited for developing highly interactive graphical software applications such as the MRUI software. We have also established that MR quantitation algorithms, programmed in other languages, can easily be embedded into the Java-based MRUI by using the Java native interface (JNI). This new graphical user interface (GUI) has been conceived for the processing of large data sets and uses prior knowledge data-bases to make interactive quantitation algorithms more userfriendly.

Abstract: Techniques are disclosed for using a combination of explicit and implicit user context modeling techniques to identify and provide appropriate computer actions based on a current context, and to continuously improve the providing of such computer actions. The appropriate computer actions include presentation of appropriate content and functionality. Feedback paths can be used to assist automated machine learning in detecting patterns and generating inferred rules, and improvements from the generated rules can be implemented with or without direct user control. The techniques can be used to enhance software and device functionality, including self-customizing of a model of the user's current context or situation, customizing received themes, predicting appropriate content for presentation or retrieval, self-customizing of software user interfaces, simplifying repetitive tasks or situations, and mentoring of the user to promote desired change.

Abstract: To create successful interactive systems, user interface designers need to cooperate with developers and application domain experts in an interdisciplinary team. These groups, however, usually miss a common terminology to exchange ideas, opinions, and values.This paper presents an approach that uses pattern languages to capture this knowledge in software development, HCI, and the application domain. A formal, domain-independent definition of design patterns allows for computer support without sacrificing readability, and pattern use is integrated into the usability engineering life cycle.As an example, experience from building an award-winning interactive music exhibit was turned into a pattern language, which was then used to inform follow-up projects and support HCI education.

Abstract: Recommender systems provide personalized suggestions about items that users will find interesting. Typically, recommender systems require a user interface that can ``intelligently'' determine the interest of a user and use this information to make suggestions. The common solution, ``explicit ratings'', where users tell the system what they think about a piece of information, is well-understood and fairly precise. However, having to stop to enter explicit ratings can alter normal patterns of browsing and reading. A more ``intelligent'' method is to useimplicit ratings, where a rating is obtained by a method other than obtaining it directly from the user. These implicit interest indicators have obvious advantages, including removing the cost of the user rating, and that every user interaction with the system can contribute to an implicit rating.Current recommender systems mostly do not use implicit ratings, nor is the ability of implicit ratings to predict actual user interest well-understood. This research studies the correlation between various implicit ratings and the explicit rating for a single Web page. A Web browser was developed to record the user's actions (implicit ratings) and the explicit rating of a page. Actions included mouse clicks, mouse movement, scrolling and elapsed time. This browser was used by over 80 people that browsed more than 2500 Web pages.Using the data collected by the browser, the individual implicit ratings and some combinations of implicit ratings were analyzed and compared with the explicit rating. We found that the time spent on a page, the amount of scrolling on a page and the combination of time and scrolling had a strong correlation with explicit interest, while individual scrolling methods and mouse-clicks were ineffective in predicting explicit interest.

Abstract: The paper reviews the development of generic user modeling systems over the past twenty years. It describes their purposes, their services within user-adaptive systems, and the different design requirements for research prototypes and commercially deployed servers. It discusses the architectures that have been explored so far, namely shell systems that form part of the application, central server systems that communicate with several applications, and possible future user modeling agents that physically follow the user. Several implemented research prototypes and commercial systems are briefly described.

Abstract: A system and method for delivering multimedia content to computers over a computer network, such as the Internet, includes a novel media player which may be downloaded onto a user's personal computer. The media player includes a user interface which allows a listener to search an online database of media selections and build a custom playlist of exactly the music selections desired by the listener. The multimedia content delivery system delivers advertisements which remain visible on a user's computer display screen at all times when the application is open, for example, while music selections are being delivered to the user. The advertisements are displayed in a window which always remains on a topmost level of windows on the user's computer display screen, even if the user is executing one or more other programs with the computer.

Abstract: A method for associating related electronic messages in computer storage. A first transportable application is created and stored. User input requesting creation of a link from the first transportable application to another transportable application is received. User input that selects a second transportable application from among a plurality of previously created transportable applications is received. A link from the first transportable application to the second transportable application is created and stored. As a result, transportable application may be inter-related in complex message webs. The message webs may also be inter-related in message web rings. Links may be generated manually or automatically, based on context, workflow processes, or other known relationships among applications. Recipient lists and data may propagate among fields of linked transportable applications, directly or according to abstract business rules. Further, multiple-part electronic messages are disclosed. A graphical user interface of an electronic messaging system displays a message in the form of one or more header portions and one or more body portions. Each of the body portions has a selection region. While one body portion is visible at a given time, all the selection regions are continuously visible in the user interface to facilitate selection of any of the body portions at a particular time. Selecting a selection region of a non-displayed body portion causes a server to generate a refreshed user interface that includes the entirety of the selected body portion, and that hides the previously viewed body portion. As a result, a large amount of associated information may be combined in a single message in a way that is clearly organized and easily accessible.

Abstract: A method, system, and computer-readable medium are described for dynamically determining an appropriate user interface (“UI”) to be provided to a user. In some situations, the determining is to dynamically modify a UI being provided to a user of a wearable computing device so that the current UI is appropriate for a current context of the user. In order to dynamically determine an appropriate UI, various types of UI needs may be characterized (e.g., based on a current user's situation, a current task being performed, current I/O devices that are available, etc.) in order to determine characteristics of a UI that is currently optimal or appropriate, various existing UI designs or templates may be characterized in order to identify situations for which they are optimal or appropriate, and one of the existing UIs that is most appropriate may then be selected based on the current UI needs.

Abstract: Sentient computing systems, which can change their behaviour based on a model of the environment they construct using sensor data, may hold the key to managing tomorrow's device-rich mobile networks. At AT&T Laboratories Cambridge, we have built a system that uses sensors to update a model of the real world. We designed the model's terms (object positions, descriptions and state, and so forth) to be immediately familiar to users. Thus, the model describes the world much as users themselves would. We can use this model to write programs that react to changes in the environment according to the user's preferences. We call this sentient computing because the applications appear to share the user's perception of the environment. Treating the current state of the environment as common ground between computers and users provides new ways of interacting with information systems. A sentient computing system doesn't need to be intelligent or capable of forming new concepts about the world, it only needs to act as though its perceptions duplicate the user's. In earlier work, we described a prototype of this system and stated our intention to deploy it on a large scale. We have now installed an enhanced version throughout an office building. Over the past year, approximately 50 staff members have used the system daily with a set of trial applications.

Abstract: A portal server presents an HTML page that comprises a plurality of modules that are formatted in a predetermined layout. Each module represents a network resource that can be accessed by a user through the portal. Some of the modules can be user-selectable, whereas others may be mandatory elements of the portal. Similarly, some aspects of the layout may be user-controllable, while others are fixed. The modular nature of the portal enables the various resources to be readily and independently updated by the entities who provide them, without affecting other features of the portal. The portal server includes an administration interface that enables an administrator to select from various layout styles, as well as control access to site information and services. A variety of customizations can be done to the portal without requiring programming skills. As a result, individual businesses and other entities can exercise complete ownership of their portals, from a hosting, branding and design perspective.

Abstract: The present invention provides a personal security network where an individual's system or systems of security devices may be connected to a central security network. The central security network of the present invention may monitor a system's status and alert the individual when an alert situation occurs. The present invention provides a security network where a user may set up personalized alarms and alert services; identify various methods of contact; order at which to be contacted; individuals and entities to be contacted; type of situations to be alerted of and other relevant security and other information. The present invention may further provide a personalized web interface where authorized individuals may view current and historical security device status. A user may generate personalized reports based on aggregated historical data based on various user-defined factors. The reports may be displayed to the user in various formats, such as maps, graphs, statistics, and others.

Abstract: A system is provided for delivering Internet and digital content to a variety of thin client devices. A web portal for accessing and selecting content is used in conjunction with graphical user interfaces on a personal computer for setting up and controlling the content channels. The user interfaces, scheduling, and communication management are controlled by a system control software application running on a local server with an Internet connection. A high speed local area network provides for streaming content from the Internet or local server to thin client devices. A digital audio playback device is connected to the local server via the local area network connection and decodes streamed audio files, and converts them into analog audio signals for input into a conventional stereo. Digital content is streamed automatically from the local server to another Internet playback device, based on end user content preferences and schedule selections.

Abstract: Methods of remote control of a mobile robot and an intuitive user interface for remotely controlling a mobile robot are provided. Using a point-and-click device (405), the user is able to choose a target location (430) within a heads-up display (400) toward which to move a mobile robot. Additional graphical overlays (410 &and 412) are provided to aid the user in navigating even in systems with asynchronous communication.

Abstract: A user interface includes a main screen segregated into various screen areas. At least one of the screen areas is devoted to a system application for displaying status icons, and another of the screen areas is devoted to an interface page which may or may not link to other interface pages which are used for displaying current or recent application information for respective user applications, which user applications may be accessed through interaction with the interface page. The application information may be application status information, recent communication messages (such as e-mail messages, SMS messages, or instant messaging messages) and/or one or more upcoming events or to do items for a user. The user interaction may occur through selection with a pointing device such as a stylus, a fingertip stylus, a finger, or one or more buttons, or even through voice commands. The user interface may also include an area reserved for displaying advertisements.

Abstract: An automated vehicle tracking and service provision system including a central controller, a local controller located in each vehicle, the central controller and the local controllers including wireless communication interface for communication of information between the central controller and the vehicle based on fuzzy logic algorithms decision making software. In a preferred embodiment, the local controller includes a processor, a global positioning systems (GPS) sensor coupled to the processor for providing vehicle location in terms of latitude and longitude, a memory coupled to the processor, a plurality of sensors coupled to the processor and adapted to provide information on a plurality of parameters related to the vehicle such as fuel level, collision status, brakes and such like, a user interface coupled to the processor for providing user input from input devices such as a credit card reader, smart card reader or keyboard, a wireless transceiver is coupled to the processor for communicating data from the processor to the central controller and for receiving data from the central controller, and a display. Provides for a voice or audio input/output interface coupled to the user interface for providing voice activation of the processor or voice transmission via the wireless transceiver to the central controller.

Abstract: Web retailing is expected to grow at aggressive rates in future years, but lack of trust on the part of potential customers can impede this growth. So, as transactions through the Internet develop and mature, success will largely be dependent on gaining and maintaining this trust. It has been suggested that the quality of the user interface of the Web site is a determinant of the initial establishment of trust. Describes a study where 66 subjects were asked to perform some predefined book purchasing task in a series of sites with varying interface quality. A strong relationship between interface quality and trust was found and some components of user interface quality were more important than others. Discusses the implications for Web site design.

Abstract: A system is described in which a media browser ( 101 ), operating as a software application on a user terminal or preferably a server for a number of users, provides a user with a single user interface that facilitates browsing and searching different metadata collections over the Internet ( 102 ). A metadata server ( 212 ) is associated with each of the metadata collections. When the metadata server ( 212 ) receives a request from the media browser ( 101 ), the metadata server ( 212 ) interprets the request and replies with a description that satisfies the request and according to a predetermined scheme. The description contains at least one link which represents a return link which represents a return request to the metadata server ( 212 ). Specifically disclosed are methods ( 2000 ) for recording user location preferences at a service and using one or more lists of such preferences to focus searching responses to statistically desirable material. Monitoring the validity of a bookmarked location is also described.

Abstract: The present invention is a multimedia management system for storing, manipulating, and displaying multimedia content. The system comprises a user interface, a plurality of predefined functions, a multimedia acquisition interface, and system controls. The system provides users with a simple and intuitive method and computer program for reviewing multimedia content, which can include digital video, digital audio and text, still images, animation, and MIDI.

Abstract: Three-dimensional user interface design is a critical component of any virtual environment (VE) application. In this paper, we present a broad overview of 3-D interaction and user interfaces. We discuss the effect of common VE hardware devices on user interaction, as well as interaction techniques for generic 3-D tasks and the use of traditional 2-D interaction styles in 3-D environments. We divide most user-interaction tasks into three categories: navigation, selection/manipulation, and system control. Throughout the paper, our focus is on presenting not only the available techniques but also practical guidelines for 3-D interaction design and widely held myths. Finally, we briefly discuss two approaches to 3-D interaction design and some example applications with complex 3-D interaction requirements. We also present an annotated online bibliography as a reference companion to this article.

Abstract: SRI’s Open Agent Architecture (OAA), a research framework for constructing agent-based systems, makes it possible for software services to be provided through the cooperative efforts of distributed collections of autonomous agents. Communication and cooperation between agents are brokered by one or more facilitators, which are responsible for matching requests, from users and agents, with descriptions of the capabilities of other agents. Thus, it is not generally required that a requester (user or agent) know the identities, locations, or number of other agents involved in satisfying a request. Facilitators are not viewed as centralized controllers, however, but rather as coordinators, as they draw upon knowledge and advice from several different, potentially distributed, sources to guide their delegation choices. OAA is structured so as to minimize the effort involved in creating new agents and “wrapping” legacy applications, written in various languages and operating on various platforms; to encourage the reuse of existing agents; and to allow for dynamism and flexibility in the makeup of agent communities. Distinguishing features of OAA as compared with related work include extreme flexibility in using facilitator-based delegation of complex goals, triggers, and data management requests; agent-based provision of multimodal user interfaces; and built-in support for including the user as a privileged member of the agent community.

Abstract: A software system automatically and dynamically generates a fully functional user interface (UI) based upon, and connected directly to, an underlying data model (as instantiated within a relational database management system (RDBMS)). The UI derives from an automated interrogation of the RDBMS, and comprises all mode displays (e.g., browse, search, edit, add) for all tables, and a full complement of mechanisms—integrated directly into the mode displays—for representing, navigating, and managing relationships across tables, regardless of the complexity of the underlying RDBMS schema. It utilizes a hierarchical “context stack” for suspending the working state of a particular table while “drilling down” to work with related-table information and return relevant changes to the base table. The embodiment further provides methods to enhance and extend the internal representation of table structures, constraints, relationships, and—special requirements (“business rules”) for improved revelation of the schema structure through external interrogation.

Abstract: The belief that humans will be able to interact with computers in conversational speech has long been a favorite subject in science fiction, reflecting the persistent belief that spoken dialogue would be the most natural and powerful user interface to computers. With recent improvements in computer technology and in speech and language processing, such systems are starting to appear feasible. There are significant technical problems that still need to be solved before speech-driven interfaces become truly conversational. This article describes the results of a 10-year effort building robust spoken dialogue systems at the University of Rochester.

Abstract: A method and system of providing a three dimensional spatial user interface (SUI) to a user of a computing device. The SUI may be manipulated in three dimensions and contains a plurality of portals. A portal may contain a sensory cue that provides a reminder as to the content of the portal. Upon selection of a portal, an application program associated with the cue in the portal is invoked. Portals may also contain further instances of the SUI of the present invention, thus providing hierarchical depth. In the preferred embodiment, the SUI is implemented as a sphere and may be viewed from an external or internal perspective.

Abstract: A method for providing interactive audience participation at live spectator events. The method includes providing each spectator with an interactive device (10) having housing (12) that presents a promotional message in the form of indicia (30) and includes a user interface (50), broadcasting audio programming to the spectator through the interactive device's ear piece (15) and display (20), querying the spectators, wherein answers to the querying may be entered by spectators via the user interface of the interactive device, transmitting the answer to a central processor, storing the answers as spectator data, processing the spectator data into results, storing the results of the processing of the spectator data and broadcasting the results of the processing of the spectator.