Abstract: A computer-based virtual assistant includes a virtual assistant application running on a computer capable of receiving human voice communications from a user of a remote user interface and transmitting a vocalization to the remote user interface, the virtual assistant application enabling the user to access email and voicemail messages of the user, the virtual assistant application selecting a responsive action to a verbal query or instruction received from the remote user interface and transmitting a vocalization characterizing the selected responsive action to the remote user interface, and the virtual assistant waiting a predetermined period of time, and if no canceling indication is received from the remote user interface, proceeding to perform the selected responsive action, and if a canceling indication is received from the remote user interface halting the selected responsive action and transmitting a new vocalization to the remote user interface. Also a method of using the virtual assistant.

Abstract: 1. Introduction. 2. The User Profile. 3. Conceptual Models. 4. Dialog Styles: Menus. 5. Dialog Styles: Fill-In Forms. 6. Dialog Styles: Question and Answer. 7. Dialog Styles: Command Languages. 8. Dialog Styles: Function Keys. 9. Dialog Styles: Direct Manipulation. 10. Dialog Styles: Natural Language. 11. Dialog Styles: Summary. 12. Input and Output Devices. 13. Organization and Functionality. 14. Screen Layout and Design. 15. Response Time. 16. Error Handling. 17. User Documentation. 18. Summary and Conclusions.

Abstract: A hands-on guide to building mobile applications, Professional Android Application Development features concise and compelling examples that show you how to quickly construct real-world mobile applications for Android phones. Fully up-to-date for version 1.0 of the Android software development kit, it covers all the essential features, and explores the advanced capabilities of Android (including GPS, accelerometers, and background Services) to help you construct increasingly complex, useful, and innovative mobile applications for Android phones.What this book includesAn introduction to mobile development, Android, and how to get started. An in-depth look at Android applications and their life cycle, the application manifest, Intents, and using external resources. Details for creating complex and compelling user interfaces by using, extending, and creating your own layouts and Views and using Menus. A detailed look at data storage, retrieval, and sharing using preferences, files, databases, and Content Providers. Instructions for making the most of mobile portability by creating rich map-based applications as well as using location-based services and the geocoder. A look at the power of background Services, using threads, and a detailed look at Notifications. Coverage of Android's communication abilities including SMS, the telephony APIs, network management, and a guide to using Internet resources Details for using Android hardware, including media recording and playback, using the camera, accelerometers, and compass sensors. Advanced development topics including security, IPC, advanced 2D / 3D graphics techniques, and userhardware interaction. Who this book is forThis book is for anyone interested in creating applications for the Android mobile phone platform. It includes information that will be valuable whether you're an experienced mobile developer or making your first foray, via Android, into writing mobile applications. It will give the grounding and knowledge you need to write applications using the current SDK, along with the flexibility to quickly adapt to future enhancements.

Abstract: Enhanced camera-based input, in which a detection region surrounding a user is defined in an image of the user within a scene, and a position of an object (such as a hand) within the detection region is detected. Additionally, a control (such as a key of a virtual keyboard) in a user interface is interacted with based on the detected position of the object.

Abstract: User interfaces for browsing and/or searching are described. In one embodiment, a method includes displaying a first display area for display representations of documents matching a search query, the first display area configured to display content of the documents which can have a plurality of different types of content including at least one of text-based content and a folder, and displaying a second display area for selecting a selected document to be displayed in the first display area. Other embodiments are also described, and computer readable media and apparatuses are also described.

Abstract: Interactive history tools, ranging from basic undo and redo to branching timelines of user actions, facilitate iterative forms of interaction. In this paper, we investigate the design of history mechanisms for information visualization. We present a design space analysis of both architectural and interface issues, identifying design decisions and associated trade-offs. Based on this analysis, we contribute a design study of graphical history tools for Tableau, a database visualization system. These tools record and visualize interaction histories, support data analysis and communication of findings, and contribute novel mechanisms for presenting, managing, and exporting histories. Furthermore, we have analyzed aggregated collections of history sessions to evaluate Tableau usage. We describe additional tools for analyzing userspsila history logs and how they have been applied to study usage patterns in Tableau.

Abstract: Enhanced image viewing, in which a user's gesture is recognized from first and second images, an interaction command corresponding to the recognized user's gesture is determined, and, based on the determined interaction command, an image object displayed in a user interface is manipulated.

Abstract: Systems, methods, devices and computer program products which relate to utilizing a camera of a mobile terminal as a user interface for search applications and online services to perform visual searching are provided. The system consists of an apparatus that includes a processor that is configured to capture an image of one or more objects and analyze data of the image to identify an object(s) of the image. The processor is further configured to receive information that is associated with at least one object of the images and display the information that is associated with the image. In this regard, the apparatus is able to simplify access to location based services and improve a user's experience. The processor of the apparatus is configured to combine results of robust visual searches with online information resources to enhance location based services.

Abstract: An enhanced interface for voice and video communications, in which a gesture of a user is recognized from a sequence of camera images, and a user interface is provided include a control and a representation of the user. The process also includes causing the representation to interact with the control based on the recognized gesture, and controlling a telecommunication session based on the interaction.

Abstract: Methods, systems, and apparatus, including computer program products, for presenting user interface elements. A first page of one or more user interface elements is presented on a touch-sensitive display. Each of the user interface elements corresponds to a respective application. A gesture performed on the touch-sensitive display is detected. In response to the detected gesture, a second page of one or more user interface elements is presented on the touch-sensitive display.

Abstract: A control system for mounting in a vehicle and for providing information to a portable electronic device for processing by the portable electronic device is shown and described. The control system includes a first interface for communicating with the portable electronic device and a memory device. The control system also includes a processing circuit communicably coupled to the first interface and the memory device, the processing circuit configured to extract information from the memory device and to provide the information to the first interface so that the first interface communicates the information to the portable electronic device. The processing circuit is further configured to determine the capabilities of the portable electronic device based on data received from the portable electronic device via the first interface and to determine whether or not to communicate the information to the portable electronic device based on the determined capabilities.

Abstract: A mobile device having a user interface supporting multiple windows is disclosed. The user interface is suitable for use in any device having a handheld form factor, such as a mobile phone or mobile Internet device. The user interface includes two windows that are displayed on the mobile device's screen. The mobile device may be configured to switch between a single window mode and a dual window mode. The device may also be configured to launch applications in either mode. It may be configured to switch between modes automatically or in response to a user command. The windows may also be re-oriented in response to a change in the device's orientation or to a user's command.

Abstract: In one embodiment of the invention, a method for a minimally invasive surgical system is disclosed. The method includes capturing and displaying camera images of a surgical site on at least one display device at a surgeon console; switching out of a following mode and into a masters-as-mice (MaM) mode; overlaying a graphical user interface (GUI) including an interactive graphical object onto the camera images; and rendering a pointer within the camera images for user interactive control. In the following mode, the input devices of the surgeon console may couple motion into surgical instruments. In the MaM mode, the input devices interact with the GUI and interactive graphical objects. The pointer is manipulated in three dimensions by input devices having at least three degrees of freedom. Interactive graphical objects are related to physical objects in the surgical site or a function thereof and are manipulatable by the input devices.

Abstract: Over the past few years, there has been a quiet revolution in display manufacturing technology. One that is only comparable in scope to that of the invention of the first LCD, which led to DynaBook and the modern laptop. E-ink electrophoretic pixel technology, combined with advances in organic thin-film circuit substrates, have led to displays that are so thin and flexible they are beginning to resemble paper. Soon displays will completely mimic the high contrast, low power consumption and flexibility of printed media. As with the invention of the first LCD, this means we are on the brink of a new paradigm in computer user interface design: one in which computers can have any organic form or shape. One where any object, no matter how complex, dynamic or flexible its structure, may display information. One where the deformation of shape is a main source of input.

Abstract: In accordance with some embodiments, a computer-implemented method is performed at a portable multifunction device with a touch screen display. The computer-implemented method includes: displaying a home menu comprising a plurality of application launch icons; detecting activation of any respective application launch icon; and, in response to detecting the activation, displaying a first animation of a transition from display of the home menu to display of an application that corresponds to the activated application launch icon. The first animation comprises expanding an image of the application.

Abstract: Providing for management of a dynamic mobile coupon (DMC) at a mobile device is described herein. Particularly, dynamic characteristics associated with the DMC, such as a redeemable value, can be utilized to browse, sort, search, recall, or redeem the DMC utilizing a user interface of the mobile device. In other aspects, a DMC management application can interact with server components to backup and store DMC data, synchronize dynamic information (e.g., a dynamic redeemable value), access or manage a user profile, interface with other mobile devices to accomplish sharing, trading, exchanging, selling the DMC, and so on. Accordingly, provided is an efficient and personable way to manage mobile coupons in a mobile operating environment and provide increased value and utility for a user of such coupons.

Abstract: A user interface method and apparatus for a mobile terminal having a touchscreen are provided. The apparatus and method improve interactivity using a toolbar menu mode screen which allows a user to execute functions and commands with drag and drop behaviors on the touchscreen to graphical objects such as toolbar, icons, and other active objects. An interface apparatus includes a touchscreen unit that displays a screen including a second region for presenting a toolbar having at least one User Interface (UI) element representing a specific function and a first region for activating, when the UI element is dragged from the toolbar and dropped in the first region on the touchscreen, the function represented by the UI element. The interface apparatus also includes a control unit which detects a drag and drop action of the UI element and activates, when the drag and drop action is detected, the function associated with the UI element in the form of an active function object. The interface apparatus of the present invention registers the frequently used functions with the toolbar in the form of icons such that, when an icon is dragged from the toolbar to the main window, the function represented by the icon is activated.

Abstract: The article introduces a framework for users' design quality judgments based on Adaptive Decision Making theory. The framework describes judgment on quality attributes (usability, content/functionality, aesthetics, customisation and engagement) with dependencies on decision making arising from the user's background, task and context. The framework is tested and refined by three experimental studies. The first two assessed judgment of quality attributes of websites with similar content but radically different designs for aesthetics and engagement. Halo effects were demonstrated whereby attribution of good quality on one attribute positively influenced judgment on another, even in the face of objective evidence to the contrary (e.g., usability errors). Users' judgment was also shown to be susceptible to framing effects of the task and their background. These appear to change the importance order of the quality attributes; hence, quality assessment of a design appears to be very context dependent. The third study assessed the influence of customisation by experiments on mobile services applications, and demonstrated that evaluation of customisation depends on the users' needs and motivation. The results are discussed in the context of the literature on aesthetic judgment, user experience and trade-offs between usability and hedonic/ludic design qualities.

Abstract: This paper presents a context-aware mobile recommender system, codenamed Magitti. Magitti is unique in that it infers user activity from context and patterns of user behavior and, without its user having to issue a query, automatically generates recommendations for content matching. Extensive field studies of leisure time practices in an urban setting (Tokyo) motivated the idea, shaped the details of its design and provided data describing typical behavior patterns. The paper describes the fieldwork, user interface, system components and functionality, and an evaluation of the Magitti prototype.

Abstract: An electronic device and a user interface display method thereof are provided. The method includes the following steps. First, organize a plurality of computer programs and a web browser executable on the electronic device into a virtual book. Each page of the virtual book includes a user interface of one of the computer programs or a web page displayed by the web browser. Next, display one of the pages as a current page so that the user interface or the web page of the current page is accessible to a user of the electronic device. Next, display a stand-up view of the virtual book in response to a first operating action performed by the user. The stand-up view includes a plurality of the pages adjacent to the current page and a virtual switch attached to a side of the virtual book.

Abstract: A viewer interface for a content delivery system is described. In one embodiment, a method for displaying programming content described. This method, occurring in a receiver controller, includes receiving a user identification from an user interface device; in response to the user identification, activating an interactive graphical display personalized for a viewer identified by the user identification; and displaying, in the interactive graphical display, a menu of programming content that can be personalized for the viewer according to the viewer's viewing preferences, wherein the programming content can be received from at least one of a broadcast transmission and unicast transmission. Other embodiments are also described.

Abstract: A user interface, system, and method are disclosed to facilitate specification of queries and displaying corresponding results. The user interface presents the user with dimensions that contain one or more headings arranged according to an information taxonomy, which can vary based on the intended implementation for the system and user interface. A corresponding filter or query is constructed based on the user selecting of one or more headings. The filter is applied to one or more databases to return results that satisfy the filter. The results are presented in the user interface and can include interactive items based on a particular query as well as can correspond to a fully specified task.

Abstract: Biological imaging is an emerging field, covering a wide range of applications in biological and clinical research. However, while machinery for automated experimenting and data acquisition has been developing rapidly in the past years, automated image analysis often introduces a bottleneck in high content screening. Wndchrm is an open source utility for biological image analysis. The software works by first extracting image content descriptors from the raw image, image transforms, and compound image transforms. Then, the most informative features are selected, and the feature vector of each image is used for classification and similarity measurement. Wndchrm has been tested using several publicly available biological datasets, and provided results which are favorably comparable to the performance of task-specific algorithms developed for these datasets. The simple user interface allows researchers who are not knowledgeable in computer vision methods and have no background in computer programming to apply image analysis to their data. We suggest that wndchrm can be effectively used for a wide range of biological image analysis tasks. Using wndchrm can allow scientists to perform automated biological image analysis while avoiding the costly challenge of implementing computer vision and pattern recognition algorithms.

Abstract: An integrated web-based communications/calendar/organizational/entertainment system provides a user interface to provide the most pertinent data to a user at any time by organizing the data into strips of content organized according to four broad contexts of who, what, when, and where. The user interface focuses information displayed by the interface by automatically adjusting the content displayed by each strip based on a user selection in any one strip.

Abstract: Methods, systems, and computer program products for insider threat detection are provided. Embodiments detect insiders who act on documents and/or files to which they have access but whose activity is inappropriate or uncharacteristic of them based on their identity, past activity, and/or organizational context. Embodiments work by monitoring the network to detect network activity associated with a set of network protocols; processing the detected activity to generate information-use events; generating contextual information associated with users of the network; and processing the information-use events based on the generated contextual information to generate alerts and threat scores for users of the network. Embodiments provide several information-misuse detectors that are used to examine generated information-use events in view of collected contextual information to detect volumetric anomalies, suspicious and/or evasive behavior. Embodiments provide a user threat ranking system and a user interface to examine user threat scores and analyze user activity.

Abstract: An electronic device having a user interface on a display and method for controlling the device, the method including: detecting a proximity of an object to the display; detecting a two-dimensional motion pattern of the object; and controlling the user interface according to the detected two-dimensional motion pattern. Also, a method including: detecting an object in a space over a border between first and second zones of a plurality of touch-sensitive zones and outputting a detection signal; and simultaneously displaying first and second information elements corresponding to the first and second zones in response to the detection signal.