User-Oriented Evaluation Methods for Interactive Web Search Interfaces
Orland Hoeber,Xue Dong Yang +1 more
- 02 Nov 2007
- pp 239-243
TL;DR: This paper highlights some of the methods used in the literature for evaluating Web search systems, and presents a summary of the Methods found to be effective in dealing with the challenges of evaluating intelligent and interactive Web search interfaces.
read more
Abstract: Although significant efforts have been devoted to the study and evaluation of information retrieval systems from an algorithmic perspective, far less work has been performed on the evaluation of these systems from the user's perspective. This is certainly the case for Web information retrieval, where the major search engines continue to utilise interfaces that have not changed substantially since their introduction. One of the challenges in developing new Web search interfaces is the evaluation of these systems in comparison to one another, as well as in comparison to the popular Web search engines. In this paper, we highlight some of the methods used in the literature for evaluating Web search systems, and present a summary of the methods that we have found to be effective in dealing with the challenges of evaluating intelligent and interactive Web search interfaces.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
•Book
Geographic Information Retrieval: Progress and Challenges in Spatial Search of Text
Ross S. Purves,Paul Clough,Christopher B. Jones,Mark M. Hall,Vanessa Murdock +4 more
- 21 Feb 2018
TL;DR: The field of Geographic Information Retrieval (GIR) is described that seeks to develop spatially-aware search systems and support user’s geographical information needs and key remaining research challenges in GIR are identified.
A user-centred evaluation framework for the Sealife semantic web browsers
Helen Oliver,Gayo Diallo,Ed de Quincey,Dimitra Alexopoulou,Bianca Habermann,Patty Kostkova,Michael Schroeder,Simon Jupp,Khaled Khelif,Robert Stevens,Gawesh Jawaheer,Gemma Madle +11 more
TL;DR: A user-centred evaluation framework was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability and found that the browser with the most mature and polished interface was rated higher for usability and semantic links were used by the users of all three browsers.
Structured data clouding across multiple webs
TL;DR: The notion of inCloud (information Cloud) is introduced and an approach to web resource clouding for the construction of in clouds is proposed, built for a target entity of interest by distinguishing how much prominent the retrieved web resource(s) are with respect to the target entity.
22
Evaluating citation visualization and exploration methods for supporting academic search tasks
Orland Hoeber,Taraneh Khazaei +1 more
TL;DR: A novel visualisation interface called Bow Tie Academic Search is developed to address some of the shortcomings of the existing search interfaces for academic searchers, and the findings from a user evaluation are presented.
10
•Dissertation
Effective, usable and learnable semantic search
Khadija Elbedweihy
- 28 May 2014
TL;DR: The thesis presents thorough analysis of state-of-the-art in semantic search evaluations and describes a set of best practices for running them based on this analysis, lessons learnt from the Information Retrieval community and on my own experience in evaluating semantic search approaches.
8
References
Interaction design: beyond human-computer interaction
TL;DR: There's Not an App for ThatOptimizing Human-Computer Interaction With Emerging TechnologiesCross-disciplinary Advances in Human Computer InteractionInteraction Design human-computer Interaction interdisciplinary Interaction Design interaction designAbout FaceDesigning the User InterfaceFuture InteractiondesignDesign for How People ThinkThoughtful Interaction design human-Computer interaction.
3.6K
•Book
Usability Engineering: Scenario-Based Development of Human-Computer Interaction
Mary Beth Rosson,John M. Carroll +1 more
- 20 Oct 2001
TL;DR: Usability Engineering: Scenario-Based Development of Human-Computer Interaction as discussed by the authors focuses on the realities of product development, showing how user interaction scenarios can make usability practices an integral part of interactive system development.
1.2K
Searching the Web: the public and their queries
TL;DR: It is found that most people use few search terms, few modified queries, view few Web pages, and rarely use advanced search features, and the language of Web queries is distinctive.
•Book
Interaction Design
Jenny Preece,Yvonne Rogers,Helen Sharp +2 more
- 01 Jan 2002
TL;DR: Preece, Rogers and Sharp as mentioned in this paper have written a key new textbook on interaction design, which covers psychological and social aspects of users, interaction styles, user requirements, design approaches, usability and evaluation, traditional and future interface paradigms and the role of theory in informing design.
973
Reexamining the cluster hypothesis: scatter/gather on retrieval results
Marti A. Hearst,Jan O. Pedersen +1 more
- 18 Aug 1996
TL;DR: This work systematically evaluates Scatter/Gather in this context and finds significant improvements over similarity search ranking alone and provides evidence validating the cluster hypothesis which states that relevant documents tend to be more similar to each other than to non-relevant documents.
Related Papers (5)
Chen Ding,J.C. Patra,Fu Cheng Peng +2 more
- 29 Mar 2005
Sungrim Kim,Joonhee Kwon +1 more
- 01 Jan 2009
Rakesh Kumar,Aditi Sharan +1 more
- 03 Apr 2014
Tarmo Robal,Ahto Kalja +1 more
- 17 Sep 2012
Vincenza Carchiolo,Alessandro Longheu,Michele Malgeri +2 more
- 13 Oct 2003