Proceedings Article10.1145/1242572.1242638
Supervised rank aggregation
Yuting Liu,Tie-Yan Liu,Tao Qin,Zhi-Ming Ma,Hang Li +4 more
- 08 May 2007
- pp 481-490
TL;DR: Experimental results on meta-searches show that Supervised Rank Aggregation can significantly outperform existing unsupervised methods and it is proved that the optimization problem can be transformed into that of Semidefinite Programming and solve it efficiently.
read more
Abstract: This paper is concerned with rank aggregation, the task of combining the ranking results of individual rankers at meta-search. Previously, rank aggregation was performed mainly by means of unsupervised learning. To further enhance ranking accuracies, we propose employing supervised learning to perform the task, using labeled data. We refer to the approach as Supervised Rank Aggregation. We set up a general framework for conducting Supervised Rank Aggregation, in which learning is formalized an optimization which minimizes disagreements between ranking results and the labeled data. As case study, we focus on Markov Chain based rank aggregation in this paper. The optimization for Markov Chain based methods is not a convex optimization problem, however, and thus is hard to solve. We prove that we can transform the optimization problem into that of Semidefinite Programming and solve it efficiently. Experimental results on meta-searches show that Supervised Rank Aggregation can significantly outperform existing unsupervised methods.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
•Book
Learning to Rank for Information Retrieval
Tie-Yan Liu
- 27 Jun 2009
TL;DR: Three major approaches to learning to rank are introduced, i.e., the pointwise, pairwise, and listwise approaches, the relationship between the loss functions used in these approaches and the widely-used IR evaluation measures are analyzed, and the performance of these approaches on the LETOR benchmark datasets is evaluated.
Learning to rank: from pairwise approach to listwise approach
Zhe Cao,Tao Qin,Tie-Yan Liu,Ming-Feng Tsai,Hang Li +4 more
- 20 Jun 2007
TL;DR: It is proposed that learning to rank should adopt the listwise approach in which lists of objects are used as 'instances' in learning, and introduces two probability models, respectively referred to as permutation probability and top k probability, to define a listwise loss function for learning.
2.4K
Learning to Rank for Information Retrieval
TL;DR: A statistical ranking theory is introduced, which can describe different learning-to-rank algorithms, and be used to analyze their query-level generalization abilities.
Recognizing contributions in wikis: Authorship categories, algorithms, and visualizations
Ofer Arazy,Eleni Stroulia,Stan Ruecker,Cristina Arias,Carlos Fiorentino,Veselin Ganev,Timothy Yau +6 more
TL;DR: It is demonstrated that the proposed automated techniques can estimate fairly accurately the quantity of editors' contributions across various authorship categories, and that the visualizations introduced can clearly convey this information to users.
587
•Book
Learning to Rank for Information Retrieval and Natural Language Processing
Hang Li
- 22 Apr 2011
TL;DR: The author explains several example applications of learning to rank including web search, collaborative filtering, definition search, keyphrase extraction, query dependent summarization, and re-ranking in machine translation.
336
References
•Book
Modern Information Retrieval
Ricardo Baeza-Yates,Berthier Ribeiro-Neto +1 more
- 15 May 1999
TL;DR: In this article, the authors present a rigorous and complete textbook for a first course on information retrieval from the computer science (as opposed to a user-centred) perspective, which provides an up-to-date student oriented treatment of the subject.
Cumulated gain-based evaluation of IR techniques
TL;DR: This article proposes several novel measures that compute the cumulative gain the user obtains by examining the retrieval result up to a given ranked position, and test results indicate that the proposed measures credit IR methods for their ability to retrieve highly relevant documents and allow testing of statistical significance of effectiveness differences.
5.3K
Storing and querying ordered XML using a relational database system
Igor Tatarinov,Stratis D. Viglas,Kevin Scott Beyer,Jayavel Shanmugasundaram,Eugene J. Shekita,Chun Zhang +5 more
- 03 Jun 2002
TL;DR: This paper shows that XML's ordered data model can indeed be efficiently supported by a relational database system, and proposes three order encoding methods that can be used to represent XML order in the relational data model, and also proposes algorithms for translating ordered XPath expressions into SQL using these encoding methods.
2.4K
Rank aggregation methods for the Web
Cynthia Dwork,Ravi Kumar,Moni Naor,Dandapani Sivakumar +3 more
- 01 Apr 2001
TL;DR: A set of techniques for the rank aggregation problem is developed and compared to that of well-known methods, to design rank aggregation techniques that can be used to combat spam in Web searches.
IR evaluation methods for retrieving highly relevant documents
Kalervo Järvelin,Jaana Kekäläinen +1 more
- 01 Jul 2000
TL;DR: The novel evaluation methods and the case demonstrate that non-dichotomous relevance assessments are applicable in IR experiments, may reveal interesting phenomena, and allow harder testing of IR methods.
1.5K
Related Papers (5)
Cynthia Dwork,Ravi Kumar,Moni Naor,Dandapani Sivakumar +3 more
- 01 Apr 2001
Javed A. Aslam,Mark Montague +1 more
- 01 Sep 2001
Thorsten Joachims
- 23 Jul 2002
Edward A. Fox,Joseph A. Shaw +1 more
- 01 Jan 1994