Open AccessProceedings Article
Feature and kernel learning.
Verónica Bolón-Canedo,Michele Donini,Fabio Aiolli +2 more
- 01 Jan 2015
TL;DR: A survey of recent methods developed for feature selection/learning and their application to real world problems is provided, together with a review of the contributions to the ESANN 2015 special session on Feature and Kernel Learning.
read more
Abstract: Feature selection and weighting has been an active research area in the last few decades nding success in many dierent applications. With the advent of Big Data, the adequate identication of the relevant features has converted feature selection in an even more indispensable step. On the other side, in kernel methods features are implicitly represented by means of feature mappings and kernels. It has been shown that the correct selection of the kernel is a crucial task, as long as an erroneous se- lection can lead to poor performance. Unfortunately, manually searching for an optimal kernel is a time-consuming and a sub-optimal choice. This tutorial is concerned with the use of data to learn features and kernels au- tomatically. We provide a survey of recent methods developed for feature selection/learning and their application to real world problems, together with a review of the contributions to the ESANN 2015 special session on Feature and Kernel Learning. 1 Feature learning In the last few years, several datasets with high dimensionality have become publicly available on the Internet. This fact has brought an interesting challenge to the research community, since for the machine learning methods it is dicult to deal with a high number of input features. To cope with the problem of the high number of input features, dimensionality reduction techniques can be applied to reduce the dimensionality of the original data and improve learning performance. These dimensionality reduction techniques usually come in two
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Vessels fuel consumption forecast and trim optimisation: A data analytics perspective
TL;DR: In this paper, the authors investigated the problems of predicting the fuel consumption and of providing the best value for the trim of a vessel in real operations based on data measured by the onboard automation systems.
159
Multiple Graph-Kernel Learning
Fabio Aiolli,Michele Donini,Nicolò Navarin,Alessandro Sperduti +3 more
- 01 Dec 2015
TL;DR: A Multiple Kernel Learning (MKL) approach to learn different weights of different bunches of features which are grouped by complexity, and defines a notion of kernel complexity, namely Kernel Spectral Complexity, and shows how this complexity relates to the well-known Empirical Rademacher Complexity for a natural class of functions which include SVM.
Measuring the expressivity of graph kernels through Statistical Learning Theory
TL;DR: Different formal definitions of expressiveness of a kernel are provided by exploiting the most recent results in the field of Statistical Learning Theory, and the differences among some state-of-the-art graph kernels are analyzed.
23
Learning With Kernels: A Local Rademacher Complexity-Based Analysis With Application to Graph Kernels
Luca Oneto,Nicolò Navarin,Michele Donini,Sandro Ridella,Alessandro Sperduti,Fabio Aiolli,Davide Anguita +6 more
TL;DR: A new approach is shown to efficiently bound the RC of the space induced by a kernel, since its exact computation is an NP-Hard problem and it is shown for the first time that RC can be used to estimate the accuracy and expressivity of different graph kernels under different parameter configurations.
15
•Proceedings Article
Learning dot-product polynomials for multiclass problems.
Ivano Lauriola,Michele Donini,Fabio Aiolli +2 more
- 01 Jan 2017
TL;DR: This work proposes an efficient learning procedure to reduce the searching space of hyperparameters, showing its empirically effectiveness.
7
References
Principal Component Analysis
Ian T. Jolliffe
- 15 Oct 2005
TL;DR: Principal component analysis (PCA) as discussed by the authors replaces the p original variables by a smaller number, q, of derived variables, the principal components, which are linear combinations of the original variables.
15.1K
Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy
TL;DR: In this article, the maximal statistical dependency criterion based on mutual information (mRMR) was proposed to select good features according to the maximal dependency condition. But the problem of feature selection is not solved by directly implementing mRMR.
9.9K
Gene Selection for Cancer Classification using Support Vector Machines
TL;DR: In this article, a Support Vector Machine (SVM) method based on recursive feature elimination (RFE) was proposed to select a small subset of genes from broad patterns of gene expression data, recorded on DNA micro-arrays.
Feature selection based on mutual information: criteria ofmax-dependency, max-relevance, and min-redundancy
Hanchuan Peng,Fuhui Long,Chris Ding +2 more
- 05 Aug 2003
TL;DR: This work derives an equivalent form, called minimal-redundancy-maximal-relevance criterion (mRMR), for first-order incremental feature selection, and presents a two-stage feature selection algorithm by combining mRMR and other more sophisticated feature selectors (e.g., wrappers).
8K
A review of feature selection techniques in bioinformatics
TL;DR: A basic taxonomy of feature selection techniques is provided, providing their use, variety and potential in a number of both common as well as upcoming bioinformatics applications.
5.4K
Related Papers (5)
John Shawe-Taylor,Nello Cristianini +1 more
- 01 Jan 2004
Thosini Bamunu Mudiyanselage,Yan-Qing Zhang +1 more
- 14 Mar 2019
K. Sutha,J. Jebamalar Tamilselvi +1 more
- 01 Jan 2015
Huan Liu,Zheng Zhao +1 more
- 01 Jan 2010
G. Saranya,A. Pravin +1 more
- 01 Jan 2021