Book Chapter10.1007/BFB0020217
Kernel Principal Component Analysis
Bernhard Schölkopf,Alexander J. Smola,Klaus-Robert Müller +2 more
- 08 Oct 1997
- pp 583-588
2.6K
TL;DR: A new method for performing a nonlinear form of Principal Component Analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
read more
Abstract: A new method for performing a nonlinear form of Principal Component Analysis is proposed. By the use of integral operator kernel functions, one can efficiently compute principal components in highdimensional feature spaces, related to input space by some nonlinear map; for instance the space of all possible d-pixel products in images. We give the derivation of the method and present experimental results on polynomial feature extraction for pattern recognition.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Robust support vector data description for novelty detection with contaminated data
Kunzhe Wang,Haibin Lan +1 more
TL;DR: This work proposes to assign weight to each observation based on the Stahel–Donoho outlyingness in an arbitrary kernel space to avoid the masking effect and demonstrates superiority of the proposed method in terms of AUC for contaminated data.
23
Comparative study on dimension reduction techniques for cluster analysis of microarray data
Daniel Araújo,Adrião Duarte Dória Neto,Allan de Medeiros Martins,Jorge Dantas de Melo +3 more
- 03 Oct 2011
TL;DR: Overall results showed that using DRTs provides a improvement in performance of all algorithms tested, specially in the hierarchical class, and Principal Component Analysis was overcome by other nonlinear methods and it did not provide a substantial performance increase in the clustering algorithms.
23
Generalized Laplacian Eigenmaps for Modeling and Tracking Human Motions
TL;DR: Graph-based particle filter is introduced, a novel methodology conceived for efficient tracking in low dimensional space derived from a spectral dimensionality reduction method that achieves state-of-the-art performance for human pose tracking in underconstrained scenarios.
22
Non-linear Causal Inference Using Gaussianity Measures.
Daniel Hernández-Lobato,Pablo Morales-Mombiela,David Lopez-Paz,Alberto Suárez +3 more
- 01 Jan 2019
TL;DR: Theoretical and empirical evidence is provided for a type of asymmetry between causes and effects that is present when these are related via linear models contaminated with additive non-Gaussian noise and the proposed method is shown to be competitive with state-of-the-art techniques for causal inference.
Inverting nonlinear dimensionality reduction with scale-free radial basis function interpolation
TL;DR: In this paper, a scale-free cubic RBF kernel was proposed to interpolate the inverse map everywhere on the low-dimensional image of the forward map. But the proposed construction is similar to the Nystrom extension of the eigenvectors of the symmetric normalized graph Laplacian matrix.
22
References
Support-Vector Networks
Corinna Cortes,Vladimir Vapnik +1 more
TL;DR: High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
A training algorithm for optimal margin classifiers
Bernhard E. Boser,Isabelle Guyon,Vladimir Vapnik +2 more
- 01 Jul 1992
TL;DR: A training algorithm that maximizes the margin between the training patterns and the decision boundary is presented, applicable to a wide variety of the classification functions, including Perceptrons, polynomials, and Radial Basis Functions.
Nonlinear component analysis as a kernel eigenvalue problem
TL;DR: A new method for performing a nonlinear form of principal component analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
Application of the Karhunen-Loeve procedure for the characterization of human faces
Michael Kirby,Lawrence Sirovich +1 more
TL;DR: The use of natural symmetries (mirror images) in a well-defined family of patterns (human faces) is discussed within the framework of the Karhunen-Loeve expansion, which results in an extension of the data and imposes even and odd symmetry on the eigenfunctions of the covariance matrix.
2.8K
Simplified neuron model as a principal component analyzer
TL;DR: A simple linear neuron model with constrained Hebbian-type synaptic modification is analyzed and a new class of unconstrained learning rules is derived.
2.6K