Book Chapter10.1007/BFB0020217
Kernel Principal Component Analysis
Bernhard Schölkopf,Alexander J. Smola,Klaus-Robert Müller +2 more
- 08 Oct 1997
- pp 583-588
2.6K
TL;DR: A new method for performing a nonlinear form of Principal Component Analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
read more
Abstract: A new method for performing a nonlinear form of Principal Component Analysis is proposed. By the use of integral operator kernel functions, one can efficiently compute principal components in highdimensional feature spaces, related to input space by some nonlinear map; for instance the space of all possible d-pixel products in images. We give the derivation of the method and present experimental results on polynomial feature extraction for pattern recognition.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals
Roberto Vega,Touqir Sajed,Kory Wallace Mathewson,Kriti Khare,Patrick M. Pilarski,Russell Greiner,Gildardo Sanchez-Ante,Javier M. Antelis +7 more
TL;DR: In this paper, a detailed assessment of feature selection techniques, viz, squared Pearson correlation (R 2 ), principal componentanalysis (PCA), kernel principal component analysis (kPCA) and fast correlation-based filter (FCBF), and the learning algorithms: linear discriminant analysis (LDA), support vector machines (SVM), and feed forward neural network (NN).
•Proceedings Article
Semi-Supervised SimHash for Efficient Document Similarity Search
Qixia Jiang,Maosong Sun +1 more
- 19 Jun 2011
TL;DR: This paper proposes a novel (semi-)supervised hashing method named Semi-Supervised SimHash (S3H) for high-dimensional data similarity search that learns the optimal feature weights from prior knowledge to relocate the data such that similar data have similar hash codes.
25
Missing Data Recovery for High-Dimensional Signals With Nonlinear Low-Dimensional Structures
TL;DR: This work proposes a novel model, termed as “union and sums of subspaces,” to characterize practical nonlinear datasets, and proposes convex-optimization-based methods to recover missing entries under this model.
A novel variable selection approach based on co-linearity index to discover optimal process settings by analysing mixed data
Cinzia Giannetti,Rajesh S. Ransing,Meghana R. Ransing,David Bould,David T. Gethin,Johann Sienz +5 more
TL;DR: The proposed method allows process variables with skewed distribution to contribute more to the variance than Gaussian distributed variables so that these variables can be investigated further, if necessary, and can be used in real industrial settings to assist process engineers in manufacturing diagnosis and root cause analysis.
24
Kernel Sliced Inverse Regression: Regularization and Consistency
TL;DR: Two types of regularization are applied in this framework for nonlinear dimension reduction using the mapping induced by kernels to address computational stability and generalization performance.
References
Support-Vector Networks
Corinna Cortes,Vladimir Vapnik +1 more
TL;DR: High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
A training algorithm for optimal margin classifiers
Bernhard E. Boser,Isabelle Guyon,Vladimir Vapnik +2 more
- 01 Jul 1992
TL;DR: A training algorithm that maximizes the margin between the training patterns and the decision boundary is presented, applicable to a wide variety of the classification functions, including Perceptrons, polynomials, and Radial Basis Functions.
Nonlinear component analysis as a kernel eigenvalue problem
TL;DR: A new method for performing a nonlinear form of principal component analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
Application of the Karhunen-Loeve procedure for the characterization of human faces
Michael Kirby,Lawrence Sirovich +1 more
TL;DR: The use of natural symmetries (mirror images) in a well-defined family of patterns (human faces) is discussed within the framework of the Karhunen-Loeve expansion, which results in an extension of the data and imposes even and odd symmetry on the eigenfunctions of the covariance matrix.
2.8K
Simplified neuron model as a principal component analyzer
TL;DR: A simple linear neuron model with constrained Hebbian-type synaptic modification is analyzed and a new class of unconstrained learning rules is derived.
2.6K