Book Chapter10.1007/BFB0020217
Kernel Principal Component Analysis
Bernhard Schölkopf,Alexander J. Smola,Klaus-Robert Müller +2 more
- 08 Oct 1997
- pp 583-588
2.6K
TL;DR: A new method for performing a nonlinear form of Principal Component Analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
read more
Abstract: A new method for performing a nonlinear form of Principal Component Analysis is proposed. By the use of integral operator kernel functions, one can efficiently compute principal components in highdimensional feature spaces, related to input space by some nonlinear map; for instance the space of all possible d-pixel products in images. We give the derivation of the method and present experimental results on polynomial feature extraction for pattern recognition.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
•Proceedings Article
Hypothesis testing using pairwise distances and associated kernels
Dino Sejdinovic,Arthur Gretton,Arthur Gretton,Kenji Fukumizu,Bharath K. Sriperumbudur +4 more
- 26 Jun 2012
TL;DR: It is shown that the energy distance most commonly employed in statistics is just one member of a parametric family of kernels, and that other choices from this family can yield more powerful tests.
•Proceedings Article
Truth or backpropaganda? An empirical investigation of deep learning theory
Micah Goldblum,Jonas Geiping,Avi Schwarzschild,Michael Moeller,Tom Goldstein +4 more
- 30 Apr 2020
TL;DR: It is proved the widespread existence of suboptimal local minima in the loss landscape of neural networks, and it is shown that small-norm parameters are not optimal for generalization and rank does not correlate with generalization or robustness in a practical setting.
Population structure at different minor allele frequency levels
Omar De la Cruz,Paola Raska +1 more
TL;DR: Using the Genetic Analysis Workshop 18 data set for 142 unrelated individuals, the following hypothesis is studied: the difference in detected structure is the result of a "scale" effect; that is, rare variants are likely to be shared only locally while common variants can be spread over longer distances.
Constructing and Visualizing High-Quality Classifier Decision Boundary Maps
TL;DR: An extensive evaluation considering the dimensionality-reduction (DR) projection techniques underlying decision map construction is performed, extending the visual accuracy of decision maps by proposing additional techniques to suppress errors caused by projection distortions and proposing ways to estimate and visually encode the distance-to-decision-boundary in decision maps.
36
Improved Statistical Fault Detection Technique and Application to Biological Phenomena Modeled by S-Systems
TL;DR: A KPCA-based EWMA-GLRT method is developed and utilized in practice to improve fault detection in biological phenomena modeled by S-systems and to enhance monitoring process mean.
36
References
Support-Vector Networks
Corinna Cortes,Vladimir Vapnik +1 more
TL;DR: High generalization ability of support-vector networks utilizing polynomial input transformations is demonstrated and the performance of the support- vector network is compared to various classical learning algorithms that all took part in a benchmark study of Optical Character Recognition.
A training algorithm for optimal margin classifiers
Bernhard E. Boser,Isabelle Guyon,Vladimir Vapnik +2 more
- 01 Jul 1992
TL;DR: A training algorithm that maximizes the margin between the training patterns and the decision boundary is presented, applicable to a wide variety of the classification functions, including Perceptrons, polynomials, and Radial Basis Functions.
Nonlinear component analysis as a kernel eigenvalue problem
TL;DR: A new method for performing a nonlinear form of principal component analysis by the use of integral operator kernel functions is proposed and experimental results on polynomial feature extraction for pattern recognition are presented.
Application of the Karhunen-Loeve procedure for the characterization of human faces
Michael Kirby,Lawrence Sirovich +1 more
TL;DR: The use of natural symmetries (mirror images) in a well-defined family of patterns (human faces) is discussed within the framework of the Karhunen-Loeve expansion, which results in an extension of the data and imposes even and odd symmetry on the eigenfunctions of the covariance matrix.
2.8K
Simplified neuron model as a principal component analyzer
TL;DR: A simple linear neuron model with constrained Hebbian-type synaptic modification is analyzed and a new class of unconstrained learning rules is derived.
2.6K