Proceedings Article10.1109/IJCNN.2010.5596571
Projection Vector Machine: One-stage learning algorithm from high-dimension small-sample data
Wan-Yu Deng,Qinghua Zheng,Shiguo Lian,Lin Chen,Xin Wang +4 more
- 18 Jul 2010
- pp 1-8
9
TL;DR: It is given proof that PVM is a universal approximator for high-dimension small-sample data, which combines dimension reduction with network training and removes the redundancy in dimension reduction and network training.
read more
Abstract: The presence of fewer samples and large number of input features increases the complexity of the classifier and degrades the stability. Thus, dimension reduction was always carried before supervised learning algorithms such as neural network. This two-stage framework is somewhat redundant in dimension reduction and network training. This paper proposes a novel one-stage learning algorithm for high-dimension small-sample data, called Projection Vector Machine (PVM), which combines dimension reduction with network training and removes the redundancy. Through dimension reduction operation such as singular vector decomposition (SVD), we not only reduce the dimension but also obtain the size of single-hidden layer feedforward neural network (SLFN) and input weight values simultaneously. This size-fixed network will become linear programming system and thus the output weights can be determined by simple least square method. Unlike traditional backpropagation feedforward neural network (BP), parameters in PVM don't need iterative tuning and thus its training speed is much faster than BP. Unlike extreme learning machine (ELM) proposed by Huang [G.-B. Huang, Q.-Y. Zhu, C.-K. Siew, Extreme learning machine: theory and applications, Neurocomputing 70 (2006) 489–501] which assigns input weights randomly, PVM's input weights are ranked by singular values and select the optimal weights order by singular value. We give proof that PVM is a universal approximator for high-dimension small-sample data. Experimental results show that the proposed one-stage algorithm PVM is faster than two-stage learning approach such as SVD+BP and SVD+ELM.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Multispectral palmprint recognition using multiclass projection extreme learning machine and digital shearlet transform
TL;DR: A novel multispectral palmprint recognition method based on multiclass projection extreme learning machine (MPELM) and digital shearlet transform and the proposed MPELM-based method outperforms the SVM-based and ELM- based methods.
39
•Journal Article
Nonlinear dimension reduction via local tangent space alignment
Zhenyue Zhang,Hongyuan Zha +1 more
TL;DR: In this article, the local geometry of the manifold is represented by tangent spaces learned by fitting an affine subspace in a neighborhood of each data point, aligned to give the internal global coordinates of the data points with respect to the underlying manifold by way of a partial eigendecomposition of the neighborhood connection matrix.
21
An AI Software Test Method Based on Scene Deductive Approach
Xinghan Zhao,Xiangfei Gao +1 more
- 16 Jul 2018
TL;DR: This paper proposes an AI software testing method based on scene deductive approach that models the input, output parameters and the environment, uses the random algorithm to generate the inputs of the test cases, and uses the algorithm of deductedive approach to make the software testing automatically, and use the test assertions to verify the results of thetest.
12
Adaptive personalized recommendation based on adaptive learning
TL;DR: Empirical evaluation of the proposed novel adaptive personalized recommendation demonstrates that it is possible to obtain accuracy comparable to that of the correlation-based, SVD-based and supervised learning-based approaches at a much lower computational cost.
11
Fault Diagnosis for Engine Based on Single-Stage Extreme Learning Machine
Fei Gao,Jiangang Lv +1 more
TL;DR: Single-Stage Extreme Learning Machine (SS-ELM) is presented to dispose of the mechanical fault diagnosis and the eigenvectors extracted from signal processing methods are directly regarded as outputs of the network’s hidden layer.
References
•Book
The Nature of Statistical Learning Theory
Vladimir Vapnik
- 01 Jan 1995
TL;DR: Setting of the learning problem consistency of learning processes bounds on the rate of convergence ofLearning processes controlling the generalization ability of learning process constructing learning algorithms what is important in learning theory?
46K
•Book
Neural Networks: A Comprehensive Foundation
Simon Haykin
- 16 Jul 1998
TL;DR: Thorough, well-organized, and completely up to date, this book examines all the important aspects of this emerging technology, including the learning process, back-propagation learning, radial-basis function networks, self-organizing systems, modular networks, temporal processing and neurodynamics, and VLSI implementation of neural networks.
Reducing the Dimensionality of Data with Neural Networks
TL;DR: In this article, an effective way of initializing the weights that allows deep autoencoder networks to learn low-dimensional codes that work much better than principal components analysis as a tool to reduce the dimensionality of data is described.
Nonlinear dimensionality reduction by locally linear embedding.
Sam T. Roweis,Lawrence K. Saul +1 more
TL;DR: Locally linear embedding (LLE) is introduced, an unsupervised learning algorithm that computes low-dimensional, neighborhood-preserving embeddings of high-dimensional inputs that learns the global structure of nonlinear manifolds.
A global geometric framework for nonlinear dimensionality reduction.
TL;DR: An approach to solving dimensionality reduction problems that uses easily measured local metric information to learn the underlying global geometry of a data set and efficiently computes a globally optimal solution, and is guaranteed to converge asymptotically to the true structure.