Open AccessProceedings Article
Stacked Density Estimation
Padhraic Smyth,David H. Wolpert +1 more
- 01 Dec 1997
- pp 668-674
TL;DR: The technique of stacking, previously only used for supervised learning, is applied to unsupervised learning and used for non-parametric multivariate density estimation, to combine finite mixture model and kernel density estimators.
read more
Abstract: In this paper, the technique of stacking, previously only used for supervised learning, is applied to unsupervised learning. Specifically, it is used for non-parametric multivariate density estimation, to combine finite mixture model and kernel density estimators. Experimental results on both simulated data and real world data sets clearly demonstrate that stacked density estimation outperforms other strategies such as choosing the single best model based on cross-validation, combining with uniform weights, and even the single best model chosen by "cheating" by looking at the data used for independent testing.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Issues in stacked generalization
Kai Ming Ting,Ian H. Witten +1 more
TL;DR: This paper addresses two crucial issues which have been considered to be a 'black art' in classification tasks ever since the introduction of stacked generalization: the type of generalizer that is suitable to derive the higher-level model, and the kind of attributes that should be used as its input.
A comprehensive review on ensemble deep learning: Opportunities and challenges
Ammar Mohammed,Rania Kora +1 more
TL;DR: A comprehensive review of the various strategies for ensemble learning, especially in the case of deep learning, is provided in this paper , where various features or factors that influence the success of ensemble methods are discussed.
439
Multifactorial Evolutionary Algorithm With Online Transfer Parameter Estimation: MFEA-II
TL;DR: A novel evolutionary computation framework is proposed that enables online learning and exploitation of the similarities (and discrepancies) between distinct tasks in multitask settings, for an enhanced optimization process.
381
Enhancing disease surveillance with novel data streams: challenges and opportunities
Benjamin M. Althouse,Samuel V. Scarpino,Lauren Ancel Meyers,Lauren Ancel Meyers,John W. Ayers,Marisa Bargsten,Joan Baumbach,John S. Brownstein,John S. Brownstein,John S. Brownstein,Lauren Castro,Hannah E. Clapham,Derek A. T. Cummings,Sara Y. Del Valle,Stephen Eubank,Geoffrey Fairchild,Lyn Finelli,Nicholas Generous,Dylan B. George,David R. Harper,Laurent Hébert-Dufresne,Michael A. Johansson,Kevin J. Konty,Marc Lipsitch,Gabriel J. Milinovich,Joseph D. Miller,Elaine O. Nsoesie,Elaine O. Nsoesie,Donald R. Olson,Michael J. Paul,Philip M. Polgreen,Reid Priedhorsky,Jonathan M. Read,Isabel Rodriguez-Barraquer,Derek J. Smith,Christian Stefansen,David L. Swerdlow,Deborah L. Thompson,Alessandro Vespignani,Amy Wesolowski +39 more
TL;DR: This paper outlines a conceptual framework for integrating NDS into current public health surveillance and presents the case that clearly articulating surveillance objectives and systematically evaluating NDS and comparing the performance of NDS to existing surveillance data and alternative NDS data is critical.
Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization
TL;DR: This paper introduces a novel evolutionary computation framework that enables online learning and exploitation of similarities across optimization problems, with the goal of achieving an algorithmic realization of the transfer optimization paradigm.
137
References
Bagging predictors
Leo Breiman
- 01 Aug 1996
TL;DR: Tests on real and simulated data sets using classification and regression trees and subset selection in linear regression show that bagging can give substantial gains in accuracy.
Original Contribution: Stacked generalization
TL;DR: The conclusion is that for almost any real-world generalization problem one should use some version of stacked generalization to minimize the generalization error rate.
7.5K
•Book
Statistical analysis of finite mixture distributions
D. M. Titterington,Adrian F. M. Smith,Udi Makov +2 more
- 01 Jan 1986
TL;DR: This course discusses Mathematical Aspects of Mixtures, Sequential Problems and Procedures, and Applications of Finite Mixture Models.
3.5K
Bayesian Density Estimation and Inference Using Mixtures
Michael Escobar,Mike West +1 more
TL;DR: In this article, the authors describe and illustrate Bayesian inference in models for density estimation using mixtures of Dirichlet processes and show convergence results for a general class of normal mixture models.
2.6K
Model-based Gaussian and non-Gaussian clustering
TL;DR: The classification maximum likelihood approach is sufficiently general to encompass many current clustering algorithms, including those based on the sum of squares criterion and on the criterion of Friedman and Rubin (1967), but it is restricted to Gaussian distributions and it does not allow for noise.
2.5K