Open AccessProceedings Article
Robust supervised learning
J. Andrew Bagnell
- 09 Jul 2005
- pp 714-719
TL;DR: This work considers a novel framework where a learner may influence the test distribution in a bounded way and derives an efficient algorithm that acts as a wrapper around a broad class of existing supervised learning algorithms while guarranteeing more robust behavior under changes in the input distribution.
read more
Abstract: Supervised machine learning techniques developed in the Probably Approximately Correct, Maximum A Posteriori, and Structural Risk Minimiziation frameworks typically make the assumption that the test data a learner is applied to is drawn from the same distribution as the training data. In various prominent applications of learning techniques, from robotics to medical diagnosis to process control, this assumption is violated. We consider a novel framework where a learner may influence the test distribution in a bounded way. From this framework, we derive an efficient algorithm that acts as a wrapper around a broad class of existing supervised learning algorithms while guarranteeing more robust behavior under changes in the input distribution.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
•Posted Content
Invariant Risk Minimization
TL;DR: This work introduces Invariant Risk Minimization, a learning paradigm to estimate invariant correlations across multiple training distributions and shows how the invariances learned by IRM relate to the causal structures governing the data and enable out-of-distribution generalization.
1.6K
•Posted Content
Out-of-Distribution Generalization via Risk Extrapolation (REx)
David Krueger,Ethan Caballero,Joern-Henrik Jacobsen,Amy Zhang,Jonathan Binas,Dinghuai Zhang,Rémi Le Priol,Aaron Courville +7 more
TL;DR: This work introduces the principle of Risk Extrapolation (REx), and shows conceptually how this principle enables extrapolation, and demonstrates the effectiveness and scalability of instantiations of REx on various OoD generalization tasks.
729
•Posted Content
Domain-Adversarial Neural Networks
TL;DR: A new neural network learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions, which has better performance than either a standard neural networks and a SVM.
•Posted Content
Generative Multi-Adversarial Networks
TL;DR: In this paper, a generative multi-adversarial network (GMAN) is proposed, which extends GANs to multiple discriminators and explores a number of design perspectives with the discriminator role ranging from formidable adversary to forgiving teacher.
326
Robust predictive model for evaluating breast cancer survivability
TL;DR: The main purpose of this work is to address the importance of the stability of a model and to suggest one of such models, which is a good candidate that medical professionals readily employ without consuming the time and effort for parameter searching.
141
References
•Book
Elements of information theory
Thomas M. Cover,Joy A. Thomas +1 more
- 01 Jan 1991
TL;DR: The author examines the role of entropy, inequality, and randomness in the design of codes and the construction of codes in the rapidly changing environment.
The Strength of Weak Learnability
TL;DR: In this paper, a method is described for converting a weak learning algorithm into one that achieves arbitrarily high accuracy, and it is shown that these two notions of learnability are equivalent.
•Book
Convex Analysis and Optimization
Dimitri P. Bertsekas,Angelia Nedic,Asuman Ozdaglar +2 more
- 01 Jan 2003
2.3K
ALVINN: An Autonomous Land Vehicle in a Neural Network
Dean A. Pomerleau
- 01 Jan 1988
TL;DR: ALVINN (Autonomous Land Vehicle In a Neural Network) is a 3-layer back-propagation network designed for the task of road following that can effectively follow real roads under certain field conditions.