Open AccessProceedings Article
Sparse Shrunk Additive Models
Hong Chen,guodong liu,Heng Huang +2 more
- 12 Jul 2020
- Vol. 1, pp 6194-6204
TL;DR: A new method, called as sparse shrunk additive models (SSAM), is proposed to explore the structure information among features and only requires the component functions to be continuous and bounded, which are not necessary to be in reproducing kernel Hilbert spaces.
read more
Abstract: Most existing feature selection methods in literature are linear models, so that the nonlinear relations between features and response variables are not considered. Meanwhile, in these feature selection models, the interactions between features are often ignored or just discussed under prior structure information. To address these challenging issues, we consider the problem of sparse additive models for high-dimensional nonparametric regression with the allowance of the flexible interactions between features. A new method, called as sparse shrunk additive models (SSAM), is proposed to explore the structure information among features. This method bridges sparse kernel regression and sparse feature selection. Theoretical results on the convergence rate and sparsity characteristics of SSAM are established by the novel analysis techniques with integral operator and concentration estimate. In particular, our algorithm and theoretical analysis only require the component functions to be continuous and bounded, which are not necessary to be in reproducing kernel Hilbert spaces. Experiments on both synthetic and real-world data demonstrate the effectiveness of the proposed approach.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
•Proceedings Article
Multi-task Additive Models for Robust Estimation and Automatic Structure Discovery
Yingjie Wang,Hong Chen,Feng Zheng,Chen Xu,Tieliang Gong,Yanhong Chen +5 more
- 01 Jan 2020
TL;DR: This work proposes a new class of additive models, called Multi-task Additive Models (MAM), by integrating the mode-induced metric, the structure-based regularizer, and additive hypothesis spaces into a bilevel optimization framework.
Sparse Interaction Additive Networks via Feature Interaction Detection and Sparse Selection
James Enouen,Yan Liu +1 more
- 19 Sep 2022
TL;DR: The proposed Sparse Interaction Additive Networks (SIAN) construct a bridge from these simple and interpretable models to fully connected neural networks and achieves competitive performance against state-of-the-art methods across multiple large-scale tabular datasets.
8
Error-Based Knockoffs Inference for Controlled Feature Selection
TL;DR: In this paper , an error-based knockoff inference method was proposed to handle feature selection with theoretical guarantees on controlling false discovery proportion (FDP), FDR, or k-familywise error rate (k-FWER).
1
Robust partially linear models for automatic structure discovery
TL;DR: In this article , the authors proposed a robust linear and nonlinear discovery algorithm (RLAND) by integrating the modal regression and partially linear models (PLMs), which can mitigate the influence of noise in structure discovery.
1
Error-based Knockoffs Inference for Controlled Feature Selection
Xuebin Zhao,H. Chen,Yingjie Wang,Weifu Li,Tieliang Gong,Yulong Wang Wang,Feng Zheng +6 more
- 09 Mar 2022
TL;DR: The proposed inference procedure does not require specifying a regression model and can handle feature selection with theoretical guarantees on controlling false discovery proportion (FDP), FDR, or k-familywise error rate (k-FWER).
1
References
Regression Shrinkage and Selection via the Lasso
TL;DR: A new method for estimation in linear models called the lasso, which minimizes the residual sum of squares subject to the sum of the absolute value of the coefficients being less than a constant, is proposed.
•Book
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
Trevor Hastie,Robert Tibshirani,Jerome H. Friedman +2 more
- 28 Jul 2013
TL;DR: In this paper, the authors describe the important ideas in these areas in a common conceptual framework, and the emphasis is on concepts rather than mathematics, with a liberal use of color graphics.
21.3K
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
TL;DR: The Elements of Statistical Learning: Data Mining, Inference, and Prediction as discussed by the authors is a popular book for data mining and machine learning, focusing on data mining, inference, and prediction.
15.4K
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Bernhard Schölkopf,Alexander J. Smola +1 more
- 01 Dec 2001
TL;DR: Learning with Kernels provides an introduction to SVMs and related kernel methods that provide all of the concepts necessary to enable a reader equipped with some basic mathematical knowledge to enter the world of machine learning using theoretically well-founded yet easy-to-use kernel algorithms.
10.2K
•Book
Kernel Methods for Pattern Analysis
John Shawe-Taylor,Nello Cristianini +1 more
- 01 Jan 2004
TL;DR: This book provides an easy introduction for students and researchers to the growing field of kernel-based pattern analysis, demonstrating with examples how to handcraft an algorithm or a kernel for a new specific application, and covering all the necessary conceptual and mathematical tools to do so.
Related Papers (5)
Junming Yin,Xi Chen,Eric P. Xing +2 more
Haitao Zhao,Zhihui Lai,Henry Leung,Xianyi Zhang +3 more
- 01 Jan 2020