Journal Article10.1002/JAE.1063
Boosting diffusion indices
Jushan Bai,Serena Ng +1 more
TL;DR: Simulations show that for each data type there is one form of boosting that performs quite well and when applied to four key economic variables, some form ofBoosting is found to outperform the standard factor-augmented forecasts and is far superior to an autoregressive forecast.
read more
Abstract: SUMMARY In forecasting and regression analysis, it is often necessary to select predictors from a large feasible set. When the predictors have no natural ordering, an exhaustive evaluation of all possible combinations of the predictors can be computationally costly. This paper considers ‘boosting’ as a methodology of selecting the predictors in factor-augmented autoregressions. As some of the predictors are being estimated, we propose a stopping rule for boosting to prevent the model from being overfitted with estimated predictors. We also consider two ways of handling lags of variables: a componentwise approach and a block-wise approach. The best forecasting method will necessarily depend on the data-generating process. Simulations show that for each data type there is one form of boosting that performs quite well. When applied to four key economic variables, some form of boosting is found to outperform the standard factor-augmented forecasts and is far superior to an autoregressive forecast. Copyright ! 2009 John Wiley & Sons, Ltd.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Generalized Shrinkage Methods for Forecasting Using Many Predictors
James H. Stock,Mark W. Watson +1 more
TL;DR: In this article, a simple shrinkage representation of various forecasting methods designed for a large number of orthogonal predictors (such as principal components) was provided, including pretest methods, Bayesian model averaging, empirical Bayes, and bagging.
Repository
Forecasting: theory and practice
Fotios Petropoulos,Daniele Apiletti,Vassilios Assimakopoulos,Mohamed Zied Babai,Devon K. Barrow,Souhaib Ben Taieb,Christoph Bergmeir,Ricardo J. Bessa,Jakub Bijak,John E. Boylan,Jethro Browell,Claudio Carnevale,Jennifer L. Castle,Pasquale Cirillo,Michael P. Clements,Clara Cordeiro,Clara Cordeiro,Fernando Luiz Cyrino Oliveira,Shari De Baets,Alexander Dokumentov,Joanne Ellison,Piotr Fiszeder,Philip Hans Franses,David T. Frazier,Michael Gilliland,M. Sinan Gönül,Paul Goodwin,Luigi Grossi,Yael Grushka-Cockayne,Mariangela Guidolin,Massimo Guidolin,Ulrich Gunter,Xiaojia Guo,Renato Guseo,Nigel Harvey,David F. Hendry,Ross Hollyman,Tim Januschowski,Jooyoung Jeon,Victor Richmond R. Jose,Yanfei Kang,Anne B. Koehler,Stephan Kolassa,Nikolaos Kourentzes,Nikolaos Kourentzes,Sonia Leva,Feng Li,Konstantia Litsiou,Spyros Makridakis,Gael M. Martin,Andrew B. Martinez,Andrew B. Martinez,Sheik Meeran,Theodore Modis,Konstantinos Nikolopoulos,Dilek Önkal,Alessia Paccagnini,Alessia Paccagnini,Anastasios Panagiotelis,Ioannis P. Panapakidis,Jose M. Pavía,Manuela Pedio,Manuela Pedio,Diego J. Pedregal,Pierre Pinson,Patrícia Ramos,David E. Rapach,J. James Reade,Bahman Rostami-Tabar,Michał Rubaszek,Georgios Sermpinis,Han Lin Shang,Evangelos Spiliotis,Aris A. Syntetos,Priyanga Dilini Talagala,Thiyanga S. Talagala,Len Tashman,Dimitrios D. Thomakos,Thordis L. Thorarinsdottir,Ezio Todini,Juan Ramón Trapero Arenas,Xiaoqian Wang,Robert L. Winkler,Alisa Yusupova,Florian Ziel +84 more
TL;DR: A non-systematic review of the theory and the practice of forecasting, offering a wide range of theoretical, state-of-the-art models, methods, principles, and approaches to prepare, produce, organise, and evaluate forecasts.
325
Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods
TL;DR: It is shown that ML models with a large number of covariates are systematically more accurate than the benchmarks and the ML method that deserves more attention is the random forest model, which dominates all other models.
The Three-Pass Regression Filter: A New Approach to Forecasting Using Many Predictors
Bryan T. Kelly,Seth Pruitt +1 more
TL;DR: In this article, a three-pass regression filter (3PRF) is proposed to forecast a single time series using many predictor variables with a new estimator called 3PRF, which is calculated in closed form and conveniently represented as a set of ordinary least squares regressions.
262
Economic Predictions With Big Data: The Illusion of Sparsity
Domenico Giannone,Domenico Giannone,Michele Lenza,Michele Lenza,Giorgio E. Primiceri,Giorgio E. Primiceri,Giorgio E. Primiceri +6 more
TL;DR: This work compares sparse and dense representations of predictive models in macroeconomic, microeconomics, and finance and specifies a prior that allows for both variable selection and shrinkage.
References
Greedy function approximation: A gradient boosting machine.
TL;DR: A general gradient descent boosting paradigm is developed for additive expansions based on any fitting criterion, and specific algorithms are presented for least-squares, least absolute deviation, and Huber-M loss functions for regression, and multiclass logistic likelihood for classification.
Additive Logistic Regression : A Statistical View of Boosting
TL;DR: This work shows that this seemingly mysterious phenomenon of boosting can be understood in terms of well-known statistical principles, namely additive modeling and maximum likelihood, and develops more direct approximations and shows that they exhibit nearly identical results to boosting.
Determining the Number of Factors in Approximate Factor Models
Jushan Bai,Serena Ng +1 more
TL;DR: In this article, the convergence rate for the factor estimates that will allow for consistent estimation of the number of factors is established, and some panel criteria are proposed to obtain the convergence rates.
The Strength of Weak Learnability
TL;DR: In this paper, a method is described for converting a weak learning algorithm into one that achieves arbitrarily high accuracy, and it is shown that these two notions of learnability are equivalent.
Forecasting Using Principal Components From a Large Number of Predictors
James H. Stock,Mark W. Watson +1 more
TL;DR: In this paper, the authors consider forecasting a single time series when there are many predictors (N) and time series observations (T), and they show that the difference between the feasible forecasts and the infeasible forecasts constructed using the actual values of the factors converges in probability to 0 as both N and T grow large.