TY - JOUR
T1 - A general framework for frequentist model averaging
AU - Mitra, Priyam
AU - Lian, Heng
AU - Mitra, Ritwik
AU - Liang, Hua
AU - Xie, Min ge
N1 - Funding Information: Acknowledgements The work was supported by National Science Foundation of USA (Grant Nos. DMS-1812048, DMS-1737857, DMS-1513483 and DMS-1418042) and National Natural Science Foundation of China (Grant No. 11529101). This article is a work developed based on the thesis of the first author. The authors wish to use this article to celebrate Professor Lincheng Zhao’s 75th birthday and his tremendous and long lasting contribution to statistical research and education in China and around the world. The authors also thank two referees for their valuable suggestions and comments that have helped improve the paper substantially. Publisher Copyright: © 2019, Science China Press and Springer-Verlag GmbH Germany, part of Springer Nature.
PY - 2019/2/1
Y1 - 2019/2/1
N2 - Model selection strategies have been routinely employed to determine a model for data analysis in statistics, and further study and inference then often proceed as though the selected model were the true model that were known a priori. Model averaging approaches, on the other hand, try to combine estimators for a set of candidate models. Specifically, instead of deciding which model is the `right' one, a model averaging approach suggests to fit a set of candidate models and average over the estimators using data adaptive weights. In this paper we establish a general frequentist model averaging framework that does not set any restrictions on the set of candidate models. It broadens the scope of the existing methodologies under the frequentist model averaging development. Assuming the data is from an unknown model, we derive the model averaging estimator and study its limiting distributions and related predictions while taking possible modeling biases into account. We propose a set of optimal weights to combine the individual estimators so that the expected mean squared error of the average estimator is minimized. Simulation studies are conducted to compare the performance of the estimator with that of the existing methods. The results show the benefits of the proposed approach over traditional model selection approaches as well as existing model averaging methods.
AB - Model selection strategies have been routinely employed to determine a model for data analysis in statistics, and further study and inference then often proceed as though the selected model were the true model that were known a priori. Model averaging approaches, on the other hand, try to combine estimators for a set of candidate models. Specifically, instead of deciding which model is the `right' one, a model averaging approach suggests to fit a set of candidate models and average over the estimators using data adaptive weights. In this paper we establish a general frequentist model averaging framework that does not set any restrictions on the set of candidate models. It broadens the scope of the existing methodologies under the frequentist model averaging development. Assuming the data is from an unknown model, we derive the model averaging estimator and study its limiting distributions and related predictions while taking possible modeling biases into account. We propose a set of optimal weights to combine the individual estimators so that the expected mean squared error of the average estimator is minimized. Simulation studies are conducted to compare the performance of the estimator with that of the existing methods. The results show the benefits of the proposed approach over traditional model selection approaches as well as existing model averaging methods.
KW - 62F99
KW - 62J99
KW - asymptotic distribution
KW - bias variance trade-off
KW - local mis-specification
KW - model averaging estima- tors
KW - optimal weight selection
UR - http://www.scopus.com/inward/record.url?scp=85060220825&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85060220825&partnerID=8YFLogxK
U2 - https://doi.org/10.1007/s11425-018-9403-x
DO - https://doi.org/10.1007/s11425-018-9403-x
M3 - Article
SN - 1674-7283
VL - 62
SP - 205
EP - 226
JO - Science China Mathematics
JF - Science China Mathematics
IS - 2
ER -