TY - JOUR
T1 - A Monte Carlo experiment to analyze the curse of dimensionality in estimating random coefficients models with a full variance-covariance matrix
AU - Cherchi, Elisabetta
AU - Guevara, Cristian Angelo
PY - 2012/2
Y1 - 2012/2
N2 - When the dimension of the vector of estimated parameters increases, simulation based methods become impractical, because the number of draws required for estimation grows exponentially with the number of parameters. In simulation methods, the lack of empirical identification when the number of parameters increases is usually known as the "curse of dimensionality" in the simulation methods. We investigate this problem in the case of the random coefficients Logit model. We compare the traditional Maximum Simulated Likelihood (MSL) method with two alternative estimation methods: the Expectation-Maximization (EM) and the Laplace Approximation (HH) methods that do not require simulation. We use Monte Carlo experimentation to investigate systematically the performance of the methods under different circumstances, including different numbers of variables, sample sizes and structures of the variance-covariance matrix. Results show that indeed MSL suffers from lack of empirical identification as the dimensionality grows while EM deals much better with this estimation problem. On the other hand, the HH method, although not being simulation-based, showed poor performance with large dimensions, principally because of the necessity of inverting large matrices. The results also show that when MSL is empirically identified this method seems superior to EM and HH in terms of ability to recover the true parameters and estimation time.
AB - When the dimension of the vector of estimated parameters increases, simulation based methods become impractical, because the number of draws required for estimation grows exponentially with the number of parameters. In simulation methods, the lack of empirical identification when the number of parameters increases is usually known as the "curse of dimensionality" in the simulation methods. We investigate this problem in the case of the random coefficients Logit model. We compare the traditional Maximum Simulated Likelihood (MSL) method with two alternative estimation methods: the Expectation-Maximization (EM) and the Laplace Approximation (HH) methods that do not require simulation. We use Monte Carlo experimentation to investigate systematically the performance of the methods under different circumstances, including different numbers of variables, sample sizes and structures of the variance-covariance matrix. Results show that indeed MSL suffers from lack of empirical identification as the dimensionality grows while EM deals much better with this estimation problem. On the other hand, the HH method, although not being simulation-based, showed poor performance with large dimensions, principally because of the necessity of inverting large matrices. The results also show that when MSL is empirically identified this method seems superior to EM and HH in terms of ability to recover the true parameters and estimation time.
KW - Curse of dimensionality
KW - Estimation methods
KW - Monte Carlo experiments
KW - Random coefficients models
UR - http://www.scopus.com/inward/record.url?scp=84856381091&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84856381091&partnerID=8YFLogxK
U2 - 10.1016/j.trb.2011.10.006
DO - 10.1016/j.trb.2011.10.006
M3 - Article
AN - SCOPUS:84856381091
SN - 0191-2615
VL - 46
SP - 321
EP - 332
JO - Transportation Research Part B: Methodological
JF - Transportation Research Part B: Methodological
IS - 2
ER -