Hostname: page-component-77c89778f8-m8s7h Total loading time: 0 Render date: 2024-07-18T04:28:35.770Z Has data issue: false hasContentIssue false

Approximate Solutions to Stochastic Dynamic Programs

Published online by Cambridge University Press:  11 February 2009

Steven Stern
Affiliation:
University of Virginia

Abstract

This paper examines the properties of various approximation methods for solving stochastic dynamic programs in structural estimation problems. The problem addressed is evaluating the expected value of the maximum of available choices. The paper shows that approximating this by the maximum of expected values frequently has poor properties. It also shows that choosing a convenient distributional assumptions for the errors and then solving exactly conditional on the distributional assumption leads to small approximation errors even if the distribution is misspecified.

Type
Articles
Copyright
Copyright © Cambridge University Press 1997

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCE

Ahn, H. & Manski, C. (1993) Distribution theory for the analysis of binary choice under uncertainty with nonparametric estimation of expectations. Journal of Econometrics 56, 291321.CrossRefGoogle Scholar
Ausink, J. & Wise, D. (1993) The Military Pension, Compensation, and Retirement of U.S. Air Force Pilots. Working paper 4593, National Bureau of.Economic Research, Cambridge.CrossRefGoogle Scholar
Berkovec, J. & Stern, S. (1991) Job exit behavior of older men. Econometrica 59, 189210.CrossRefGoogle Scholar
Christensen, B. (1990) Estimation of Dynamic Programming Models. Ph.D. Dissertation, Cornell University, Ithaca, New York.Google Scholar
Eckstein, Z. & Wolpin, K. (1989) The specification and estimation of dynamic stochastic discrete choice models. Journal of Human Resources 24, 562598.CrossRefGoogle Scholar
Engen, E. (1992) Precautionary Saving, Consumption, and Taxation in a Life Cycle Model with Stochastic Earnings and Mortality Risk. Ph.D. Dissertation, University of Virginia, Charlottesville.Google Scholar
Geweke, J. (1988) Antithetic acceleration of Monte Carlo integration in Bayesian inference. Journal of Econometrics 38, 7389.CrossRefGoogle Scholar
Heckman, J. (1979) Selection bias as a specification error. Econometrica 47, 153161.CrossRefGoogle Scholar
Hotz, V.J., Miller, R., Sanders, S., & Smith, J. (1994) A simulation estimator for models of dynamic discrete choice. Review of Economic Studies 61, 265290.CrossRefGoogle Scholar
Hubbard, G., Skinner, J., & Zeldes, S. (1993) Precautionary Saving and Social Insurance. Working paper, National Bureau of Economic Research, Cambridge.CrossRefGoogle Scholar
Johnson, N. & Kotz, S. (1970) Continuous Univariate Distributions. Boston: Houghton Mifflin.Google Scholar
Lumsdainc, R., Stock, J., & Wise, D. (1991) Three models of retirement: Computational complexity versus predictive validity. In Wise, D. (ed.), Topics in the Economics of Aging, pp. 1960. Chicago: University of Chicago Press.Google Scholar
Manski, C. (1988) Path utility analysis of dynamic choice. Manuscript, University of Wisconsin, Madison.Google Scholar
Manski, C. (1991) Nonparametric estimation of expectations in the analysis of discrete choice under uncertainty. In Bamett, W., Powell, J., & Tauchen, G. (eds.), Nonparametric and Semiparametric Methods in Econometrics and Statistics, pp. 259276. Cambridge: Cambridge University Press.Google Scholar
McFadden, D. (1981) Econometric models of probabilistic choice. In Manski, C. & McFadden, D. (eds.) Structural Analysis of Discrete Data with Econometric Applications, pp. 198272. Cambridge, Massachusetts: MIT Press.Google Scholar
Miller, R. (1984) Job matching and occupational choice. Journal of Political Economy 92, 10861120.CrossRefGoogle Scholar
Pakes, A. (1987) Patents as options: Some estimates of the value of holding European patent stocks. Econometrica 54, 755784.CrossRefGoogle Scholar
Palumbo, M. (1991) Health Uncertainty and Optimal Consumption Near the End of the Life Cycle. Ph.D. Dissertation, University of Virginia, Charlottesville.Google Scholar
Rust, J. (1989) A dynamic programming model of retirement behavior. In Wise, D. (ed.), The Economics of Aging, pp. 359398. Cambridge: National Bureau of Economic Research.Google Scholar
Stern, S. (1994) Approximate solutions to stochastic dynamic programs. Manuscript, University of Virginia, Charlottesville.Google Scholar
Stock, J. & Wise, D. (1990) Pensions, the option value of work, and retirement. Econometrica 58, 11511180.CrossRefGoogle Scholar
Wolpin, K. (1984) An estimable dynamic stochastic model of fertility and child mortality. Journal of Political Economy 92, 852874.CrossRefGoogle Scholar
Wolpin, K. (1987) Estimating a structural search model: The transition from school to work. Econometrica 55, 801817.CrossRefGoogle Scholar