Hostname: page-component-77c89778f8-gq7q9 Total loading time: 0 Render date: 2024-07-20T13:20:20.959Z Has data issue: false hasContentIssue false
  • English
  • Français

Sequential decision processes with essential unobservables

Published online by Cambridge University Press:  01 July 2016

P. Whittle
P. Whittle*
Affiliation:
University of Cambridge
Get access Rights & Permissions [Opens in a new window]

Abstract

We consider sequential decision processes in which the posterior distribution of some unobservable must be included among the sufficient statistics. The technique of an earlier paper (Whittle (1964)) is applied to show that the residual loss function is necessarily homogeneous of degree one in this distribution, if certain conventions are adopted. This point leads to considerable simplification. Examples are given of the great variety of problems which can advantageously be formulated in this manner.

Type
Research Article
Information
Advances in Applied Probability , Volume 1 , Issue 2 , Autumn 1969 , pp. 271 - 287
Copyright
Copyright © Applied Probability Trust 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aoki, M. (1967) Optimisation of Stochastic Systems. Academic Press, New York.Google Scholar
Feldman, D. (1962) Contribution to the “two-armed bandit” problem. Ann. Math. Statist. 33, 847–856.Google Scholar
Isaacs, R. (1965) Differential Games. Wiley, New York.Google Scholar
Stratonovich, R. (1968) Conditional Markov Processes and their Application to the Theory of Optimal Control. Elsevier, New York.Google Scholar
Wald, A. (1947) Sequential Analysis. Wiley, New York.Google Scholar
Whittle, P. (1964) Some general results in sequential analysis. Biometrika 51, 123–141.Google Scholar
Whittle, P. (1965) Some general results in sequential design. J. R. Statist. Soc. B 27, 371–387.Google Scholar
Whittle, P. (1969) A view of stochastic control theory. J. R. Statist. Soc. B. To appear.Google Scholar