Hostname: page-component-7479d7b7d-qs9v7 Total loading time: 0 Render date: 2024-07-09T23:57:13.588Z Has data issue: false hasContentIssue false
  • English
  • Français

Sufficient optimality conditions for control-limit policy in a semi-Markov process

Published online by Cambridge University Press:  14 July 2016

I. Gertsbach
I. Gertsbach*
Affiliation:
Ben Gurion University of the Negev, Beer Sheva, Israel
Get access Rights & Permissions [Opens in a new window]

Abstract

A finite-state semi-Markov process (SMP) with penalties is considered. A property which is similar to an increasing-hazard-rate property for a Markov chain is defined for an SMP. The SMP is controlled by shifts from the state Ei to immediately after a transition has occurred. Conditions are given which guarantee that the optimal stationary Markovian policy belongs to a subclass of control-limit policies.

Keywords

SEMI-MARKOV PROCESSCONTROLCONTROL-LIMIT POLICY
Type
Short Communications
Information
Journal of Applied Probability , Volume 13 , Issue 2 , June 1976 , pp. 400 - 406
Copyright
Copyright © Applied Probability Trust 1976 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Barlow, R. and Proschan, F. (1965) Mathematical Theory of Reliability. Wiley, New York.Google Scholar
Derman, C. (1963) On optimal replacement rules when changes of state are Markovian. In Mathematical Optimization Techniques , University of California Press, Berkeley, 201–210.CrossRefGoogle Scholar
Jewell, W. (1963) Markov renewal programming 1, 2. Operations Res. 11, 938–971.Google Scholar
Kao, E. (1973) Optimal replacement and rules when changes of state are semi-Markovian. Operations Res. 21, 1231–1249.Google Scholar
Kolesar, P. (1966) Minimum cost replacement under Markovian deterioration. Management Sci. 12, 694–706.Google Scholar