Hostname: page-component-7479d7b7d-c9gpj Total loading time: 0 Render date: 2024-07-15T21:16:02.289Z Has data issue: false hasContentIssue false
  • English
  • Français

Semi-Markov Replacement Chains

Part of: Special processes

Published online by Cambridge University Press:  01 July 2016

Ioannis I. Gerontidis
Ioannis I. Gerontidis*
Affiliation:
University of Thessaloniki
*
* Postal address: Mathematics Department, University of Thessaloniki, 54006 Thessaloniki, Greece.
Get access Rights & Permissions [Opens in a new window]

Abstract

We consider an absorbing semi-Markov chain for which each time absorption occurs there is a resetting of the chain according to some initial (replacement) distribution. The new process is a semi-Markov replacement chain and we study its properties in terms of those of the imbedded Markov replacement chain. A time-dependent version of the model is also defined and analysed asymptotically for two types of environmental behaviour, i.e. either convergent or cyclic. The results contribute to the control theory of semi-Markov chains and extend in a natural manner a wide variety of applied probability models. An application to the modelling of populations with semi-Markovian replacements is also presented.

Keywords

COMPENSATIONCONTROL OF SEMI-MARKOV CHAINSNON-STATIONARITYQUASI-PERIODICITYSTOCHASTIC POPULATION MODELSUNIFORM STRONG ERGODICITY

MSC classification

Primary: 60K15: Markov renewal processes, semi-Markov processes
Secondary: 60K20: Applications of Markov renewal processes (reliability, queueing networks, etc.)
Type
General Applied Probability
Information
Advances in Applied Probability , Volume 26 , Issue 3 , September 1994 , pp. 728 - 755
Copyright
Copyright © Applied Probability Trust 1994 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Agrafiotis, G. K. (1980) Modeling manpower systems. J. Indust. Math. Soc. 30, 103–120.Google Scholar
Bhat, U. N. (1972) Elements of Applied Stochastic Processes. Wiley, New York.Google Scholar
Bartholomew, D. J. (1982) Stochastic Models for Social Processes. 3rd edn. Wiley, Chichester.Google Scholar
Benevento, R. V. (1986) Asymptotic analysis of some non-homogeneous semi-Markov processes. In Semi-Markov Models: Theory and Applications, ed. Janssen, J., pp. 23–35. Plenum, New York.Google Scholar
ÇInlar, E. (1975) Introduction to Stochastic Processes. Prentice Hall, Englewood Cliffs, NJ.Google Scholar
Darroch, J. N. and Seneta, E. (1965) On quasi-stationary distributions in absorbing discrete-time finite Markov chains. J. Appl. Prob. 2, 88–100.Google Scholar
Fabens, A. (1961) The solution of queueing and inventory models by semi-Markov processes. J. Royal Statist. Soc. B23, 113–127.Google Scholar
Feller, W. (1968) An Introduction to Probability Theory and its Applications, Vol. I, 3rd edn. Wiley, New York.Google Scholar
Feller, W. (1971) An Introduction to Probability Theory and its Applications, Vol. II, 2nd edn. Wiley, New York.Google Scholar
Gantmacher, F. R. (1959) Applications of the Theory of Matrices. Interscience Publishers, New York.Google Scholar
Gerontidis, I. I. (1992) Cyclic strong ergodicity in non-homogeneous Markov systems, SIAM J. Matrix Anal. Appl. 13, 550–566.Google Scholar
Gerontidis, I. I. (1993) A continuous time Markov renewal replacement model for manpower systems. Appl. Stoch. Models Data Anal. 9, 39–58.Google Scholar
Gerontidis, I. I. (1994a) Stochastic equilibria in non-homogeneous Markov population replacement processes. Math. Operat. Res. 19, 192–210.Google Scholar
Gerontidis, I. I. (1994b) Periodic Markovian replacement chains. Stoch. Proc. Appl. To appear.Google Scholar
Ginsberg, R. B. (1971) Semi-Markov processes and mobility. J. Math. Sociol. 1, 233–262.Google Scholar
Iosifescu-Manu, A. (1972) Procese semi-Markoviene neomogene. Stud. Cerc. Mat. 24, 529–533.Google Scholar
Isaacson, D. L. and Madsen, R. W. (1976) Markov Chains. Wiley, New York.Google Scholar
Keilson, J. (1979) Markov Chain Models–Rarity and Exponentiality. Springer-Verlag, Berlin.CrossRefGoogle Scholar
Keilson, J. and Wishart, D. M. G. (1964) A central limit theorem for processes defined on a finite Markov chain. Proc. Camb. Phil. Soc. 60, 547–567.Google Scholar
Latouche, G. (1982) A phase-type semi-Markov point process. SIAM J. Algebraic Discrete Meth. 1, 77–90.Google Scholar
Mcclean, S. I. (1980) A semi-Markov model for a multi-grade population with Poisson recruitment. J. Appl. Prob. 17, 846–852.Google Scholar
Neuts, M. F. (1981) Matrix Geometric Solutions in Stochastic Models: An Algorithmic Approach. The Johns Hopkins University Press, Baltimore.Google Scholar
Neuts, M. F. (1989) Structured Stochastic Matrices of M/G/1 Type and Their Applications. Marcel Dekker, New York.Google Scholar
Valliant, R. and Milkovich, G. (1977) Comparison of semi-Markov and Markov models in personnel forecasting application. Decision Sci. 8, 465–477.CrossRefGoogle Scholar
Vassiliou, P.-C. G and Papadopoulou, A. (1992) Non-homogeneous semi-Markov systems and maintainability of the state sizes. J. Appl. Prob. 29, 519–534.Google Scholar
Whittle, P. (1975) Reversibility and acyclicity. In Perspectives in Probability and Statistics, ed. Gani, J., pp. 217–224. Distributed by the Academic Press, London, for the Applied Probability Trust, Sheffield.Google Scholar
Woodward, M. (1983) The limiting properties of population distributions with particular application to manpower planning. J. Appl. Prob. 20, 19–30.Google Scholar