Hostname: page-component-7479d7b7d-pfhbr Total loading time: 0 Render date: 2024-07-13T02:27:54.497Z Has data issue: false hasContentIssue false
  • English
  • Français

On exponential limit laws for hitting times of rare sets for Harris chains and processes

Part of: Limit theorems Markov processes Special processes Stochastic processes

Published online by Cambridge University Press:  14 July 2016

Peter W. Glynn
Peter W. Glynn*
Affiliation:
Stanford University, Department of Management Science and Engineering, Stanford University, Huang Engineering Center 357, Stanford, CA 94305, USA. Email address: glynn@leland.stanford.edu
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

This paper provides a simple proof for the fact that the hitting time to an infrequently visited subset for a one-dependent regenerative process converges weakly to an exponential distribution. Special cases are positive recurrent Harris chains and Harris processes. The paper further extends this class of limit theorems to ‘rewards’ that are cumulated to the hitting time of such a rare set.

Keywords

Hitting timeregenerative processHarris recurrent Markov chainHarris recurrent Markov process

MSC classification

Primary: 60F05: Central limit and other weak theorems 60G70: Extreme value theory; extremal processes 60J05: Discrete-time Markov processes on general state spaces 60J25: Continuous-time Markov processes on general state spaces 60K05: Renewal theory
Type
Part 7. Queueing Theory and Markov Processes
Information
Journal of Applied Probability , Volume 48 , Issue A: New Frontiers in Applied Probability (Journal of Applied Probability Special Volume 48A) , August 2011 , pp. 319 - 326
Copyright
Copyright © Applied Probability Trust 2011 

References

[1] Asmussen, S., (1998). Extreme value theory for queues via cycle maxima. Extremes 1, 137–168.Google Scholar
[2] Asmussen, S., (2003). Applied Probability and Queues, 2nd edn. Springer, New York.Google Scholar
[3] Asmussen, S. and Glynn, P. W., (2011). Harris recurrence and MCMC: a simplified approach. Submitted.Google Scholar
[4] Asmussen, S. and Perry, D., (1992). On cycle maxima, first passage problems and extreme value theory for queues. Commun. Statist. Stoch. Models 8, 421–458.Google Scholar
[5] Athreya, K. B., (1988). Hitting times of decreasing sets for regenerative processes. J. Appl. Prob. 25, 89–96.Google Scholar
[6] Baccelli, F. and McDonald, D. R., (2000). Rare events for stationary processes. Stoch. Process. Appl. 89, 141–173.Google Scholar
[7] Billingsley, P., (1968). Convergence of Probability Measures. John Wiley, New York.Google Scholar
[8] Cogburn, R., (1985). On the distribution of first passage and return times for small sets. Ann. Prob. 13, 1219–1223.Google Scholar
[9] Glasserman, P. and Kou, S.-G., (1995). Limits of first passage times to rare sets in regenerative processes. Ann. Appl. Prob. 5, 424–445.CrossRefGoogle Scholar
[10] Glynn, P. W., (1982). Simulation output analysis for general state space Markov chains. , Department of Operations Research, Stanford University.Google Scholar
[11] Korolyuk, D. V. and Sil'vestrov, D. S., (1984). Entry times into asymptotically receding domains for ergodic Markov chains. Theory Prob. Appl. 28, 432–442.Google Scholar
[12] Madan, D. B., Carr, P. P. and Chang, E. C., (1998). The variance gamma process and option pricing. Europ. Finance Rev. 2, 79–105.Google Scholar
[13] Meyn, S. P. and Tweedie, R. L., (2009). Markov Chains and Stochastic Stability, 2nd edn. Cambridge University Press.CrossRefGoogle Scholar
[14] Sigman, K., (1990). One-dependent regenerative processes and queues in continuous time. Math. Operat. Res. 15, 175–189.Google Scholar