Hostname: page-component-586b7cd67f-tf8b9 Total loading time: 0 Render date: 2024-11-29T10:32:23.600Z Has data issue: false hasContentIssue false

Disjoint Decomposition of Markov Chains and Sampling Circuits in Cayley Graphs

Published online by Cambridge University Press:  07 April 2006

RUSSELL MARTIN
Affiliation:
Department of Computer Science, University of Liverpool, Liverpool L69 7ZF, UK
DANA RANDALL
Affiliation:
College of Computing, Georgia Institute of Technology, Atlanta, GA 30332-0280, USA

Abstract

Markov chain decomposition is a tool for analysing the convergence rate of a complicated Markov chain by studying its behaviour on smaller, more manageable pieces of the state space. Roughly speaking, if a Markov chain converges quickly to equilibrium when restricted to subsets of the state space, and if there is sufficient ergodic flow between the pieces, then the original Markov chain also must converge rapidly to equilibrium. We present a new version of the decomposition theorem where the pieces partition the state space, rather than forming a cover where pieces overlap, as was previously required. This new formulation is more natural and better suited to many applications. We apply this disjoint decomposition method to demonstrate the efficiency of simple Markov chains designed to uniformly sample circuits of a given length on certain Cayley graphs. The proofs further indicate that a Markov chain for sampling adsorbing staircase walks, a problem arising in statistical physics, is also rapidly mixing.

Type
Paper
Copyright
2006 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)