Jump to content

Nearly completely decomposable Markov chain

From Wikipedia, the free encyclopedia
This is an old revision of this page, as edited by Gareth Jones (talk | contribs) at 17:06, 7 December 2011 (Created page with 'In probability theory, a '''nearly completely decomposable Markov chain''' is a Markov chain where the state-space can be partitioned in such a way that ...'). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
(diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff)

In probability theory, a nearly completely decomposable Markov chain is a Markov chain where the state-space can be partitioned in such a way that movement within a partition occurs much more frequently that movement between partitions.[1] Particularly efficient algorithms exist to compute the stationary distribution of Markov chains with this property.[2]

Definition

Ando and Fisher define a decomposable matrix as one where "an identical rearrangement of rows and columns leaves a set of square submatrixes on the pricnipal diagonal and zeros everywhere else." A nearly completely decomposable matrix is one where "zeroes everywhere else" is replaced with "small nonzeros everywhere else."[3][4]

See also

References

  1. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:1427937, please use {{cite journal}} with |jstor=1427937 instead.
  2. ^ Attention: This template ({{cite doi}}) is deprecated. To cite the publication identified by doi:10.1137/0605019, please use {{cite journal}} (if it was published in a bona fide academic journal, otherwise {{cite report}} with |doi=10.1137/0605019 instead.
  3. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:2525455, please use {{cite journal}} with |jstor=2525455 instead.
  4. ^ Attention: This template ({{cite jstor}}) is deprecated. To cite the publication identified by jstor:2525455, please use {{cite journal}} with |jstor=2525455 instead.