Markov information source

In mathematics, a Markov information source, or simply, a Markov source, is an information source whose underlying dynamics are given by a stationary finite Markov chain.

Formal definition

An information source is a sequence of random variables ranging over a finite alphabet Γ, having a stationary distribution.

A Markov information source is then a (stationary) Markov chain M, together with a function

$f:S\to \Gamma$

that maps states S in the Markov chain to letters in the alphabet Γ.

A unifilar Markov source is a Markov source for which the values $f(s_{k})$ are distinct whenever each of the states $s_{k}$ are reachable, in one step, from a common prior state.

References

• Robert B. Ash, Information Theory, (1965) Dover Publications. ISBN 0-486-66521-6