Irreducible Markov chain

Irreducible Markov chain

A Markov chain given by is irreducible if the directed graph on given by non-zero values of has a single strongly connected component.