Periodic Markov chain A Markov chain is said to be periodic if it has a periodic state and aperiodic otherwise.