Markov chain
A Markov chain is specified by a number of states
and a transition probability matrix . Intuitively think of this as a state machine which at state has probability of transitioning to state .
Markov chain
A Markov chain is specified by a number of states
and a transition probability matrix . Intuitively think of this as a state machine which at state has probability of transitioning to state .