Stochastic matrix

Stochastic matrix

A matrix is called stochastic if for all with we have and for and we have . Therefore every row forms a probability distribution.