Joint Entropy

Joint Entropy

Suppose we have two random variables and over different domains and . The joint entropy is defined by This is Information entropy of the joint distribution.