Conditional entropy

Conditional entropy

Suppose we have two random variables and over different domains and . The conditional entropy is defined by