Statement

Lemma

Suppose we have two independent random variables and over different domains and . Then the Conditional entropy is excludes the dependent

Proof

This follows from the definitions