Wspólne i warunkowe entropia skorelowane źródeł

Joint and conditional entropy of correlated sources If two sources X and Y (Fig. 2.1.2) are considered: ; ,
, then, conditional entropy and joint entropy can be defined. For two sources X and Y , conditional probabilities (2.1.5):
and joint probabilities (2.1.6) can be introduced:
. Relation between these probabilities is describes the Bays' formula :
Then, joint entropy:
and conditional entropy:
SOURCE Y ... zobacz całą notatkę