Wymiana informacji z kanału dyskretnych Memoryless

Mutual information of Discrete Memoryless Channel (DMC) For the given, set of input messages : ,
set of output messages : ,
Discrete Memoryless Channel (DMC) is defined by its probabilistic model (Fig.3.1), MN transition (conditional) probabilities:
For the given channel and input probabilities, output probabilities can be calculated:
For a noisy channel the following terms can be introduced:
information loss : , misinformation: , mutual information :
Mutual information between events (sources) X and Y is the information provided about the event X by the occurrence of the event Y . Its unit is [bit].
... zobacz całą notatkę