Źródło z pamięcią

Source with memory Consider a sequence of messages of a discrete memoryless source X , of the length L :
where is any element of X . Total of all sequences:
A discrete memoryless source X described by sequences (2.2.1) is called the L -the extension of a source , denoted as . Its probability assignment is:
; Then, entropy of the source L -the extension is L times greater than entropy of the original source:
... zobacz całą notatkę