Turkish Journal of Mathematics
Abstract
In this study, a class of strong limit theorems for the relative entropy densities of random sum of arbitrary information source are discussed by constructing the joint distribution and nonnegative super martingales. As corollaries, some Shannon-McMillan theorems for arbitrary information source, mth-order Markov information source and non-memory information source are obtained and some results for the discrete information source which have been obtained by authors are extended.
DOI
10.3906/mat-0903-3
Keywords
Shannon-McMillan theorem, the consistent distribution, arbitrary information source, relative entropy density, m-order Markov information source, non-memory information source
First Page
729
Last Page
736
Recommended Citation
WANG, KANGKANG
(2011)
"A class of generalized Shannon-McMillan theorems for arbitrary discrete information source,"
Turkish Journal of Mathematics: Vol. 35:
No.
4, Article 13.
https://doi.org/10.3906/mat-0903-3
Available at:
https://journals.tubitak.gov.tr/math/vol35/iss4/13
