Acta mathematica scientia,Series A ›› 1997, Vol. 17 ›› Issue (2): 176-183.

Previous Articles     Next Articles

Some Researches of Shannon-Mcmillan Theorem(Ⅱ)

Liu Wen1, Yang Weiguo2   

  1. 1 Hebei University of Technology, Tianjin 300130;
    2 Hebei Mining and Civil Engineering Institute, Handan 056038
  • Received:1995-05-16 Revised:1995-11-17 Online:1997-04-26 Published:1997-04-26

Abstract: In this paper, a class of small-devitions theorems for the relative entropy densities of the sequence of arbitrary random variables are discussed by comparing between the sequence of arbitrary distributions and the seqence of independent distributions. As corollaries, some Shannon-Mcmillan theorems are obtained and some results for the discrete information source which has been obtained by authors before are extended.

Key words: Shannon-Mcmillan theorem, small-deviations theorem, relative entropy density, discrete information source

Trendmd