Fund Project:the National Natural Science Foundation of China (10571076); the Jiangsu Provicial Educaiton Department Natural Science Foundation (02KJD110003).
In this paper, a class of small-deviation theorems for the relative entropy densities of the arbitrary stochastic sequence are discussed by comparing two joint distributions. As corollaries, some Shannon-Mcmillan theorems for arbitrary information source, $m$-order Markov information source are obtained and some results for the discrete information source are extended.
