An algorithm for computing the stationary distribution of finite state discrete time MarkovChains is provided in the paper.
论文提出了一种计算有限状态离散时间马尔科夫链平稳分布的算法。
2
The purpose of this paper is to give a strong law of large numbers for occupation time of finite non-homogeneous Markovchains, which is an extension of the one of the homogeneous Markov chains.