A new theorem on the existence of an invariant initial distribution for a Markov chain evolving on a Polish space is proved. As an application of the theorem, sufficient conditions for the existence of integrated ARCH processes are established. In the case where these conditions are violated, the top Lyapunov exponent is shown to be zero.