In various stochastic models the random equation of implicit renewal theory appears where the real random variable S and the stochastic process Ψ with index space and state space R are independent. By use of stochastic approximation the distribution function of S is recursively estimated on the basis of independent or ergodic copies of Ψ. Under integrability assumptions almost sure L1-convergence is proved. The choice of gains in the recursion is discussed. Applications are given to insurance mathematics (perpetuities) and queueing theory (stationary waiting and queueing times).

Recursive estimation is considered for parameters of certain continuous stochastic models. Several optimality properties are shown to hold for the resulting recursive estimator, where a stochastic approximation viewpoint is taken when deriving statistical properties, like strong consistency and convergence in distribution. Applications are considered throughout, where for example explosion theory for diffusion processes is used as a modeling guide, in a particular application.

For every hth member of a two-state Markov chain the value of a random variable Y is observed where the distribution of Y is conditional on the state of the corresponding member of the chain. A recursive set of equations is derived giving the posterior probabilities for both the observed and unobserved members. The use of this recursive solution to investigate the optimality of certain simple classification rules is discussed, and a “classification by runs” is also presented.