In this paper, we show that the delayed Sparre Andersen insurance risk model in discrete time can be analyzed as a doubly infinite Markov chain. We then describe how matrix analytic methods can be used to establish a computational procedure for calculating the probability distributions associated with fundamental ruin-related quantities of interest, such as the time of ruin, the surplus immediately prior to ruin, and the deficit at ruin. Special cases of the model, namely the ordinary and stationary Sparre Andersen models, are considered in several numerical examples.