A basic theory for probabilistic convergence spaces based on filter convergence is introduced. As in Florescu's previous theory of probabilistic convergence structures based on nets, one is able to assign a probability that a given filter converges to a given point. Various concepts and theorems pertaining to convergence spaces are extended to the realm of probabilistic convergence spaces, and illustrated by means of examples based on convergence in probability and convergence almost everywhere. Diagonal axioms due to Kowalsky and Fischer are also studied, first for convergence spaces and then in the setting of probabilistic convergence spaces.