A generic model of bulk crystal plasticity with stochastic evolution of the local microstructure is formulated. The evolution of local fluctuations of internal stress and plastic strain, as well as the cross correlation between these variables, is investigated for different loading modes (stress control vs. displacement control) as a function of the coarse graining scale, and the spatial structure of the respective correlation functions is determined. The investigations demonstrate that, after an initial transient characterized by uncorrelated initiation of plasticity in different sample locations, nontrivial long range correlations emerge both within the strain pattern and between the internal stress and plastic strain patterns. The internal stresses, on the other hand, remain short range correlated throughout. Implications of our findings for larger-scale plasticity models are discussed.