Language isn't the only way to cross modules, nor is it the only module with access to both input and output. Minds don't generally work across modules because this leads to combinatorial explosion in search and planning. Language is special in being a good vector for mimetics, so it becomes associated with useful cross-module concepts we acquire culturally. Further, language is indexical, so it facilitates computationally expensive operations.