Using a voluntary object-naming paradigm, we examined if bilinguals with high or low L2 proficiency monitor their language selection and production according to their interlocutors' L2 language proficiency. Telugu (L1)–English (L2) bilinguals were introduced to audio-visual stimuli that consisted of animated interlocutors that were high or low proficient in English. In Experiment 1, interlocutors were presented at different frequencies in each block, and in Experiment 2, the presentation of each interlocutor was blocked. We predicted that the frequency of interlocutors would modulate language activation and selection. The participants named the objects language that came to their minds to respond to interlocutors. Indeed, consistent with our predictions, monitoring contexts induced by such interlocutors influenced latencies, language choice and switch-cost. High-L2 proficient participants employed higher language control than low-L2 proficient participants. These results support the hypothesis that bilinguals are sensitive toward their interlocutors' language proficiency and employ context-appropriate cognitive control.