There have been many discussions recently from philosophers, cognitive scientists, and psychologists about group polarization, with online and social media environments in particular receiving a lot of attention, both because of people's increasing reliance on such environments for receiving and exchanging information and because such environments often allow individuals to selectively interact with those who are like-minded. My goal here is to argue that the group epistemologist can facilitate understanding the kinds of factors that drive group polarization in a way that has been overlooked by the existing research. Specifically, I argue that polarization can occur in part because of the ways that members of a group treat the group itself (as opposed to an individual member within that group) as a source of information, and in doing so makes their own position, as well as that of the group, more extreme. I refer to this as a structural factor in driving polarization, and argue that such factors can contribute to explanations of polarization that occurs specifically in an important subset of groups, namely online and social media groups in which little is known about other members within the group, what I refer to as anonymous, semi-anonymous and pseudonymous (ASAP) groups.