In Territorial Sovereignty: A Philosophical Exploration, Anna Stilz argues that legitimate political authority requires the actual—rather than hypothetical—consent of the governed. I argue, however, that her analysis of that consent is inconsistent, in the weight it ascribes to the felt desire to refrain from doing politics with some particular group of people. In the context of secession and self-determination, the lack of actual consent to shared political institutions is weighty enough to render such institutions presumptively illegitimate. In the context of migration, however, a lack of actual consent to the presence of newcomers is ascribed nearly no weight, and instead is taken as evidence of irrationality or immoral preferences. I argue that this apparent contradiction must be clarified before Stilz's overall account of self-governance can be accepted.