If we have a natural right to liberty, it is hard to see how a state could be legitimate without first obtaining the (genuine) consent of the governed. I consider the threat natural rights pose to state legitimacy. I distinguish minimal from full legitimacy and explore different understandings of the nature of our natural rights. Even though I conclude that natural rights do threaten the full legitimacy of states, I suggest that understanding our natural right to liberty to be grounded in our interests in a certain way might not commit us to requiring consent for minimal legitimacy. Thus, even if natural rights effectively block the full legitimacy of states - on the assumption that rarely, if ever, the requisite consent will be forthcoming - they may allow minimal state legitimacy.