International human rights specialists and libertarian philosophers have rarely pursued meaningful exchanges, but this paper probes some of their common ground. In recent years, leading international monitoring bodies have developed a principle described here as the ‘Libertarian Principle of Human Rights’ (LPHR). It runs as follows: Governments cannot legitimately recite public morals as a sufficient justification to limit individual human rights. That principle might seem obvious in many societies today, but throughout history, including the history of liberalism, any notion that certain individual interests must trump religious or customary beliefs has stood as the rare exception. The seemingly Western and secular suggestion of a libertarian principle inherent within human rights may seem at odds with the view that human rights ought to reflect diverse cultural traditions; however, LPHR underscores an anti-authoritarianism, which, it is argued, must form part of any serious conception of human rights. LPHR can be substantiated even for highly controversial rights, such as LGBTQ+ rights, suggesting that it applies a fortiori to more settled rights.