Non-naturalist normative realists face an epistemological objection: They must explain how their preferred route of justification ensures a non-accidental connection between justified moral beliefs and the normative truths. One strategy for meeting this challenge begins by pointing out that we are semantically or conceptually competent in our use of the normative terms, and then argues that this competence guarantees the non-accidental truth of some of our first-order normative beliefs. In this paper, I argue against this strategy by illustrating that this competence based strategy undermines the non-naturalist's ability to capture the robustly normative content of our moral beliefs.