In response to the DSM’s crisis in validity, psychiatry has seen a proliferation of alternative research frameworks (HiTOP, the Network Approach, RDoC) for studying and classifying psychiatric disorders. In this paper, I argue the existence of multiple frameworks in which each employs their own standards of validity is problematic methodologically speaking for trying to do any kind of unified validation work. Fundamental disagreements concerning the underlying phenomenon, sources of validating evidence, and the very nature of validity move each framework into an unrecognized plurality. The consequence for psychiatry is a new validity crisis.