Researchers in cognitive psychology have proposed that there are two distinct cognitive systems or dual processes underlying reasoning: automatic (implicit) processing and effortful (explicit) processing. Multiple measures have since been developed to capture implicit attitudes. However, do these new measures truly capture implicit attitudes? And can these implicit measures be used interchangeably? To answer this question, we investigated the differences between two of the most popular implicit attitudes measures used in the study of political behavior, the Implicit Association Test (IAT) and the Affect Misattribution Procedure (AMP). We examined data from an original survey experiment investigating gender attitudes and a nationally representative survey that measured racial attitudes. We found that it is important to consider implicit measures alongside explicit measures, as they are not redundant measures. However, when implicit attitudes are measured with the IAT, our inferences are more consistent with predictions of dual process accounts. Moreover, the IAT picks up out-group bias in a way that the AMP does not. The two studies point to the presence of significant differences between different types of implicit measures, and a need to reconsider how implicit attitudes are measured.