Let $H_n$, $n\ge3$, be the space of all $n\times n$ Hermitian matrices. Assume that a map $\phi:H_n\to H_n$ preserves commutativity in both directions (no linearity or bijectivity of $\phi$ is assumed). Then $\phi$ is a unitary similarity transformation composed with a locally polynomial map possibly composed by the transposition. The same result holds for injective continuous maps on $H_n$ preserving commutativity in one direction only. We give counter-examples showing that these two theorems cannot be improved or extended to the infinite-dimensional case.