In this work, we establish a connection between the cumulative residual entropy and the Gini mean difference (GMD). Some relationships between the extropy and the GMD, and the truncated GMD and dynamic versions of the cumulative past extropy are also established. We then show that several entropy and extropy measures discussed here can be brought into the framework of probability weighted moments, which would facilitate finding estimators of these measures.