We show that if a partially hyperbolic diffeomorphism of a Seifert manifold induces a map in the base which has a pseudo-Anosov component then it cannot be dynamically coherent. This extends [C. Bonatti, A. Gogolev, A. Hammerlindl and R. Potrie. Anomalous partially hyperbolic diffeomorphisms III: Abundance and incoherence. Geom. Topol., to appear] to the whole isotopy class. We relate the techniques to the study of certain partially hyperbolic diffeomorphisms in hyperbolic 3-manifolds performed in [T. Barthelmé, S. Fenley, S. Frankel and R. Potrie. Partially hyperbolic diffeomorphisms homotopic to the identity in dimension 3, part I: The dynamically coherent case. Preprint, 2019, arXiv:1908.06227; Partially hyperbolic diffeomorphisms homotopic to the identity in dimension 3, part II: Branching foliations. Preprint, 2020, arXiv: 2008.04871]. The appendix reviews some consequences of the Nielsen–Thurston classification of surface homeomorphisms for the dynamics of lifts of such maps to the universal cover.