In this commentary we describe findings in normal human subjects and in patients with visual hemineglect that support the importance of higher-level influences on saccade generation during visual exploration. As the duration of fixations increases with increases in the cognitive demand of the task, the timing of exploratory saccades is controlled more by centers of cognitive and perceptual processing at levels 4 and 5 than by reflex-like automatic processes at level 3. In line with this, unilateral frontal eye field lesions impair systematic, intentional saccadic exploration of visual scenes, causing prolonged fixations and contralesional hemineglect, but leave visually triggered reflexive saccades largely intact.