The purpose of this study was to test whether color–motion correlations carried by a pure color difference (S-cone component only) can be used to improve global motion extraction. We also examined the neural markers of color–motion correlation processing in event-related potentials. Color and motion information was dissociated using a two-colored random dot kinematogram, wherein coherent motion and motion noise differed from each other only in their S-cone component, with spatial and temporal parameters set so that global motion processing relied solely on a constant L-M component. Hence, when color and the local motion direction are correlated, more efficient segregation of coherent motion can only be brought about by the S-cone difference, and crucially, this S-cone component does not provide any effective input to a global motion mechanism but only changes the color appearance of the moving dots. The color contrasts (vector length in the S vs. L-M plane) of both the dots carrying coherent motion and the dots moving randomly were fixed at motion discrimination threshold to ensure equal effectiveness for motion extraction. In the behavioral experiment, participants were asked to discriminate between coherent and random motion, and d′ was determined for three different conditions: uncorrelated, uncued correlated, and cued correlated. In the electroencephalographic experiment, participants discriminated direction of motion for uncued correlated and cued correlated conditions. Color–motion correlations were found to improve performance. Cueing a specific color also modulated the N1 component of the event-related potential, with sources in visual area middle temporal. We conclude that S-cone signals “invisible” to the motion system can influence the analysis by direction-selective motion mechanisms through grouping of local motion signals by color. This grouping mechanism must precede motion processing and is likely to be under attentional control.

Impulse response functions (IRFs) were obtained from two-pulse detection thresholds using isoluminant stimuli that produced increments or decrements in S-cone excitation. The pulses were chromatically modulated at constant luminance (based on 18 Hz heterochromatic flicker photometry). Chromatic stimuli were presented as a Gaussian patch (±1 SD = 2.3°) in one of four quadrants around a central fixation cross on a CRT screen. Each of the two pulses (6.67 ms) was separated by an inter-stimulus interval (ISI) from 20 to 360 ms. Chromaticity of the pulses was changed from the equal-energy white of the background to a bluish or yellowish color along individually determined tritan lines (based on color matching under strong S-cone adaptation from a 420 nm background superimposed in Maxwellian view). Chromatic detection thresholds were determined by a four-alternative forced-choice method with staircases for each ISI interleaved in each session. Measurements were repeated in at least four sessions for each observer. IRFs were calculated by varying four parameters of an exponentially-damped sinewave. Both S-cone increment and decrement IRFs are characterized by a single excitatory phase and a much longer time course compared with IRFs derived for luminance modulation using the same apparatus and observers. S-cone increment IRFs are faster than S-cone decrement IRFs; the time to peak amplitude of S-cone increment and decrement IRFs is 50–70 and 100–120 ms, respectively. These results were used to derive the temporal contrast sensitivity for human observers of putative ON- and OFF-channels carrying signals from S-cones.

There is common consensus now that color-defined motion can be perceived by the human visual system. For global motion integration tasks based on isoluminant random dot kinematograms conflicting evidence exists, whether observers can (Ruppertsberg et al., 2003) or cannot (Bilodeau & Faubert, 1999) extract a common motion direction for stimuli modulated along the isoluminant red-green axis. Here we report conditions, in which S-cones contribute to chromatic global motion processing. When the display included extra-foveal regions, the individual elements were large (∼0.3°) and the displacement was large (∼1°), stimuli modulated along the yellowish-violet axis proved to be effective in a global motion task. The color contrast thresholds for detection for both color axes were well below the contrasts required for global motion integration, and therefore the discrimination-to-detection ratio was >1. We conclude that there is significant S-cone input to chromatic global motion processing and the extraction of global motion is not mediated by the same mechanism as simple detection. Whether the koniocellular or the magnocellular pathway is involved in transmitting S-cone signals is a topic of current debate (Chatterjee & Callaway, 2002).

The mosaics of S-cones and the neurons to which they are connected are relatively well characterized, so the S-cone system is a good vehicle for exploring how the sampling of the retinal image controls visual performance. We used an interferometer to measure the grating acuity of the S-cone system in the fovea and at a range of eccentricities out to 20 deg. We also developed a simple model observer that, by assuming only that cone pathways are noisy and that signals are subject to eccentricity-dependent postreceptoral pooling, predicts the measured acuities from the sampling properties of the S-cone mosaic. The amount of pooling required to explain performance is consistent with that suggested by anatomical and physiological measurements.