Anatomical and electrophysiological studies have provided us with detailed information regarding the extent and topography of the primary (V1) and secondary (V2) visual areas in primates. The consensus about the V1 and V2 maps, however, is in sharp contrast with controversies regarding the organization of the cortical areas lying immediately rostral to V2. In this review, we address the contentious issue of the extent of the third visual area (V3). Specifically, we will argue for the existence of both ventral (V3v) and dorsal (V3d) segments of V3, which are located, respectively, adjacent to the anterior border of ventral and dorsal V2. V3v and V3d would together constitute a single functional area with a complete representation of both upper and lower visual hemifields. Another contentious issue is the organization of the parietal-occipital (PO) area, which also borders the rostral edge of the medial portion of dorsal V2. Different from V1, V2, and V3, which exhibit a topography based on the defined lines of isoeccentricity and isopolar representation, area PO only has a systematic representation of polar angles, with an emphasis on the peripheral visual field (isoeccentricity lines are not well defined). Based on the connectivity patterns of area PO with distinct cytochrome oxidase modules in V2, we propose a subdivision of the dorsal stream of visual information processing into lateral and medial domains. In this model, area PO constitutes the first processing instance of the dorsal-medial stream, coding for the full-field flow of visual cues during navigation. Finally, we compare our findings with those in other species of Old and New World monkeys and argue that larger animals, such as macaque and capuchin monkeys, have similar organizations of the areas rostral to V2, which is different from that in smaller New World monkeys.

A basic principle in visual neuroscience is the retinotopic organization of neural receptive fields. Here, we review behavioral, neurophysiological, and neuroimaging evidence for nonretinotopic processing of visual stimuli. A number of behavioral studies have shown perception depending on object or external-space coordinate systems, in addition to retinal coordinates. Both single-cell neurophysiology and neuroimaging have provided evidence for the modulation of neural firing by gaze position and processing of visual information based on craniotopic or spatiotopic coordinates. Transient remapping of the spatial and temporal properties of neurons contingent on saccadic eye movements has been demonstrated in visual cortex, as well as frontal and parietal areas involved in saliency/priority maps, and is a good candidate to mediate some of the spatial invariance demonstrated by perception. Recent studies suggest that spatiotopic selectivity depends on a low spatial resolution system of maps that operates over a longer time frame than retinotopic processing and is strongly modulated by high-level cognitive factors such as attention. The interaction of an initial and rapid retinotopic processing stage, tied to new fixations, and a longer lasting but less precise nonretinotopic level of visual representation could underlie the perception of both a detailed and a stable visual world across saccadic eye movements.

The organization of the cortex located immediately anterior to the second visual area (V2), i.e., the third tier visual cortex, remains controversial, especially in New World primates. In particular, there is lack of consensus regarding the exact location and extent of the lower visual quadrant representation of the third visual area V3 (or ventrolateral posterior –VLP – of a different nomenclature). Microelectrode and connectional mapping studies have revealed the existence of an upper visual quadrant representation abutting dorsal V2 anteriorly, and bordered medially and laterally by representations of the lower visual quadrant. It remains unclear whether these lower field regions are both part of a single area V3, which is split into two patches by an interposed region of upper field representation, or whether they are the lower field representations of two different areas, the dorsomedial area (DM) and area V3/VLP, respectively. To address this question, we quantitatively analyzed the patterns of corticocortical afferent connections labeled by tracer injections targeted to these two lower field regions in the dorsal aspect of the third tier cortex. We found different inter-areal connectivity patterns arising from these two regions, strongly suggesting that they belong to two different visual areas. In particular, our results indicate that the dorsal aspect of the third tier cortex consists of two distinct areas: a full area DM, representing the lower quadrant medially, and the upper quadrant laterally, and the lower quadrant representation of V3/VLP, located laterally to upper field DM. DM is predominantly connected with areas of the dorsal visual stream, and V3/VLP with areas of the ventral stream. These results prompt further functional investigations of the third tier cortex, as previous studies of this cortical territory may have pooled response properties of two very different areas into a single area V3.

The ventral surface of the human occipital lobe contains multiple retinotopic maps. The most posterior of these maps is considered a potential homolog of macaque V4, and referred to as human V4 (“hV4”). The location of the hV4 map, its retinotopic organization, its role in visual encoding, and the cortical areas it borders have been the subject of considerable investigation and debate over the last 25 years. We review the history of this map and adjacent maps in ventral occipital cortex, and consider the different hypotheses for how these ventral occipital maps are organized. Advances in neuroimaging, computational modeling, and characterization of the nearby anatomical landmarks and functional brain areas have improved our understanding of where human V4 is and what kind of visual representations it contains.

In primates, the cortex adjoining the rostral border of V2 has been variously interpreted as belonging to a single visual area, V3, with dorsal V3 (V3d) representing the lower visual quadrant and ventral V3 (V3v) representing the upper visual quadrant, V3d and V3v constituting separate, incomplete visual areas, V3d and ventral posterior (VP), or V3d being divided into several visual areas, including a dorsomedial (DM) visual area, a medial visual area (M), and dorsal extension of VP (or VLP). In our view, the evidence from V1 connections strongly supports the contention that V3v and V3d are parts of a single visual area, V3, and that DM is a separate visual area along the rostral border of V3d. In addition, the retinotopy revealed by V1 connection patterns, microelectrode mapping, optical imaging mapping, and functional magnetic resonance imaging (fmri) mapping indicates that much of the proposed territory of V3d corresponds to V3. Yet, other evidence from microelectrode mapping and anatomical connection patterns supports the possibility of an upper quadrant representation along the rostral border of the middle of dorsal V2 (V2d), interpreted as part of DM or DM plus DI, and along the midline end of V2d, interpreted as the visual area M. While the data supporting these different interpretations appear contradictory, they also seem, to some extent, valid. We suggest that V3d may have a gap in its middle, possibly representing part of the upper visual quadrant that is not part of DM. In addition, another visual area, M, is likely located at the DM tip of V3d. There is no evidence for a similar disruption of V3v. For the present, we favor continuing the traditional concept of V3 with the possible modification of a gap in V3d in at least some primates.

Areas V3 and V4 are commonly thought of as individual entities in the primate visual system, based on definition criteria such as their representation of visual space, connectivity, functional response properties, and relative anatomical location in cortex. Yet, large-scale functional and anatomical organization patterns not only emphasize distinctions within each area, but also links across visual cortex. Specifically, the visuotopic organization of V3 and V4 appears to be part of a larger, supra-areal organization, clustering these areas with early visual areas V1 and V2. In addition, connectivity patterns across visual cortex appear to vary within these areas as a function of their supra-areal eccentricity organization. This complicates the traditional view of these regions as individual functional “areas.” Here, we will review the criteria for defining areas V3 and V4 and will discuss functional and anatomical studies in humans and monkeys that emphasize the integration of individual visual areas into broad, supra-areal clusters that work in concert for a common computational goal. Specifically, we propose that the visuotopic organization of V3 and V4, which provides the criteria for differentiating these areas, also unifies these areas into the supra-areal organization of early visual cortex. We propose that V3 and V4 play a critical role in this supra-areal organization by filtering information about the visual environment along parallel pathways across higher-order cortex.

The number, location, extent, and functional properties of the cortical areas that occupy the medial parieto-occipital cortex (mPOC) have been, and still is, a matter of scientific debate. The mPOC is a convoluted region of the brain that presents a high level of individual variability, and the fact that many areas of mPOC are located within very deep sulci further limits the possibility to investigate their anatomo-functional properties. In the present review, we summarize the location and extent of mPOC areas in the macaque brain as obtained by architectural, connectional, and functional data. The different approaches lead to a subdivision of mPOC that includes areas V2, V3, V6, V6Av, and V6Ad. Extrastriate areas V2 and V3 occupy the posterior wall of the parieto-occipital sulcus (POs). The fundus of POs and the ventralmost part of the anterior wall of the sulcus are occupied by a retinotopically organized visual area, called V6, which represents the contralateral part of the visual field and emphasizes its periphery. The remaining part of the anterior wall of POs is occupied by two areas, V6Av and V6Ad, which contain visual as well as arm reaching neurons. Our analyses suggest that areas V6 and V6Av, together, occupy the cortical territory previously described as area PO. Functionally, area V6 is a motion area particularly sensitive to the real motion of objects in the animal's field of view, while V6Av and V6Ad are visuomotor areas likely involved in the visual guidance of arm movement and object prehension.

As highlighted by several contributions to this special issue, there is still ongoing debate about the number, exact location, and boundaries of the visual areas located in cortex immediately rostral to the second visual area (V2), i.e., the “third tier” visual cortex, in primates. In this review, we provide a historical overview of the main ideas that have led to four models of third tier cortex organization, which are at the center of today's debate. We formulate specific predictions of these models, and compare these predictions with experimental evidence obtained primarily in New World primates. From this analysis, we conclude that only one of these models (the “multiple-areas” model) can accommodate the breadth of available experimental evidence. According to this model, most of the third tier cortex in New World primates is occupied by two distinct areas, both representing the full contralateral visual quadrant: the dorsomedial area (DM), restricted to the dorsal half of the third visual complex, and the ventrolateral posterior area (VLP), occupying its ventral half and a substantial fraction of its dorsal half. DM belongs to the dorsal stream of visual processing, and overlaps with macaque parietooccipital (PO) area (or V6), whereas VLP belongs to the ventral stream and overlaps considerably with area V3 proposed by others. In contrast, there is substantial evidence that is inconsistent with the concept of a single elongated area V3 lining much of V2. We also review the experimental evidence from macaque monkey and humans, and propose that, once the data are interpreted within an evolutionary-developmental context, these species share a homologous (but not necessarily identical) organization of the third tier cortex as that observed in New World monkeys. Finally, we identify outstanding issues, and propose experiments to resolve them, highlighting in particular the need for more extensive, hypothesis-driven investigations in macaque and humans.

Inferring neural responses from functional magnetic resonance imaging (fMRI) data is challenging. Even if we take advantage of high-field systems to acquire data with submillimeter resolution, we are still acquiring data in which a single datum summarizes the responses of tens of thousands of neurons. Excitation and inhibition, spikes and subthreshold membrane potential modulations, local and long-range computations, and tuned and nonselective responses are mixed together in one signal. With a priori knowledge of the underlying neural population responses, careful experiment design allows us to manipulate the experiment or task design so that subpopulations are selectively modulated, and our experiments can reveal those tuning functions. However, because we want to be able to use fMRI to discover new kinds of tuning functions and selectivity, we cannot limit ourselves to experiments in which we already know what we are looking for. Broadly speaking, analyses that rely on classification of responses that are distributed across the local neural population [multi-voxel pattern analyses (MVPA)] offer the ability to discover new kinds of information representation and selectivities in neural subpopulations. There is, however, no way to determine how the information discovered with MVPA or other analyses is related to the underlying neuronal tuning functions. Therefore, we must continue to rely on behavioral, computational, and animal models to develop theories of information representation in mid-tier visual cortical areas. Once encoding models exist, fMRI can be powerful for testing these a priori models of information representation. As an aide in developing these models, an important contribution that fMRI can make to our understanding of mid-tier visual areas is derived from connectivity analyses and experiments that study information sharing between visual areas. This ability to quantify localized population average responses throughout the brain is the strength we can best leverage to discover new properties of local and long-range neural networks.

In macaque, it has long been known since the late nineties that the medial parieto-occipital sulcus (POS) contains two regions, V6 and V6A, important for visual motion and action. While V6 is a retinotopically organized extrastriate area, V6A is a broadly retinotopically organized visuomotor area constituted by a ventral and dorsal subdivision (V6Av and V6Ad), both containing arm movement-related cells active during spatially directed reaching movements. In humans, these areas have been mapped only in recent years thanks to neuroimaging methods. In a series of brain mapping studies, by using a combination of functional magnetic resonance imaging methods such as wide-field retinotopy and task-evoked activity, we mapped human areas V6 (Pitzalis et al., 2006) and V6Av (Pitzalis et al., 2013d) retinotopically and defined human V6Ad functionally as a pointing-selective region situated anteriorly in the close proximity of V6Av (Tosoni et al., 2014). Like in macaque, human V6 is a motion area (e.g., Pitzalis et al., 2010, 2012, 2013a,b,c), while V6Av and V6Ad respond to pointing movements (Tosoni et al., 2014). The retinotopic organization (when present), anatomical position, neighbor relations, and functional properties of these three areas closely resemble those reported for macaque V6 (Galletti et al., 1996, 1999a), V6Av, and V6Ad (Galletti et al., 1999b; Gamberini et al., 2011). We suggest that information on objects in depth which are translating in space, because of the self-motion, is processed in V6 and conveyed to V6A for evaluating object distance in a dynamic condition such as that created by self-motion, so to orchestrate the eye and arm movements necessary to reach or avoid static and moving objects in the environment.

The second-order visual mechanisms perform the operation of integrating the spatially distributed local visual information. Their organization is traditionally considered within the framework of the filter-rectify-filter model. These are the second-order filters that provide the ability to detect texture gradients. However, the question of the mechanisms' selectivity to the modulation dimension remains open. The aim of this investigation is to answer the above question by using visual evoked potentials (VEPs). Stimuli were textures consisting of staggered Gabor patches. The base texture was nonmodulated (NM). Three other textures represented the base texture which was sinusoidally modulated in different dimensions: contrast, orientation, or spatial frequency. EEG was recorded with 20 electrodes. VEPs of 500 ms duration were obtained for each of the four textures. After that, VEP to the NM texture was subtracted from VEP to each modulated texture. As a result, three different waves (d-waves) were obtained for each electrode site. Each d-wave was then averaged across all the 48 observers. The revealed d-waves have a latency of about 200 ms and, in our opinion, reflect the second-order filters reactivation through the feedback connection. The d-waves for different modulation dimensions were compared with each other in time, amplitude, topography, and localization of the sources of activity that causes the d-wave (with sLORETA). We proceeded from the assumption that the d-wave (its first component) represents functioning of the second-order visual mechanisms and activity changes at the following processing stages. It was found that the d-waves for different modulation dimensions significantly differ in all parameters. The obtained results indicate that the spatial modulations of different texture parameters caused specific changes in the brain activity, which could be evidence supporting the specificity of the second-order visual mechanisms to modulation dimension.

Here we propose that earlier-demonstrated details in the primate visual cortical map may account for an otherwise puzzling (and problematic) finding in the current human fMRI literature. Specifically, the well-known regions LO and MT(+) reportedly overlap in the human cortical visual map, when those two regions are localized using standard stimulus comparisons in conventional fMRI experiments. Here we describe evidence supporting the idea that the apparent functional overlap between LO and MT arises from a third area (the MT crescent: “MTc”), which is well known to surround posterior MT based on earlier histological, neuroanatomical, and electrophysiological studies in nonhuman primates. If we assume that MTc also exists in human visual cortex, and that it has a location and functional properties intermediate to those in LO and MT, simplistic modeling confirmed that this arrangement could produce apparent overlap between localizers for LO and MT in conventional fMRI maps in human visual cortex.