Nothing Special   »   [go: up one dir, main page]
Advertisement

  • Loading metrics

Open Access

Peer-reviewed

Research Article

Radial Frequency Analysis of Contour Shapes in the Visual Cortex

  • Viljami R. Salmela ,

    viljami.salmela@helsinki.fi

    Affiliations Institute of Behavioural Sciences, Division of Cognitive and Neuropsychology, University of Helsinki, Helsinki, Finland, Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland

    ⨯
  • Linda Henriksson,

    Affiliations Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland

    ⨯
  • Simo Vanni

    Affiliations Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland, Clinical Neurosciences, Neurology, University of Helsinki and Helsinki University Hospital, Helsinki, Finland

    ⨯

Abstract

Cumulative psychophysical evidence suggests that the shape of closed contours is analysed by means of their radial frequency components (RFC). However, neurophysiological evidence for RFC-based representations is still missing. We investigated the representation of radial frequency in the human visual cortex with functional magnetic resonance imaging. We parametrically varied the radial frequency, amplitude and local curvature of contour shapes. The stimuli evoked clear responses across visual areas in the univariate analysis, but the response magnitude did not depend on radial frequency or local curvature. Searchlight-based, multivariate representational similarity analysis revealed RFC specific response patterns in areas V2d, V3d, V3AB, and IPS0. Interestingly, RFC-specific representations were not found in hV4 or LO, traditionally associated with visual shape analysis. The modulation amplitude of the shapes did not affect the responses in any visual area. Local curvature, SF-spectrum and contrast energy related representations were found across visual areas but without similar specificity for visual area that was found for RFC. The results suggest that the radial frequency of a closed contour is one of the cortical shape analysis dimensions, represented in the early and mid-level visual areas.

Author Summary

Current views suggest that neural representations of the visual environment are built from combinations of basis functions. For low-level visual feature analysis these basis functions are relatively well understood. It is not yet known, however, how primary visual features are combined into higher-level representations of visual objects. Psychophysical evidence suggests that visual shapes are perceived on the basis of the radial frequency components of the shape contour. We investigated whether human visual cortex contains representations of radial frequency components. Our results show that the neural mechanisms that utilize radial frequency are located in the early and intermediate visual areas, and provide further support for the idea of radial frequency based representations in shape perception. This suggests that radial frequency representations might be one link between low-level visual feature analysis and high-level object shape representations.

Citation: Salmela VR, Henriksson L, Vanni S (2016) Radial Frequency Analysis of Contour Shapes in the Visual Cortex. PLoS Comput Biol 12(2): e1004719. https://doi.org/10.1371/journal.pcbi.1004719

Editor: Wolfgang Einhäuser, Technische Universitat Chemnitz, GERMANY

Received: June 8, 2015; Accepted: December 17, 2015; Published: February 11, 2016

Copyright: © 2016 Salmela et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: Data are available on request from the corresponding author. The requests should be submitted to the corresponding author (email: viljami.salmela@helsinki.fi) and to the ethics committee of the Hospital District of Helsinki and Uusimaa (Coordinating ethics committee, reference: Dnro 299/13/03/00/2010, email: eettiset.toimikunnat@hus.fi).

Funding: The work was supported by the Academy of Finland (http://www.aka.fi/en/; grant no. 278957 (LH), and grant no:s. 210347, 124698, 111817, 140726 (SV)), and Helsinki University (https://www.helsinki.fi/en; VRS) and Helsinki University Hospital research funds (SV). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

To psychophysically investigate contour shape processing beyond local Gabor-like analysis Wilkinson et al. [1] introduced radial frequency patterns (Fig 1A), closed contour shapes formed by sinusoidally modulating the radius of a base circle (Fig 1C). Any closed shape, such as the outline of human face, can be constructed with multiple radial frequency components (RFC) [2]. Wilkinson et al. [1] showed that human observers are extremely sensitive in detecting shape deformation from circularity, with visual acuity exceeding the spatial resolution of the retina. Psychophysical studies have provided converging evidence that visual system relies on global shape analysis of these patterns [1, 3–10]. Experiments using psychophysical methods of adaptation [11, 12], masking [13], and sub-threshold summation [6] suggested that shape analysis of these patterns are RFC specific. This indicates that closed contour shapes are analysed—similarly to local spatial frequency and orientation—via narrow-band radial frequency channels. The neurophysiological evidence for RFC-based shape representations is, however, still missing.

thumbnail
Download:
Fig 1. Stimuli.

A) Radial frequency patterns with different radial frequencies (3–6) and amplitudes (A1-4). B) All the different shapes were presented in four different orientations (polar phases 0, 90, 180 or 270 deg). In total, 65 different stimuli were used, circles and 64 modulated shapes (4 RFCs x 4 amplitudes x 4 orientations). C) RFC patterns are constructed by modulating a base circle with radial sine function. D) The concave and convex curvatures were calculated at the trough and peak, respectively, of the modulation function. Amplitude refers to the amount of modulation relative to the radius of base circle.

https://doi.org/10.1371/journal.pcbi.1004719.g001

In previous functional magnetic resonance imaging (fMRI) studies, shape representations have been studied with circular gratings and Gabor arrays. Radial and concentric gratings [14] as well as Gabor flow-fields that contain global shape [15] evoke stronger responses in mid-level areas V3 and hV4 than in primary visual cortex (V1) or area V2. Lateral occipital complex (LOC) is also associated with processing of visual objects [16–19] and contours [20]. Human fMRI results are consistent with single-cell recording studies in macaque monkeys that show selectivity for complex shapes in areas V2 [21–24] and V4 [23, 25–29] although complex shape units have been reported also from area V1 [23, 30].

The aim of this work is to test the hypothesis emerging from psychophysical evidence that intermediate shape analysis contains representations of contour RFC. We measured blood oxygenation level dependent (BOLD) responses from the human visual cortex to parametric variation of radial frequency and modulation amplitude of closed contours (Fig 1A). The measured BOLD-responses were analysed with multivariate representational similarity analysis (RSA) [31]. In RSA, correlations between activity patterns evoked by different stimuli are calculated to construct representational dissimilarity matrices (RDMs). To characterize response profiles for different visual areas, the measured RDMs were compared to model RDMs based on stimulus radial frequency, modulation amplitude, local curvature, spatial frequency spectrum and contrast energy. We used a searchlight approach [32] that makes no assumption about location, but instead the whole cortex is scanned voxel-by-voxel to find the stimulus-specific information. We found RFC specific response patterns and our results suggest that mid-level visual areas V2d, V3d, V3AB, and IPS0 contain radial frequency based representations of contour shapes.

Results

Attention task

During the measurements, the participants performed a demanding RSVP task at the fixation [18] to control for attention and to ensure that the participant did not attend to any specific shape or part of the contour. The percentage of correct responses varied, both individually and between runs, from 35 to 80%, but was significantly above the chance level of 25% correct (t(10) = 6.124,p < .001). The average of correct responses across participants was 50%.

BOLD signal changes

First we investigated the activity evoked by our shape stimuli by calculating average activity within the searchlight sphere, each with radius of 3 voxels. This analysis is comparable to standard univariate voxel-wise analysis with smoothing. As expected, the stimuli (all modulated shapes averaged) evoked clear clusters of activity in all mapped visual areas (Fig 2A). Modulated shapes evoked slightly larger activity than circular shapes in all visual areas (Fig 2B), but the difference was statistically significant only in areas V3v, VO1, V3d, and V3AB (Table 1A). The difference in activation is probably due to adaptation (circles were presented more often) or contrast energy (circles had shortest perimeter). The response magnitude varied significantly across areas (Table 1B) and largest responses for both circles and modulated shapes were found in areas V3d, hV4, VO1, V3AB, LO and TO (Fig 2B). Thus our stimuli well activated areas known to be important for shape processing. The amount of activation slightly increased as a function of local curvature, but the increase was not statistically significant (Table 1B and Fig 2C). The amount of activation also slightly decreased as a function radial frequency, but the decrease was not statistically significant (Table 1B and Fig 2D). There were no significant interactions and the activation across visual areas did not depend on the local curvature or the radial frequency of the stimulus (Table 1B). In sum, the stimuli evoked clear responses across visual areas, but the amount of signal change did not depend on the stimulus parameters.

thumbnail
Download:
Fig 2. Activity across visual areas.

A) Within the searchlight, t-value for average activity across different modulated shapes was calculated for each voxel and for each participant. Median t-values across participants are shown on the flattened Freesurfer average surface. Left and right hemispheres are on the left and right sides, respectively. B) Signal changes for circles and modulated shapes in different visual areas. C) Signal changes as a function of local curvature. Value 0.35 depicts circle shape. D) Signal changes as a function of radial frequency in different visual areas.

https://doi.org/10.1371/journal.pcbi.1004719.g002

thumbnail
Download:
Table 1. Statistical tests.

https://doi.org/10.1371/journal.pcbi.1004719.t001

Representational similarity analysis of the BOLD signal

Next we investigated if any of the areas represented specific contour shape information. We tested whether the response profiles in any visual area resembled response profiles predicted on the basis of different stimulus parameters: radial frequency, concave curvature, convex curvature, and modulation amplitude. Within each searchlight we calculated a representational dissimilarity matrix (RDM) by cross-correlating the response patterns for the 16 modulated shapes, and compared the measured RDMs to model RDMs based on shape parameters (Fig 3). Visually comparing the measured RDMs (S1 Fig) with the model RDMs (Fig 3) does not reveal any model superior to other models. Visual inspection suggests, however, that there are differences across visual areas and non-random structures in the measured RDMs (S1 Fig) that might be explained by the stimulus parameters.

thumbnail
Download:
Fig 3. Model and measured RDMs.

The RDMs describe the dissimilarity of the response patterns across different shapes. Five models were constructed based on the classification of the stimuli to four classes (Table 2) and one model was constructed by cross-correlating stimulus SF spectrum. Model RDMs for Radial Frequency, Amplitude, Convex Curvature, Contrast Energy, Spatial Frequency Spectrum, and Concave Curvature, and one example of the measured RDM from visual area V3AB. See S1 Fig for examples of measured RDMs in all areas.

https://doi.org/10.1371/journal.pcbi.1004719.g003

Next, the similarity between the measured and model RDMs was quantified by calculating the correlation between the measured RDMs and model RDMs within the spherical searchlights, and averaged across participants. Fig 4 shows these correlation maps in visual cortex for each model RDM. In general, the response profile maps (Fig 4) resembled the activity maps (Fig 2A), that is, the strongest correlations between brain and model RDMs were found across visual cortices approximately at the same retinotopic locations as the highest activity. However, LO2, TO1 and TO2, while robustly activated in the univariate analysis, were not captured by any of the models in the multivariate analysis.

thumbnail
Download:
Fig 4. Response profile maps.

Correlation maps for Radial Frequency (A), Amplitude (B), Convex Curvature (C), Concave Curvature (D), Spatial Frequency spectrum (E), and Contrast Energy (F). Within the searchlight, correlation with model RDMs was calculated for each voxel. Average correlations, larger than three standard deviations above the mean, across participants are shown on the flattened Freesurfer average surface. Left and right hemispheres on the left and right sides, respectively.

https://doi.org/10.1371/journal.pcbi.1004719.g004

The highest correlations (>three standard deviations above the mean) between the measured RDM and the RFC-model were found in visual areas V1, V2v, V2d, V3d, V3AB, IPS0, and some voxels in area LO1 (Fig 4A) suggesting that the activation patterns in these areas carry information about the RFC of the stimulus contour. For the amplitude of the shape modulation, no clear peaks in correlation were found in any visual area (Fig 4B). For convex curvature, clusters of high correlations were found in areas V1, V2v, V3AB, and in VO1 in right hemisphere (Fig 4C), and for concave curvature, high correlations were found in few voxels in V1 (Fig 4D).

We also calculated correlation maps for spatial frequency and contrast energy. As the radial frequency of the contour and the amplitude of the modulation are increased, the SF-spectrum of the stimulus shifts slightly to higher frequencies. The amplitude modulates the SF-spectrum more than the radial frequency. As expected, the pattern of activity in areas V1-V3, V3AB, IPS0, and V01 strongly correlated with the SF-spectrum of the stimuli (Fig 4D). Similarly the measured RDMs correlated with contrast energy in areas V1-V3, V3AB, and IPS0 (Fig 4E). Thus, the low-level visual factors—contrast energy and spatial frequency—predicted the dissimilarity of the response patterns non-selectively across visual cortex.

Visual area analysis

To further quantify the differences between response profiles across visual areas, we conducted a ROI analysis based on the probability atlas of visual areas [33]. In the ROI analysis, areas LO1 and LO2 that are a part of LOC [18], as well as areas TO1 and TO2, were combined. Further, we used the univariate activity maps (Fig 2A) as functional localizer, that is, for each individual we included only voxels that were clearly activated by the stimuli (t-value > 4.0). Separate repeated measures ANOVAs were conducted for every model.

The average correlation of the measured pattern and RFC-model did not differ across the left and right hemispheres (Table 1C and Fig 5A). However, the average correlation with RFC-model varied significantly across visual areas (Table 1C and Fig 5A). The highest correlations (significantly above zero, p < .05, t-test) between the measured RDM and RFC model RDM were in areas V2d, V3d, V3AB and IPS0, in both the left and the right hemispheres (Table 1D and Fig 5A). That is, in these visual areas the measured response patterns carried information about the radial frequency of the shape stimuli. The correlations in areas V1 and V2v were not significantly above zero. In areas V3v, hV4, VO1, LO1/LO2 and TO1/TO2, the average correlation with RFC-model was close to zero (Fig 5A). No significant interaction between the hemisphere and visual area (Table 1C) was found for RFC model suggesting that radial frequency is similarly represented in same visual areas in both hemispheres. Thus, the statistical analyses confirm the selective spread of pattern correlations for radial frequency only for certain visual areas, as was shown in the Fig 4A.

thumbnail
Download:
Fig 5. Visual area analysis.

A) Average correlations with Radial Frequency model for different visual areas in the left and right hemispheres. B) Average correlations with all models. Hemispheres have been averaged. Error bars depict standard error of mean across participants. C) Dorsal-Ventral difference. Average correlation difference between dorsal (V2d, V3d, V3AB, IPS0) and ventral (V2v, V3v, hV3, VO1) visual areas for model RDMs. *p < .05 (t-test).

https://doi.org/10.1371/journal.pcbi.1004719.g005

The effect of hemisphere was not significant for any model indicating robustness of the result. The correlations varied significantly across visual areas also for SF and contrast energy, but not for amplitude, concave curvature or convex curvature (Table 1C). The effect of SF and contrast energy was expected since these are the primary factors that drive the low-level neural responses. However, the modulation amplitude as such and the direction of local curvature seem not to be represented specifically in any certain visual area. The interaction between the hemisphere and visual area was not significant for any model, showing that response patterns were similar in the same visual areas in both hemispheres.

Since no significant effects of hemisphere were found, the correlations for each model RDM were averaged across hemispheres, and tested with t-tests (significantly above zero, p < .05) to statistically confirm the spread of correlations across visual areas (shown in Fig 4). We used probabilistic atlas to localize the visual areas and this might produce some uncertainty to classifying areas close to each other. Therefore, nearby visual areas were averaged as follows: V1, V2d/V3d, V3AB/IPS0, V2v/V3v, hV4/VO1, and LO/TO. The average correlation of the measured RDM with RFC model varied across areas and was significantly above zero in V2d/V3d and V3AB/IPS0 (Fig 5B). The average correlation with Amplitude model RDMs was constantly low and not significantly higher than zero in any of these areas. The average correlation to other models remained high across most of the areas: correlation with SF and energy models was significantly above zero in all areas, correlation with concave model was significantly above zero in all areas except LO/TO, and correlation with convex models was significantly above zero in all areas except hV4/VO1 and LO/TO (Fig 5B).

The clearest area specificity was found for radial frequency. This selectivity was further quantified by comparing (paired sample t-test) the average correlation in dorsal and ventral areas. Statistically significant difference between the ventral and dorsal part of areas V2 and V3, as well as between areas V3AB/IPS0 and hV4/VO1 was found only for RFC, but not for other models (Table 1E). The average difference across all dorsal (V2d/V3d/V3AB/IPS0) and ventral (V2v/V3v, hV4/VO1) areas was largest for radial frequency (Fig 5C), and this difference was significantly higher than for SF (Table 1E).

Searchlight RSA regression analysis

To further test the independent role of different stimulus parameters, a multiple linear regression analysis within each searchlight was conducted. The regression model contained all six model RDMs: radial frequency, amplitude, convex and concave curvature, contrast energy, and SF spectrum. The average R2 was 0.11, and varied between 0.09 and 0.13 depending on the visual area. Thus, all the models explained 11% of the total variability within the searchlights. Next we conducted regression analysis with leave-one-out method and calculated the change of R2 values relative to the full model. Removing the SF model from the regressors decreased R2 values ca. 40%. For other models, the decrease was 7–16%. Thus most of the explained variability was due to the SF model. This was expected since highest correlations were found for the SF model, and the SF model contains the same information of the stimulus variability as the other models combined. Next we replicated the regression analyses without the SF model. The average R2 of the full model decreased to 0.06. In the leave-one-out analysis, largest decrease of R2 values were found for convex curvature (29%) and radial frequency (23%). However, only for radial frequency the relative decrease of R2 values varied significantly across areas (Table 1F) and was more prominent in dorsal (V2d/V3d and V3AB/IPS0) than in ventral (V2v/V3v and hV4/VO1) areas. Thus, a similar specificity for RFC across visual areas was found in the regression analysis as in the correlation analysis.

Discussion

Multivariate representational similarity analysis revealed that the RFC of the contour is represented in human visual areas V2d, V3d, V3AB and IPS0. Surprisingly, the areas hV4 and LO1/LO2, known to be important in global shape processing [15, 19, 20], while responding to the stimuli, did not show pattern selectivity for radial frequency. Low-level visual properties—SF spectrum and contrast energy–did not explain our results, since these parameters did not show similar specificity across visual areas as the radial frequency. Our results provide evidence for radial frequency based representations which could be used in contour shape processing, and in particular, we suggest that RFC representations are a mid-level link between local contour analysis in V1 and more comprehensive global shape analysis in areas such as hV4 and LOC. Alternatively, the radial frequency information in the early and intermediate areas may be utilised more directly in the higher level object sensitive areas with no additional middle steps.

Most previous fMRI studies on contour shape perception have compared BOLD-responses to different shapes, i.e., circular vs. parallel gratings [14] or global circular shapes vs. only local curvatures [15]. In the former study hV4 and FFA showed selectivity for concentric shapes, and in the latter study visual areas V3, VP and hV4 showed strongest responses to circularity. Consistent with these studies, our modulated shapes evoked larger responses than circular shapes in univariate analysis of mean signal change, i.e. in the overall fMRI response. The response magnitude did not, however, depend on the local curvature or radial frequency. In order to investigate the role of different stimulus parameters on shape representations, we investigated the multivariate similarity structure [31, 34] of the activity patterns evoked by parametric variation of the contour shapes. The multi-voxel pattern analysis is more sensitive than direct comparison of average responses within the visual area, because the multidimensional pattern of BOLD-responses across voxels contains more information about the response than the averaged one-dimensional measure. Further, the searchlight based approach [32] makes no assumptions where the stimulus specific activation patterns should be found. Our results provide further evidence that radial frequency is used in the contour shape analysis in the visual cortex. Furthermore, our results suggest that RFC based representations are located in visual areas V2d, V3d, V3AB and IPS0. For areas hV4 and LO1/LO2 we did not find evidence for RFC based representations.

Integration of local visual features to contours likely involves visual areas at different processing levels [35, 36]. The representations of contour convexity and concavity, as well as the representations of global shape are likely located in visual areas V3AB, hV4 and LOC [14, 15, 18, 20, 37–40]. In agreement with these studies, largest univariate responses in our study included areas V3AB, hV4 and LO1/LO2. However, the multivariate patterns were different between these areas. Our results suggest that the global closed-shape representations in V3AB are based on the radial frequency of the contour, but we did not find similar RFC based activity patterns in hV4 or LO1/LO2.

The lack of pattern specificity in hV4 and LOC was not due to our stimuli as such, since they robustly activated also these areas. One possibility is that shape representations or neurons encoding shapes in hV4 are so close to each other that voxel-level activity patterns measured with fMRI cannot discriminate them or the MVPA methods are not sensitive enough. This would suggest different structure for V3AB and hV4 neurons/representations since we did find significant voxel-level pattern correlations in V3AB. In primates, cell density [41] and microvascular density [42] vary across cortical areas which might affect BOLD-responses, and thus this is a possible explanation for the difference between the areas we found. Future studies could aim to image the RFC representations in these areas with smaller voxel size or higher spatial resolution using high-field fMRI. Second possible explanation for the difference between the visual areas is that fMRI might be particularly sensitive for feedback [43, 44]. Multivariate pattern reflects data distributed in large part of a functional area, whereas the univariate pattern is sensitive to more local changes. In this scheme the multivariate analysis might better see the feedback effects which typically have much wider distribution than the classical receptive field [45] and this would emphasize the early areas as well as give different distribution in the mid-level areas. Third possibility is that—since the RFC based representations are mainly limited to closed shapes—areas that represent more complex visual objects, such as hV4 and LOC, might simply use some other type of shape encoding.

Instead of individual functional localization of visual areas, we used probability atlas of visual areas measured in a separate study [33]. The average location of early visual areas (e.g., V1-V3) is more accurate than subsequent visual areas (e.g., hV4, LO1/LO2). Hence there might be more locational variability in the activity patterns in hV4 and LO1/LO2 across individuals and this might explain the absence of RFC specific activity patterns. However, we did find significant correlation between measured patterns and model RDMs for SF Spectrum and Contrast Energy also in areas hV4/VO1. In our searchlight analysis the activity patterns are smoothed with the spherical volume of searchlight, and we calculated an average within the ROIs. This analysis controls for small deviations in exact locations of activity patterns. Furthermore, all mapped visual areas, including hV4 and LO1/LO2, were activated by our stimuli and these univariate activation maps were used as functional localizers in the ROI analysis of RDM correlations. This emphasizes voxels across visual areas that were indeed processing our stimuli. Still, some locational uncertainties in our results remain. However, the locational uncertainties are more likely between nearby areas, e.g., between areas V2 and V3, than areas further away, such as between areas V3AB and hV4.

Another limitation of our study is the relatively low correlations found between measured and model RDMs. While the correlations were quite low, the results were systematic across participants, and the effect sizes (of the ANOVAs testing the effect of visual area) were large (Table 1). Instead of the correlation values as such, the structure of correlations across studied events was the main interest in our study. These structures reveal information of the representational geometry that can be compared to predictions based on different models, and we found clear differences between the models based on RFC of the contour and models based on the other stimulus parameters. Further, most of the previous RSA studies have investigated representational similarities across object categories. In contrast, we studied representational similarities of relatively similar shapes within a category, which could also explain the low correlation values we obtained.

The asymmetry between the dorsal and ventral areas for RFC model could be related to the ecologically justified and well known difference between the upper and lower visual fields [46]. Anatomically, there is slightly more cortex representing the lower than the upper visual field in macaque monkey V1 [47], physiologically stronger responses in MEG in humans [48, 49], and better behavioral performance in humans [46, 50]. In line with these earlier findings, our results suggest that radial frequency representations are biased towards cortical areas with lower visual field representations. This finding can be contributed by the relative cortical size of the lower vs. the upper visual field representations, and differences in the represented eccentricities in dorsal and ventral areas. However, we did not find similar asymmetry for contrast energy and spatial frequency. The anisotropy between IPS0/V3AB and hV4/VO1 areas cannot be explained by retinotopy, because all these areas comprise half-field representations, i.e. both the upper and lower visual fields [51]. Consistent with our results, lower visual field advantage was recently demonstrated for perception of RFC shape stimuli whereas no similar asymmetry was found for orientation or curvature discrimination [52].

The radial frequency and amplitude of the modulation determine the shape of an RFC pattern. However, several other parameters vary as the RF and amplitude of the stimulus is varied. Increasing the amplitude and the radial frequency increases the contour length and contrast energy and shifts the SF spectrum to higher SFs. The RDM models based on these low-level visual parameters did correlate with the measured patterns across visual areas but without similar specificity as was found for radial frequency. Thus the results found with the RFC-model are not due to these low level factors but reflect the different activity patterns evoked by the parametric modulation of RFC. For the amplitude of modulation the average correlation was constantly near zero, as expected. The amplitude as such is not a critical parameter for visual shape analysis. Slightly higher correlations were found for convex than concave curvature, but the correlations did not vary much across visual areas for these parameters. Higher correlations for convex curvature might indicate more critical role of convex than concave forms and angles in shape analysis, as previously suggested [4, 13, 28, 40, 53, 54].

In our experiment, all the stimuli were presented in four different orientations. As the orientation of the shape was varied, the shapes activated slightly different retinotopic locations. However, the RSA analysis was conducted for SPMT-images in which the shapes in different orientations had been averaged. Thus the role of different retinotopic locations was controlled already in GLM analysis. We did a separate control analysis with a different GLM model (shapes averaged across different amplitudes instead of orientations) and calculated correlation maps for the orientation and the retinotopic locations. As expected, the correlation map for the orientation as such did not reveal any peaks in any visual area. The correlation map for retinotopy revealed clear activity peaks across visual areas and was highly similar to the correlation map for the SF spectrum.

Recently, radial frequency patterns and multi-voxel pattern analyses have been used to study perception of RFC motion trajectories [55, 56]. The motion trajectory of a dot could be decomposed from areas V2, V3 and MT [55, 56]. In contrast, the shape of the static RFC patterns could not be decoded in these areas, but only in posterior parietal areas and in LOC [56]. In contrast, we found RFC specific response profiles in areas V2-V3, and V3AB. There are several differences in our and Gorbet et al. [56] experimental setups and data analysis which likely explain the different results. Most likely our setup was more sensitive to differences between RFCs because we had much higher number of stimulus presentations, and we compared response patterns to all different RFCs simultaneously, instead of comparing only two RFCs at a time [56]. Nevertheless, both our and Gorbet et al. [55, 56] studies agree in that radial frequency is used in the visual shape analysis in areas V2 and V3, but not in area hV4.

The prevailing theoretical view suggests that neural representation of the visual environment is built from a sparse set of basis functions whose combinations constitute the population code for perceptual representations [57, 58]. It is possible that the RFC representations, corresponding to the relatively simple combinations of Gabors, provide a set of mid-level basis functions for shape analysis. Our results provide further support for the idea of radial frequency based representations in shape perception, and suggest that the neural mechanisms that utilize radial frequency are located in the intermediate visual areas V2d, V3d, V3AB and IPS0, but not in areas hV4 or LOC. This result places the radial frequency representations to relatively early position in visual processing, presumably beyond Gabor analysis, but before object identification.

Materials and Methods

Ethics statement

The ethics committee of the Hospital District of Helsinki and Uusimaa had approved the experiments (Coordinating ethics committee, Dnro 299/13/03/00/2010). The experiments were conducted according to the declaration of Helsinki and participants gave written informed consent before the measurements.

Participants

Eleven participants (one female), with normal or corrected-to-normal vision, participated in the study. First and last author participated as subjects; the rest of the participants were naïve to the purpose of the study.

Stimuli

The stimuli were radial frequency patterns (Fig 1A), which were constructed by sinusoidally modulating (Fig 1C) the radius of a base circle [1]. The spatial profile of the contour was 4th derivative of Gaussian and the peak spatial frequency of the contour was 1.57 c/deg (σ = 0.28 deg). The shapes were composed of four different radial frequencies, amplitudes (Fig 1A) and orientations (Fig 1B). The radial frequencies were 3 (triangle), 4 (quadrilateral), 5 (pentagon) and 6 (hexagon) cycle/perimeter. The minimum and the maximum local curvature of the contour depend on the radial frequency and the amplitude of the shape (equation 4 in [1]). The amplitude of the shapes was varied so that the maximum local curvatures at the peak (point of maximum curvature or convex curvature) and the trough (point of minimum curvature or concave curvature) of the radial modulation (Fig 1D) were roughly equal across different radial frequencies (Table 2). The amplitude varied between 0.0 and 0.46 in proportion to the radius, the maximum concave curvature varied between -0.1 and -4.8 deg-1, and the maximum convex curvature varied between 0.6 and 2.3 deg-1 (Table 2). Each stimulus was presented in four orientations, which corresponded to polar phases 0, 90, 180 and 270 deg (Fig 1B). In total there were 65 different stimuli (circle + 4 radial frequencies x 4 amplitudes x 4 orientations). The rms-contrast (the standard deviation of the luminance divided by the mean luminance) of the stimuli was 0.17, and same for all the stimuli. The radius of the base circle was 2.86 deg and the stimulus maximum diameter varied from 5.7 (circle) to 8.6 deg (radial frequency four with amplitude of 0.35).

thumbnail
Download:
Table 2. Stimulus parameters and classifications in model RDMs.

https://doi.org/10.1371/journal.pcbi.1004719.t002

fMRI data acquisition

The fMRI data were acquired with a Siemens MAGNETOM Skyra 3 T scanner (Siemens Healthcare, Erlangen, Germany) equipped with a 30- or 32-channel receive only head coil. Each measurement session started with a fast structural MR image with a 3D T1-weighted sequence (in-plane resolution 1.8x1.8 mm, and 1.5 mm slice thickness). Then eight experimental runs were measured using a gradient-echo echo planar imaging sequence (TR = 1800 ms, TE = 30 ms, flip angle = 60 deg, 64x64 acquisition matrix, FOV = 20 cm, 23 slices, 3.0 mm slice thickness, resulting in 3.1 x 3.1 x 3.0 mm voxel size).

The fMRI data were analyzed with SPM8 Matlab toolbox [59] and Freesurfer [60] software packages. The preprocessing comprised first the correction for the acquisition order of the functional images and then for the head motion.

Procedure

Circles and 64 different contour shapes were presented in event-related design. In each run all shapes were presented once, except circular stimulus, which was presented 16 times. In addition, 20 rest trials were included. In total, one run consisted of 100 events (20 rests + 16 circles + 64 modulated shapes). The duration of each stimulus was 300 ms and the duration of each trial 2.4 seconds. Hence, the length of the run was 240 s (100*2.4s, corresponding to 135 volumes). Each run started with eight volumes, which were discarded from the analysis to reach stable magnetization. Stimuli were presented with abrupt on/offset. In total, eight runs were measured resulting in 800 stimulus presentations. The order of stimuli in each run was optimally randomized [61] and the order of runs was randomized across participants. Each radial frequency was presented 128 times (4 (amplitudes) x 4 (orientations) x 8 runs).

The shapes were presented at 10 deg eccentricity (at 43-cm viewing distance), one (same) shape in each quadrant in order to have separable upper/lower and left/right visual field responses in early visual areas. The participants performed a demanding RSVP attention task at the fixation [18]. Five different letters (Z,L,N,T, and X; Arial-font) were rapidly presented at fixation (150 ms/letter). The letter series contained 1–4 ‘X’-letters and the participants’ task was to count the ‘X’s and report the number of ‘X’s during a 1 s break in every 5.4 seconds. The letter task was used to control for participants attention. The letter task, instead of shape discrimination task, was also used to avoid ceiling effects in behavioral performance since the contour shapes were supra-threshold, far exceeding the contrast sensitivity and discrimination thresholds of these patterns.

Data analysis

The general linear model (GLM) analysis included a design matrix where the data were modelled with 17 effects of interest (1 for circle, 16 for different modulated shapes) and 8 nuisance regressors (1 for RSVP-letters, 1 for responses to attention task, and 6 for head motion parameters). Data were high-pass filtered at 1/200 Hz. SPMT-images were calculated for the 17 stimulus-related regressors, and corresponding BOLD signal changes for each voxel by dividing the parameter estimates with mean response. In the experiment each shape was presented in four different orientations. The orientation was omitted from the analysis and each shape was modelled with one regressor. Separate control analysis confirmed that orientation as such did not have significant effect on the measured activity patterns.

Next, we applied several searchlight analyses [32]. The radius of the spherical searchlight was 3 voxels, resulting in an average search volume of 100 voxels (similar results were obtained with smaller (70 voxels) and larger (270 voxels) searchlight volumes). First searchlight analysis was conducted to find visual areas that were activated by the contour stimuli. For a univariate activity map, comprising ca. 30000 voxels, we first centered the searchlight volume at each voxel, and then calculated within the volume the T-value of average signal change across the different shapes, i.e., stimulus-related regressors. The circle shape was omitted from the analysis because it was presented more often than other shapes, and it evoked weaker responses than modulated shapes. The same analysis was repeated for each participant. The result essentially corresponds to classical activity map but with smoothing by the searchlight volume.

In the subsequent searchlight analyses, we calculated a representational dissimilarity matrix (RDM; [31]) within each searchlight. The RDM comprised 1—Pearson correlation between the response patterns for the 16 visual shapes (the circle shape was again omitted from the analysis). The logic of the searchlight analysis is straightforward: If the multi-voxel response pattern, contained within the spherical searchlight, carries information about a parameter, such as the stimulus shape, then there should be high correlation between voxel response patterns for similar shapes and low correlation for dissimilar shapes. To find out what information the visual areas were representing, the measured RDMs within the searchlights were compared to different model RDMs [31, 62]. The comparison was quantified as Spearman correlation between the measured and model RDMs. Since the RDMs are symmetric over the diagonal, only the lower triangular parts of the matrices were used in the comparison. The searchlight RSA analysis were conducted using the RSA toolbox [63].

Model RDMs

The RDM models for Radial Frequency Components (RCF), Amplitude, Concave and Convex Curvature were constructed by classifying the stimuli according to the parameter of interest (Fig 3; Table 2). In the RDM for RFC, for example, the stimuli are classified according to the radial frequency of the stimulus (RFC 3–6), and nearby radial frequencies are expected to be represented more similar than more distant radial frequencies. Thus, if the RFC of the shape is represented in any visual area, then the activity patterns for the same RFCs are expected to be more similar (higher correlation) than the activity patterns for different RFCs. A similar logic applies to other features of the stimuli. Separate models for concave and convex local curvature were used since previous studies have suggested different role of concavities and convexities in shape perception [53] and in fMRI [40]. To control for low-level visual feature similarity between the stimuli, two additional RDM models were calculated for Contrast Energy and Spatial Frequency (SF) spectrum of the stimuli (Fig 3). For the Contrast Energy model, total contrast energy (sum of squared pixel contrast values) for each stimulus was calculated and classified to create the model RDMs (Table 2). For the SF model, SF spectrum of each stimulus was calculated and cross-correlated to create model RDM.

In total 7 searchlight maps (activity map + 6 RSA correlation maps) were calculated for each participant. The individual searchlight maps were projected on the Freesurfer average cortical surface, and averaged across participants. The visual areas were identified from the Freesurfer average surface on the basis of probability atlas of visual areas measured in the separate study [33]. The statistical significance of the average signal changes and correlations across participants were tested with repeated measures ANOVAs and t-tests. Greenhouse-Geisser correction was used in ANOVAs when Mauchly's test of sphericity was significant.

Supporting Information

S1 Fig. Measured RDMs.

A) Measured RDMs from different visual areas averaged across participants. Visual evaluation of measured matrices does not reveal any clear structure comparable to model RDMs (Fig 3) or clear differences between visual areas. B) Measured RDMs and RFC model averaged to 4×4 matrices. These averaged RDMs were most similar with the RFC model RDM in areas V3d (r=.32), IPS0 (r=.42) and LO (r=.42), but the correlations were not statistically significant (permutation test).

https://doi.org/10.1371/journal.pcbi.1004719.s001

(PDF)

Author Contributions

Conceived and designed the experiments: VRS LH SV. Performed the experiments: VRS SV. Analyzed the data: VRS LH. Wrote the paper: VRS LH SV.

References

  1. 1. Wilkinson F., Wilson H.R., Habak C. (1998). Detection and recognition of radial frequency patterns. Vision Res 38, 3555–3568 pmid:9893789
  2. 2. Wilson H.R., Wilkinson F. (2002). Symmetry perception: a novel approach for biological shapes. Vision Res 42, 589–597 pmid:11853776
  3. 3. Jeffrey B.G., Wang Y.Z., Birch E.E. (2002). Circular contour frequency in shape discrimination. Vision Res 42, 2773–2779 pmid:12450496
  4. 4. Loffler G., Wilson H.R., Wilkinson F. (2003). Local and global contributions to shape discrimination. Vision Res 43, 519–530 pmid:12594998
  5. 5. Bell J., Badcock D.R. (2008). Luminance and contrast cues are integrated in global shape detection with contours. Vision Res 48, 2336–2344 pmid:18703078
  6. 6. Bell J., Badcock D.R. (2009). Narrow-band radial frequency shape channels revealed by sub-threshold summation. Vision Res 49, 843–850 pmid:19275912
  7. 7. Hess R.F., Achtman R.L., Wang Y.Z. (2001). Detection of constrast-defined shape. Journal of the Optical Society of America A, Optics, image science, and vision 18, 2220–2227 pmid:11551057
  8. 8. Hess R.F., Wang Y.Z., Dakin S.C. (1999). Are judgements of circularity local or global? Vision Res 39, 4354–4360 pmid:10789429
  9. 9. Bell J., Hancock S., Kingdom F.A., Peirce J.W. (2010). Global shape processing: which parts form the whole? J Vis 10, 16
  10. 10. Mullen K.T., Beaudot W.H. (2002). Comparison of color and luminance vision on a global shape discrimination task. Vision Res 42, 565–575 pmid:11853774
  11. 11. Anderson N.D., Habak C., Wilkinson F., Wilson H.R. (2007). Evaluating shape after-effects with radial frequency patterns. Vision Res 47, 298–308 pmid:17178143
  12. 12. Bell J., Wilkinson F., Wilson H.R., Loffler G., Badcock D.R. (2009). Radial frequency adaptation reveals interacting contour shape channels. Vision Res 49, 2306–2317 pmid:19580822
  13. 13. Habak C., Wilkinson F., Zakher B., Wilson H.R. (2004). Curvature population coding for complex shapes in human vision. Vision Res 44, 2815–2823 pmid:15342225
  14. 14. Wilkinson F., James T.W., Wilson H.R., Gati J.S., Menon R.S., Goodale M.A. (2000). An fMRI study of the selective activation of human extrastriate form vision areas by radial and concentric gratings. Curr Biol 10, 1455–1458 pmid:11102809
  15. 15. Dumoulin S.O., Hess R.F. (2007). Cortical specialization for concentric shape processing. Vision Res 47, 1608–1613 pmid:17449081
  16. 16. Kanwisher N., Woods R.P., Iacoboni M., Mazziotta J.C. (1997). A locus in human extrastriate cortex for visual shape analysis. J Cogn Neurosci 9, 133–142 pmid:23968185
  17. 17. Malach R., Reppas J.B., Benson R.R., Kwong K.K., Jiang H., Kennedy W.A., et al. (1995). Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci U S A 92, 8135–8139 pmid:7667258
  18. 18. Larsson J., Heeger D.J. (2006). Two retinotopic visual areas in human lateral occipital cortex. J Neurosci 26, 13128–13142 pmid:17182764
  19. 19. Grill-Spector K., Kourtzi Z., Kanwisher N. (2001). The lateral occipital complex and its role in object recognition. Vision Res 41, 1409–1422 pmid:11322983
  20. 20. Drucker D.M., Aguirre G.K. (2009). Different spatial scales of shape similarity representation in lateral and ventral LOC. Cereb Cortex 19, 2269–2280 pmid:19176637
  21. 21. Hegde J., Van Essen D.C. (2000). Selectivity for complex shapes in primate visual area V2. J Neurosci 20, RC61 pmid:10684908
  22. 22. Anzai A., Peng X., Van Essen D.C. (2007). Neurons in monkey visual area V2 encode combinations of orientations. Nat Neurosci 10, 1313–1321 pmid:17873872
  23. 23. Hegde J, Van Essen D.C. (2007). A comparative study of shape representation in macaque visual areas v2 and v4. Cereb Cortex 17, 1100–1116 pmid:16785255
  24. 24. Willmore B.D., Prenger R.J., Gallant J.L. (2010). Neural representation of natural images in visual area V2. J Neurosci 30, 2102–2114 pmid:20147538
  25. 25. Gallant J.L., Braun J., Van Essen D.C. (1993). Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. Science 259, 100–103 pmid:8418487
  26. 26. Muller K.M., Wilke M., Leopold D.A. (2009). Visual adaptation to convexity in macaque area V4. Neuroscience 161, 655–662 pmid:19345725
  27. 27. Pasupathy A., Connor C.E. (2002). Population coding of shape in area V4. Nat Neurosci 5, 1332–1338 pmid:12426571
  28. 28. Pasupathy A., Connor C.E. (1999). Responses to contour features in macaque area V4. J Neurophysiol 82, 2490–2502 pmid:10561421
  29. 29. Gallant J.L., Connor C.E., Rakshit S., Lewis J.W., Van Essen D.C. (1996). Neural responses to polar, hyperbolic, and Cartesian gratings in area V4 of the macaque monkey. J Neurophysiol 76, 2718–2739 pmid:8899641
  30. 30. McManus J.N., Li W., Gilbert C.D. (2011). Adaptive shape processing in primary visual cortex. Proc Natl Acad Sci U S A 108, 9739–9746 pmid:21571645
  31. 31. Kriegeskorte N., Mur M., Bandettini P. (2008). Representational similarity analysis—connecting the branches of systems neuroscience. Frontiers in systems neuroscience 2, 4 pmid:19104670
  32. 32. Kriegeskorte N., Goebel R., Bandettini P. (2006). Information-based functional brain mapping. Proc Natl Acad Sci U S A 103, 3863–3868 pmid:16537458
  33. 33. Henriksson L., Karvonen J., Salminen-Vaparanta N., Railo H., Vanni S. (2012). Retinotopic maps, spatial tuning, and locations of human visual areas in surface coordinates characterized with multifocal and blocked FMRI designs. PLoS One 7, e36859 pmid:22590626
  34. 34. Kriegeskorte N., Kievit R.A. (2013). Representational geometry: integrating cognition, computation, and the brain. Trends in cognitive sciences 17, 401–412 pmid:23876494
  35. 35. Kourtzi Z., Tolias A.S., Altmann C.F., Augath M., Logothetis N.K. (2003). Integration of local features into global shapes: monkey and human FMRI studies. Neuron 37, 333–346 pmid:12546827
  36. 36. Altmann C.F., Bulthoff H.H., Kourtzi Z. (2003). Perceptual organization of local elements into global shapes in the human visual cortex. Curr Biol 13, 342–349 pmid:12593802
  37. 37. Mannion D.J., Clifford C.W. (2011). Cortical and behavioral sensitivity to eccentric polar form. J Vis 11,
  38. 38. Mannion D.J., Kersten D.J., Olman C.A. (2013). Consequences of polar form coherence for fMRI responses in human visual cortex. Neuroimage 78, 152–158 pmid:23608060
  39. 39. Ostwald D., Lam J.M., Li S., Kourtzi Z. (2008). Neural coding of global form in the human visual cortex. J Neurophysiol 99, 2456–2469 pmid:18322002
  40. 40. Haushofer J., Baker C.I., Livingstone M.S., Kanwisher N. (2008). Privileged coding of convex shapes in human object-selective cortex. J Neurophysiol 100, 753–762 pmid:18579661
  41. 41. Collins C.E., Airey D.C., Young N.A., Leitch D.B., Kaas J.H. (2010). Neuron densities vary across and within cortical areas in primates. Proc Natl Acad Sci U S A 107, 15927–15932 pmid:20798050
  42. 42. Weber B., Keller A.L., Reichold J., Logothetis N.K. (2008). The microvascular system of the striate and extrastriate visual cortex of the macaque. Cereb Cortex 18, 2318–2330 pmid:18222935
  43. 43. Vanni S., Sharifian F., Heikkinen H., Vigario R. (2015). Modeling fMRI signals can provide insights into neural processing in the cerebral cortex. J Neurophysiol 114, 768–780 pmid:25972586
  44. 44. Heikkinen H., Sharifian F., Vigario R., Vanni S. (2015). Feedback to distal dendrites links fMRI signals to neural receptive fields in a spiking network model of the visual cortex. J Neurophysiol 114, 57–69 pmid:25925319
  45. 45. Angelucci A., Levitt J.B., Walton E.J., Hupe J.M., Bullier J., Lund J.S. (2002). Circuits for local and global signal integration in primary visual cortex. J Neurosci 22, 8633–8646 pmid:12351737
  46. 46. Skrandies W. The Upper and Lower Visual Field of Man: Electrophysiological and Functional Differences. In: Autrum H, Ottoson D, Perl E, Schmidt R, Shimazu H, Willis W, editors. Progress in Sensory Physiology. Progress in Sensory Physiology. 8: Springer Berlin Heidelberg; 1987. p. 1–93.
    • 47. Van Essen D.C., Newsome W.T., Maunsell J.H. (1984). The visual field representation in striate cortex of the macaque monkey: asymmetries, anisotropies, and individual variability. Vision Res 24, 429–448 pmid:6740964
    • 48. Portin K., Vanni S., Virsu V., Hari R. (1999). Stronger occipital cortical activation to lower than upper visual field stimuli. Neuromagnetic recordings. Experimental brain research 124, 287–294 pmid:9989434
    • 49. Hagler D.J. Jr. (2014). Visual field asymmetries in visual evoked responses. J Vis 14, 13
    • 50. McAnany J.J., Levine M.W. (2007). Magnocellular and parvocellular visual pathway contributions to visual field anisotropies. Vision Res 47, 2327–2336 pmid:17662333
    • 51. Wandell B.A., Dumoulin S.O., Brewer A.A. (2007). Visual field maps in human cortex. Neuron 56, 366–383 pmid:17964252
    • 52. Schmidtmann G., Logan A.J., Kennedy G.J., Gordon G.E., Loffler G. (2015). Distinct lower visual field preference for object shape. Journal of Vision 15, 18–18
    • 53. Poirier F.J., Wilson H.R. (2007). Object perception and masking: contributions of sides and convexities. Vision Res 47, 3001–3011 pmid:17889924
    • 54. Kurki I., Saarinen J., Hyvarinen A. (2014). Investigating shape perception by classification images. J Vis 14,
    • 55. Gorbet D.J., Wilkinson F., Wilson H.R. (2012). An fMRI examination of the neural processing of periodic motion trajectories. J Vis 12, 5
    • 56. Gorbet D.J., Wilkinson F., Wilson H.R. (2014). Neural correlates of radial frequency trajectory perception in the human brain. J Vis 14,
    • 57. Olshausen B.A., Field D.J. (2004). Sparse coding of sensory inputs. Current opinion in neurobiology 14, 481–487 pmid:15321069
    • 58. Poggio T. (1990). A Theory of How the Brain Might Work. Cold Spring Harbor Symposia on Quantitative Biology 55, 899–910 pmid:2132866
    • 59. Penny W.D., Friston K.J., Ashburner J.T., Kiebel S.J., Nichols T.E. Statistical Parametric Mapping: The Analysis of Functional Brain Images: The Analysis of Functional Brain Images: Elsevier Science; 2006.
      • 60. Dale A.M., Fischl B., Sereno M.I. (1999). Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 9, 179–194 pmid:9931268
      • 61. Wager T.D., Nichols T.E. (2003). Optimization of experimental design in fMRI: a general framework using a genetic algorithm. Neuroimage 18, 293–309 pmid:12595184
      • 62. Kriegeskorte N. (2011). Pattern-information analysis: from stimulus decoding to computational-model testing. Neuroimage 56, 411–421 pmid:21281719
      • 63. Nili H., Wingfield C., Walther A., Su L., Marslen-Wilson W., Kriegeskorte N. (2014). A toolbox for representational similarity analysis. PLoS computational biology 10, e1003553 pmid:24743308