Abstract: This book, first published in 1979, is about how we see: the environment around us (its surfaces, their layout, and their colors and textures); where we are in the environment; whether or not we are moving and, if we are, where we are going; what things are good for; how to do things (to thread a needle or drive an automobile); or why things look as they do The basic assumption is that vision depends on the eye which is connected to the brain The author suggests that natural vision depends on the eyes in the head on a body supported by the ground, the brain being only the central organ of a complete visual system When no constraints are put on the visual system, people look around, walk up to something interesting and move around it so as to see it from all sides, and go from one vista to another That is natural vision -- and what this book is about

Abstract: The ventral temporal cortex (VTC) rapidly and flexibly categorizes visual stimuli. In this Review, Grill-Spector and Weiner discuss how the structural features of the VTC support the computations that are necessary to achieve this categorization.

Abstract: Visual input often arrives in a noisy and discontinuous stream, owing to head and eye movements, occlusion, lighting changes, and many other factors. Yet the physical world is generally stable; objects and physical characteristics rarely change spontaneously. How then does the human visual system capitalize on continuity in the physical environment over time? We found that visual perception in humans is serially dependent, using both prior and present input to inform perception at the present moment. Using an orientation judgment task, we found that, even when visual input changed randomly over time, perceived orientation was strongly and systematically biased toward recently seen stimuli. Furthermore, the strength of this bias was modulated by attention and tuned to the spatial and temporal proximity of successive stimuli. These results reveal a serial dependence in perception characterized by a spatiotemporally tuned, orientation-selective operator-which we call a continuity field-that may promote visual stability over time.

Abstract: Visual science is the model system for neuroscience, its findings relevant to all other areas. This essential reference to contemporary visual neuroscience covers the extraordinary range of the field today, from molecules and cell assemblies to systems and therapies. It provides a state-of-the art companion to the earlier book The Visual Neurosciences (MIT Press, 2003). This volume covers the dramatic advances made in the last decade, offering new topics, new authors, and new chapters. The New Visual Neurosciences assembles groundbreaking research, written by international authorities. Many of the 112 chapters treat seminal topics not included in the earlier book. These new topics include retinal feature detection; cortical connectomics; new approaches to mid-level vision and spatiotemporal perception; the latest understanding of how multimodal integration contributes to visual perception; new theoretical work on the role of neural oscillations in information processing; and new molecular and genetic techniques for understanding visual system development. An entirely new section covers invertebrate vision, reflecting the importance of this research in understanding fundamental principles of visual processing. Another new section treats translational visual neuroscience, covering recent progress in novel treatment modalities for optic nerve disorders, macular degeneration, and retinal cell replacement. The New Visual Neurosciences is an indispensable reference for students, teachers, researchers, clinicians, and anyone interested in contemporary neuroscience. Associate EditorsMarie Burns, Joy Geng, Mark Goldman, James Handa, Andrew Ishida, George R. Mangun, Kimberley McAllister, Bruno Olshausen, Gregg Recanzone, Mandyam Srinivasan, W.Martin Usrey, Michael Webster, David Whitney SectionsRetinal Mechanisms and ProcessesOrganization of Visual PathwaysSubcortical ProcessingProcessing in Primary Visual CortexBrightness and ColorPattern, Surface, and ShapeObjects and ScenesTime, Motion, and DepthEye MovementsCortical Mechanisms of Attention, Cognition, and Multimodal IntegrationInvertebrate VisionTheoretical PerspectivesMolecular and Developmental ProcessesTranslational Visual Neuroscience

Abstract: To guide future experiments aimed at understanding the mouse visual system, it is essential that we have a solid handle on the global topography of visual cortical areas. Ideally, the method used to measure cortical topography is objective, robust, and simple enough to guide subsequent targeting of visual areas in each subject. We developed an automated method that uses retinotopic maps of mouse visual cortex obtained with intrinsic signal imaging (Schuett et al., 2002; Kalatsky and Stryker, 2003; Marshel et al., 2011) and applies an algorithm to automatically identify cortical regions that satisfy a set of quantifiable criteria for what constitutes a visual area. This approach facilitated detailed parcellation of mouse visual cortex, delineating nine known areas (primary visual cortex, lateromedial area, anterolateral area, rostrolateral area, anteromedial area, posteromedial area, laterointermediate area, posterior area, and postrhinal area), and revealing two additional areas that have not been previously described as visuotopically mapped in mice (laterolateral anterior area and medial area). Using the topographic maps and defined area boundaries from each animal, we characterized several features of map organization, including variability in area position, area size, visual field coverage, and cortical magnification. We demonstrate that higher areas in mice often have representations that are incomplete or biased toward particular regions of visual space, suggestive of specializations for processing specific types of information about the environment. This work provides a comprehensive description of mouse visuotopic organization and describes essential tools for accurate functional localization of visual areas.

Abstract: Prestimulus oscillatory neural activity in the visual cortex has large consequences for perception and can be influenced by top-down control from higher-order brain regions. Making a causal claim about the mechanistic role of oscillatory activity requires that oscillations be directly manipulated independently of cognitive instructions. There are indications that a direct manipulation, or entrainment, of visual alpha activity is possible through visual stimulation. However, three important questions remain: (1) Can the entrained alpha activity be endogenously maintained in the absence of continuous stimulation?; (2) Does entrainment of alpha activity reflect a global or a local process?; and (3) Does the entrained alpha activity influence perception? To address these questions, we presented human subjects with rhythmic stimuli in one visual hemifield, and arhythmic stimuli in the other. After rhythmic entrainment, we found a periodic pattern in detection performance of near-threshold targets specific to the entrained hemifield. Using magnetoencephalograhy to measure ongoing brain activity, we observed strong alpha activity contralateral to the rhythmic stimulation outlasting the stimulation by several cycles. This entrained alpha activity was produced locally in early visual cortex, as revealed by source analysis. Importantly, stronger alpha entrainment predicted a stronger phasic modulation of detection performance in the entrained hemifield. These findings argue for a cortically focal entrainment of ongoing alpha oscillations by visual stimulation, with concomitant consequences for perception. Our results support the notion that oscillatory brain activity in the alpha band provides a causal mechanism for the temporal organization of visual perception.

Abstract: The “visual preference heuristic” suggests that consumers prefer visual to verbal depiction of information in a product assortment. Images produce greater perceptions of variety than text, which is appealing in assortment selection, but can result in choice complexity and overload when choice sets are large and preferences are unknown, suggesting a moderator for Iyengar and Lepper's results. Eye-tracking results reveal that the natural gestalt processing of individual visual stimuli, as compared to the piecemeal processing of individual textual stimuli, affects the processing of the assortment as a whole with visual (compared to verbal) presentation facilitating a faster, though more haphazard, scanning of the assortment. While the less systematic processing that results from visual presentation feels easier, it is not ideal for larger assortments resulting in higher complexity ratings and choice overload than with text depiction. These findings reveal that, like many heuristics, preference for visual depiction may be overapplied.

Abstract: Spelling is an important application of brain-computer interfaces (BCIs). Previous BCI spellers were not suited for widespread use due to their low information transfer rate (ITR). In this study, we constructed a high-ITR BCI speller based on the steady-state visual evoked potential (SSVEP). A 45-target BCI speller was implemented with a frequency resolution of 0.2 Hz. A sampled sinusoidal stimulation method was used to present visual stimuli on a conventional LCD screen. The online results revealed that the proposed BCI speller had a good performance, reaching a high average accuracy (84.1% for 2 s stimulation time; 90.2% for 3 s stimulation time) and the corresponding high ITR (105 bits/min for 2 s stimulation time, 82 bits/min for 3 s stimulation time) during the low-frequency stimuli, while 88.7% and 61 bits/min were achieved for a 4 s time window during the high-frequency stimuli.

Abstract: Here the authors report that repeated presentations of a visual sequence over a course of days causes evoked response potentiation in mouse V1 that is highly specific for stimulus order and timing. After V1 is trained to recognize a sequence, cortical activity regenerates the full sequence even when individual stimulus elements are omitted.

Abstract: A head camera was used to examine the visual correlates of object name learning by toddlers as they played with novel objects and as the parent spontaneously named those objects. The toddlers’ learning of the object names was tested after play, and the visual properties of the head camera images during naming events associated with learned and unlearned object names were analyzed. Naming events associated with learning had a clear visual signature, one in which the visual information itself was clean and visual competition among objects was minimized. Moreover, for learned object names, the visual advantage of the named target over competitors was sustained, both before and after the heard name. The findings are discussed in terms of the visual and cognitive processes that may depend on clean sensory input for learning and also on the sensory–motor, cognitive, and social processes that may create these optimal visual moments for learning.

Abstract: Saccadic eye movements cause substantial shifts in the retinal image as we take in visual scenes, but our perception is stable and continuous; here, visual receptive fields are shown to shift dramatically towards the saccadic goal, running counter to the long-standing hypothesis of receptive field remapping as the basis of perceived stability. As we take in a visual scene we make rapid eye movements — called saccades — that bring different parts of the scene to the fovea, the region of the retina with highest acuity. These eye movements cause substantial shifts in the retinal image, but our perception of the visual world is stable and continuous. Tirin Moore and colleagues find a possible mechanism for this stability in prefrontal neurons. They show that during preparation for eye movement, neurons shift their visual receptive fields (those regions of space that neurons are most responsive to) in order to massively over-represent behaviourally relevant areas, consistent with human visual perception. These findings run counter to a long-standing hypothesis — that receptive fields predictively remap, shifting the representation of visual space by neurons in the brain in anticipation of the outcome of each eye movement. We experience the visual world through a series of saccadic eye movements, each one shifting our gaze to bring objects of interest to the fovea for further processing. Although such movements lead to frequent and substantial displacements of the retinal image, these displacements go unnoticed. It is widely assumed that a primary mechanism underlying this apparent stability is an anticipatory shifting of visual receptive fields (RFs) from their presaccadic to their postsaccadic locations before movement onset1. Evidence of this predictive ‘remapping’ of RFs has been particularly apparent within brain structures involved in gaze control2,3,4. However, critically absent among that evidence are detailed measurements of visual RFs before movement onset. Here we show that during saccade preparation, rather than remap, RFs of neurons in a prefrontal gaze control area massively converge towards the saccadic target. We mapped the visual RFs of prefrontal neurons during stable fixation and immediately before the onset of eye movements, using multi-electrode recordings in monkeys. Following movements from an initial fixation point to a target, RFs remained stationary in retinocentric space. However, in the period immediately before movement onset, RFs shifted by as much as 18 degrees of visual angle, and converged towards the target location. This convergence resulted in a threefold increase in the proportion of RFs responding to stimuli near the target region. In addition, like in human observers5,6, the population of prefrontal neurons grossly mislocalized presaccadic stimuli as being closer to the target. Our results show that RF shifts do not predict the retinal displacements due to saccades, but instead reflect the overriding perception of target space during eye movements.

Abstract: Theories on visual perception agree that scenes are processed in terms of spatial frequencies. Low spatial frequencies (LSF) carry coarse information whereas high spatial frequencies (HSF) carry fine details of the scene. However, how and where spatial frequencies are processed within the brain remain unresolved questions. The present review addresses these issues and aims to identify the cerebral regions differentially involved in low and high spatial frequency processing, and to clarify their attributes during scene perception. Results from a number of behavioral and neuroimaging studies suggest that spatial frequency processing is lateralized in both hemispheres, with the right and left hemispheres predominantly involved in the categorization of LSF and HSF scenes, respectively. There is also evidence that spatial frequency processing is retinotopically mapped in the visual cortex. HSF scenes (as opposed to LSF) activate occipital areas in relation to foveal representations, while categorization of LSF scenes (as opposed to HSF) activates occipital areas in relation to more peripheral representations. Concomitantly, a number of studies have demonstrated that LSF information may reach high-order areas rapidly, allowing an initial coarse parsing of the visual scene, which could then be sent back through feedback into the occipito-temporal cortex to guide finer HSF-based analysis. Finally, the review addresses spatial frequency processing within scene-selective regions areas of the occipito-temporal cortex.

Abstract: Perception reflects an integration of “bottom-up” (sensory-driven) and “top-down” (internally generated) signals. Although models of visual processing often emphasize the central role of feed-forward hierarchical processing, less is known about the impact of top-down signals on complex visual representations. Here, we investigated whether and how the observer’s goals modulate object processing across the cortex. We examined responses elicited by a diverse set of objects under six distinct tasks, focusing on either physical (e.g., color) or conceptual properties (e.g., man-made). Critically, the same stimuli were presented in all tasks, allowing us to investigate how task impacts the neural representations of identical visual input. We found that task has an extensive and differential impact on object processing across the cortex. First, we found task-dependent representations in the ventral temporal and prefrontal cortex. In particular, although object identity could be decoded from the multivoxel response within task, there was a significant reduction in decoding across tasks. In contrast, the early visual cortex evidenced equivalent decoding within and across tasks, indicating task-independent representations. Second, task information was pervasive and present from the earliest stages of object processing. However, although the responses of the ventral temporal, prefrontal, and parietal cortex enabled decoding of both the type of task (physical/conceptual) and the specific task (e.g., color), the early visual cortex was not sensitive to type of task and could only be used to decode individual physical tasks. Thus, object processing is highly influenced by the behavioral goal of the observer, highlighting how top-down signals constrain and inform the formation of visual representations.

Abstract: Cerebral visual impairment (CVI) comprises visual malfunction due to retro-chiasmal visual and visual association pathway pathology This can be isolated or accompany anterior visual pathway dysfunction It is a major cause of low vision in children in the developed and developing world due to increasing survival in paediatric and neonatal care CVI can present in many combinations and degrees There are multiple causes and it is common in children with cerebral palsy CVI can be identified easily, if a structured approach to history-taking is employed This review describes the features of CVI and describes practical management strategies aimed at helping affected children A literature review was undertaken using 'Medline' and 'Pubmed' Search terms included cerebral visual impairment, cortical visual impairment, dorsal stream dysfunction and visual function in cerebral palsy

Abstract: Illusion, namely a mismatch between the objective and perceived properties of an object present in the environment, is a common feature of visual perception, both in normal and pathological conditions. This makes illusion a valuable tool with which to explore normal perception and its impairments. Although still debated, the hypothesis of a modified, and typically diminished, susceptibility to illusions in schizophrenia patients is supported by a growing number of studies. The current paper aimed to review how illusions have been used to explore and reveal the core features of visual perception in schizophrenia from a psychophysical, neurophysiological and functional point of view. We propose an integration of these findings into a common hierarchical Bayesian inference framework. The Bayesian formalism considers perception as the optimal combination between sensory evidence and prior knowledge, thereby highlighting the interweaving of perceptions and beliefs. Notably, it offers a holistic and convincing explanation for the perceptual changes observed in schizophrenia that might be ideally tested using illusory paradigms, as well as potential paths to explore neural mechanisms. Implications for psychopathology (in terms of positive symptoms, subjective experience or behavior disruptions) are critically discussed.

Abstract: Does our perceptual awareness consist of a continuous stream, or a discrete sequence of perceptual cycles, possibly associated with the rhythmic structure of brain activity? This has been a long-standing question in neuroscience. We review recent psychophysical and electrophysiological studies indicating that part of our visual awareness proceeds in approximately 7–13 Hz cycles rather than continuously. On the other hand, experimental attempts at applying similar tools to demonstrate the discreteness of auditory awareness have been largely unsuccessful. We argue and demonstrate experimentally that visual and auditory perception are not equally affected by temporal subsampling of their respective input streams: video sequences remain intelligible at sampling rates of two to three frames per second, whereas audio inputs lose their fine temporal structure, and thus all significance, below 20–30 samples per second. This does not mean, however, that our auditory perception must proceed continuously. Instead, we propose that audition could still involve perceptual cycles, but the periodic sampling should happen only after the stage of auditory feature extraction. In addition, although visual perceptual cycles can follow one another at a spontaneous pace largely independent of the visual input, auditory cycles may need to sample the input stream more flexibly, by adapting to the temporal structure of the auditory inputs.

Abstract: Vision not only provides us with detailed knowledge of the world beyond our bodies, but it also guides our actions with respect to objects and events in that world. The computations required for vision-for-perception are quite different from those required for vision-for-action. The former uses relational metrics and scene-based frames of reference while the latter uses absolute metrics and effector-based frames of reference. These competing demands on vision have shaped the organization of the visual pathways in the primate brain, particularly within the visual areas of the cerebral cortex. The ventral ‘perceptual’ stream, projecting from early visual areas to inferior temporal cortex, helps to construct the rich and detailed visual representations of the world that allow us to identify objects and events, attach meaning and significance to them and establish their causal relations. By contrast, the dorsal ‘action’ stream, projecting from early visual areas to the posterior parietal cortex, plays a critical role in the real-time control of action, transforming information about the location and disposition of goal objects into the coordinate frames of the effectors being used to perform the action. The idea of two visual systems in a single brain might seem initially counterintuitive. Our visual experience of the world is so compelling that it is hard to believe that some other quite independent visual signal—one that we are unaware of—is guiding our movements. But evidence from a broad range of studies from neuropsychology to neuroimaging has shown that the visual signals that give us our experience of objects and events in the world are not the same ones that control our actions.

Abstract: Several neurophysiologic and neuroimaging studies suggested that motor and perceptual systems are tightly linked along a continuum rather than providing segregated mechanisms supporting different functions. Using correlational approaches, these studies demonstrated that action observation activates not only visual but also motor brain regions. On the other hand, brain stimulation and brain lesion evidence allows tackling the critical question of whether our action representations are necessary to perceive and understand others’ actions. In particular, recent neuropsychological studies have shown that patients with temporal, parietal, and frontal lesions exhibit a number of possible deficits in the visual perception and the understanding of others’ actions. The specific anatomical substrates of such neuropsychological deficits however, are still a matter of debate. Here we review the existing literature on this issue and perform an anatomic likelihood estimation meta-analysis of studies using lesion-symptom mapping methods on the causal relation between brain lesions and non-linguistic action perception and understanding deficits. The meta-analysis encompassed data from 361 patients tested in 11 studies and identified regions in the inferior frontal cortex, the inferior parietal cortex and the middle/superior temporal cortex, whose damage is consistently associated with poor performance in action perception and understanding tasks across studies. Interestingly, these areas correspond to the three nodes of the action observation network that are strongly activated in response to visual action perception in neuroimaging research and that have been targeted in previous brain stimulation studies. Thus, brain lesion mapping research provides converging causal evidence that premotor, parietal and temporal regions play a crucial role in action recognition and understanding.

Abstract: Cognitive control allows stimulus-response processing to be aligned with internal goals and is thus central to intelligent, purposeful behavior. Control is thought to depend in part on the active representation of task information in prefrontal cortex (PFC), which provides a source of contextual bias on perception, decision making, and action. In the present study, we investigated the organization, influences, and consequences of context representation as human subjects performed a cued sorting task that required them to flexibly judge the relationship between pairs of multivalent stimuli. Using a connectivity-based parcellation of PFC and multivariate decoding analyses, we determined that context is specifically and transiently represented in a region spanning the inferior frontal sulcus during context-dependent decision making. We also found strong evidence that decision context is represented within the intraparietal sulcus, an area previously shown to be functionally networked with the inferior frontal sulcus at rest and during task performance. Rule-guided allocation of attention to different stimulus dimensions produced discriminable patterns of activation in visual cortex, providing a signature of top-down bias over perception. Furthermore, demands on cognitive control arising from the task structure modulated context representation, which was found to be strongest after a shift in task rules. When context representation in frontoparietal areas increased in strength, as measured by the discriminability of high-dimensional activation patterns, the bias on attended stimulus features was enhanced. These results provide novel evidence that illuminates the mechanisms by which humans flexibly guide behavior in complex environments.