Abstract: There is considerable evidence that visual attention is concentrated at a single locus in the visual field, and that this locus can be moved independent of eye movements. Two studies are reported which suggest that, while certain aspects of attention require that locations be scanned serially, at least one operation may be carried out in parallel across several independent loci in the visual field. That is the operation of indexing features and tracking their identity. The studies show that: (a) subjects are able to track a subset of up to 5 objects in a field of 10 identical randomly-moving objects in order to distinguish a change in a target from a change in a distractor; and (b) when the speed and distance parameters of the display are designed so that, on the basis of some very conservative assumptions about the speed of attention movement and encoding times, the predicted performance of a serial scanning and updating algorithm would not exceed about 40% accuracy, subjects still manage to do the task with 87% accuracy. These findings are discussed in relation to an earlier, and independently motivated model of feature-binding--called the FINST model--which posits a primitive identity maintenance mechanism that indexes and tracks a limited number of visual objects in parallel. These indexes are hypothesized to serve the function of binding visual features prior to subsequent pattern recognition.

Abstract: (1988). Features and objects: The fourteenth bartlett memorial lecture. The Quarterly Journal of Experimental Psychology Section A: Vol. 40, No. 2, pp. 201-237.

Abstract: Physiological experiments indicate that the middle temporal visual area (MT) of primates plays a prominent role in the cortical analysis of visual motion. We investigated the role of MT in visual perception by examining the effect of chemical lesions of MT on psychophysical thresholds. We trained rhesus monkeys on psychophysical tasks that enabled us to assess their sensitivity to motion and to contrast. For motion psychophysics, we employed a dynamic random dot display that permitted us to vary the intensity of a motion signal in the midst of masking motion noise. We measured the threshold intensity for which the monkey could successfully complete a direction discrimination. In the contrast task, we measured the threshold contrast for which the monkeys could successfully discriminate the orientation of stationary gratings. Injections of ibotenic acid into MT caused striking elevations in motion thresholds, but had little or no effect on contrast thresholds. The results indicate that neural activity in MT contributes selectively to the perception of motion.

Abstract: Detection of change when one display of familiar objects replaces another display might be based purely upon visual codes, or also on identity information (i.e., knowingwhat was presentwhere in the initial display). Displays of 10 alphanumeric characters were presented and, after a brief offset, were presented again in the same position, with or without a change in a single character. Subjects’ accuracy in change detection did not suggest preservation of any more information than is usually available in whole report, except with the briefest of offsets (under 50 msec). Stimulus duration had only modest effects. The interaction of masking with offset duration followed the pattern previously observed with unfamiliar visual stimuli (Phillips, 1974). Accuracy was not reduced by reflection of the characters about a horizontal axis, suggesting that categorical information contributed negligibly. Detection of change appears to depend upon capacity-limited visual memory; (putative) knowledge of what identities are present in different display locations does not seem to contribute.

Abstract: In human long-term memory, ideas and concepts become associated in the learning process. No neuronal correlate for this cognitive function has so far been described, except that memory traces are thought to be localized in the cerebral cortex; the temporal lobe has been assigned as the site for visual experience because electric stimulation of this area results in imagery recall and lesions produce deficits in visual recognition of objects. We previously reported that in the anterior ventral temporal cortex of monkeys, individual neurons have a sustained activity that is highly selective for a few of the 100 coloured fractal patterns used in a visual working-memory task. Here I report the development of this selectivity through repeated trials involving the working memory. The few patterns for which a neuron was conjointly selective were frequently related to each other through stimulus-stimulus association imposed during training. The results indicate that the selectivity acquired by these cells represents a neuronal correlate of the associative long-term memory of pictures.

Abstract: Does visual imagery engage some of the same representations used in visual perception? The evidence collected by cognitive psychologists in support of this claim has been challenged by three types of alternative explanation: Tacit knowledge, according to which subjects use nonvisual representations to simulate the use of visual representations during imagery tasks, guided by their tacit knowledge of their visual systems; experimenter expectancy, according to which the data implicating shared representations for imagery and perception is an artifact of experimenter expectancies; and nonvisual spatial representation, according to which imagery representations are partially similar to visual representations in the way they code spatial relations but are not visual representations. This article reviews previously overlooked neuropsychological evidence on the relation between imagery and perception, and discusses its relative immunity to the foregoing alternative explanations. This evidence includes electrophysiological and cerebral blood flow studies localizing brain activity during imagery to cortical visual areas, and parallels between the selective effects of brain damage on visual perception and imagery. Because these findings cannot be accounted for in the same way as traditional cognitive data using the alternative explanations listed earlier, they can play a decisive role in answering the title question.

Abstract: • Investigators have long suggested that schizophrenia might be related to an impairment in the regulation of attention. In this report, the performance of schizophrenic patients was compared with nonschizophrenic control subjects in their ability to direct visual attention. In the first experiment, patients were distinguished from controls by a slower response to a target in the right visual field than to a target in the left visual field when attention was not first directed to the target location. In the second experiment, patients were distinguished from controls by a stronger bias in favor of symbolic information over language information about spatial direction. In both experiments, the patients demonstrated deficits in attention similar to patients from previous studies who had unilateral lesions of the left hemisphere. The identification of performance abnormalities using tasks that are simple, have dissectable cognitive components, have been related to discrete neural systems, and control for nonspecific variables provide the basis for constructing reasonable hypotheses about the cognitive psychology and functional neuroanatomy of schizophrenia.

Abstract: Our visual experience of the world is based on two-dimensional images: nat patterns of varying light intensity and color faIling on a single plane of cells in the retina. Yet we come to perceive solidity and depth. We can do this because a number of cues about depth are available in the retinal image: shading, perspective, occlusion of one object by another and stereoscopic disparity. In some mysterious way the brain is able to exploit these cues to recover the three-dimensional shapes of objects. Of the many mechanisms employed by the visual system to recover the third dimension, the ability to exploit shading is probably the most primitive. One reason for believing this is that in the natural world many animals have evolved pale undersides, presumably to make themselves less visible to predators. \"Countershading\" compensates for the shading effects caused by the sun shining from above and has at least two benefits: it reduces the contrast with the background and it \"flattens\" the animal's perceived shape. The prevalence of countershading in a variety of species, including many fishes, suggests that shading may be a crucial source of information about three-dimensional shape. Painters, of course, have long ex-

Abstract: Human subjects and non-human primates (the common marmoset) were trained on a series of reversals of both a simple (stimuli varying along one dimension) and compound (stimuli varying along two different dimensions) visual discrimination, using computer-generated stimuli. They were then shifted to a third series of reversals using completely novel compound stimuli. Those humans and marmosets for which the previously relevant dimension remained relevant, following the shift (shapes to shapes or lines to lines; intradimensional shift) made fewer errors than those for which the previously irrelevant dimension became relevant (shapes to lines or lines to shapes; extradimensional shift). These findings suggest that both humans and marmosets can learn to attend to the specific attributes or dimensions of a stimulus and use this information in visual discrimination learning.

Abstract: A category-specific semantic disorder, selectively affecting Living things and food and sparing inanimate objects, was observed in a patient (LA) who had made a partial recovery from herpes simplex encephalitis. This impairment was observed to have similar characteristics both with verbal and pictorial material, and a significant degree of consistency was observed between repeated presentations and across various modalities of administration of the same stimuli. In order to study the possible role of interactions between verbal-semantic and visual-semantic impairment, we constructed a test of “naming animals by definitions”, in which two sorts of definitions were contrasted: (1) those stressing visual perceptual features; and (2) those using verbal metaphorical expressions, or a description of the function accomplished by that animal for man, to allow identification. LA performed much better in the second than in the first condition. On the grounds of these results, the following hypotheses were ...

Abstract: The relevance of codes and modalities in a multiple-resource model to the prediction of task interference was investigated in an experiment in which either verbal or spatial decision tasks, responded to with either voice or key press, were time-shared with second-order tracking. Results indicate the importance of the dichotomy between verbal and spatial processing codes in accounting for task interference. Interference with tracking was consistently greater, and difficulty/performance trade-offs were stronger, when the spatial decision task was performed and the manual response was used. A review of the literature on the interference between a continuous visual task and a discrete task whose modality is either auditory or visual suggests that scanning produces a dominant cost to intramodal configurations when visual channels are separated in space. In absence of visual separation, the differences between cross-modal and intramodal performance may be best accounted for by a mechanism of preemption.

Abstract: Lesion to the posterior parietal cortex in monkeys and humans produces spatial deficits in movement and perception. In recording experiments from area 7a, a cortical subdivision in the posterior parietal cortex in monkeys, we have found neurons whose responses are a function of both the retinal location of visual stimuli and the position of the eyes in the orbits. By combining these signals area 7 a neurons code the location of visual stimuli with respect to the head. However, these cells respond over only limited ranges of eye positions (eye-position-dependent coding). To code location in craniotopic space at all eye positions (eye-position-independent coding) an additional step in neural processing is required that uses information distributed across populations of area 7a neurons. We describe here a neural network model, based on back-propagation learning, that both demonstrates how spatial location could be derived from the population response of area 7a neurons and accurately accounts for the observed response properties of these neurons.

Abstract: Previous studies on the visual origin of time-to-collision (Tc) information have demonstrated that Tc estimates can be based solely on the processing of target expansion rate (optic variable tau). But in the simulated situations used (film clips), there was little reliable information on speed (owing to reduced peripheral vision) and distance (owing to the absence of binocular distance cues) available. In order to determine whether these kinds of information are also taken into account, it is necessary to take an approach where the subject receives a more complete visual input. Thus, an experiment conducted on a circuit under actual driving conditions is reported. Experienced drivers and beginners, who were passengers in a car, had to indicate the moment they expected a collision with a stationary obstacle to take place. Subjects were blindfolded after a viewing time of 3 s. The conditions for speed evaluation (normal versus restricted visual field) and distance evaluation (binocular versus monocular vision) by subjects were varied. The approach speed (30 and 90 km h-1) and actual Tc (3 and 6 s) were also varied. The results show that accuracy of Tc estimation increased with (i) normal visual field, (ii) binocular vision, (iii) higher speeds, and (iv) driving experience. These findings have been interpreted as indicating that both speed and distance information are taken into account in Tc estimation. They suggest furthermore that these two kinds of information may be used differently depending on the skill level of the subject. The results are discussed in terms of the complementarity of the various potentially usable visual means of obtaining Tc information.

Abstract: Two studies, with undergraduate subjects, investigated how sex and situation-specific power factors relate to visual behavior in mixed-sex interactions. The power variable in Study 1 was expert power, based on differential knowledge. Mixed-sex dyads were formed such that members had complementary areas of expertise. In Study 2, reward power was manipulated. Consistent with expectation states theory, both men and women high in expertise or reward power displayed high visual dominance, defined as the ratio of looking while speaking to looking while listening. Specifically, men and women high in expertise or reward power exhibited equivalent levels of looking while speaking and looking while listening. High visual dominance ratios have been associated with high social power in previous research. Both men and women low in expertise or reward power looked more while listening than while speaking, producing a relatively low visual dominance ratio. In conditions in which men and women did not possess differential expertise or reward power, visual behavior was related to sex. Men displayed visual behavior similar to their patterns in the high expertise and high reward power conditions, whereas women exhibited visual behavior similar to their patterns in the low expertise and low reward power conditions. The results demonstrate how social expectations are reflected in nonverbal power displays.

Abstract: Based on a review of numerous studies conducted on normal, neurosurgical and brain-injured individuals, the right cerebral hemisphere appears to be dominant in the perception and identification of environmental and nonverbal sounds; the analysis of geometric and visual space (e.g., depth perception, visual closure); somesthesis, stereognosis, the maintenance of the body image; the production of dreams during REM sleep; the perception of most aspects of musical stimuli; and the comprehension and expression of prosodic, melodic, visual, facial, and verbal emotion. When the right hemisphere is damaged a variety of cognitive abnormalities may result, including hemi-inattention and neglect, prosopagnosia, constructional apraxia, visual-perceptual disturbances, and agnosia for environmental, musical, and emotional sounds. Similarly, a myriad of affective abnormalities may occur, including indifference, depression, hysteria, gross social-emotional disinhibition, florid manic excitement, childishness, euphoria, impulsivity, and abnormal sexual behavior. Patients may become delusional, engage in the production of bizzare confabulations and experience a host of somatic disturbances such as pain and body-perceptual distortions. Based on studies of normal and "split-brain" functioning, it also appears that the right hemisphere maintains a highly developed social-emotional mental system and can independently perceive, recall and act on certain memories and experiences without the aid or active reflective participation of the left. This leads to situations in which the right and left halves of the brain sometime act in an uncooperative fashion, which gives rise to inter-manual and intra-psychic conflicts.

Abstract: The verve of op art, the serenity of a pointillist painting and the 3-D puzzlement of an Escher print derive from the interplay of the art with the anatomy of the visual system. Color, shape and movement are each processed separately by different structures in the eye and brain and then are combined to produce the experience we call perception.

Abstract: This paper demonstrates how serious consideration of the deep complexity issues inherent in the design of a visual system can constrain the development of a theory of vision. We first show how the seemingly intractable problem of visual perception can be converted into a much simpler problem by the application of several physical and biological constraints. For this transformation, two guiding principles are used that are claimed to be critical in the development of any theory of perception. The first is that analysis at the ‘complexity level’ is necessary to ensure that the basic space and performance constraints observed in human vision are satisfied by a proposed system architecture. Second, the ‘maximum power/minimum cost principle’ ranks the many architectures that satisfy the complexity level and allows the choice of the best one. The best architecture chosen using this principle is completely compatible with the known architecture of the human visual system, and in addition, leads to several predictions. The analysis provides an argument for the computational necessity of attentive visual processes by exposing the computational limits of bottom-up early vision schemes. Further, this argues strongly for the validity of the computational approach to modeling the human visual system. Finally, a new explanation for the pop-out phenomenon so readily observed in visual search experiments, is proposed.

Abstract: : The first year of the grant was spent in setting up the laboratory, and in starting research on a number of different projects. All are concerned with the visual processing of information in the perception of objects. A series of experiments has explored the perception of conjunctions of features, attempting to determine what makes this difficult or easy. A new method (detection of apparent motion) was tested and a modification of feature-integration theory was developed to accommodate the new results. Other projects have been concerned with coding of features, finding evidence for modularity, testing the level of abstraction at which features (such as orientation) are coded, the different media which support the coding of shape, and the space in which they are represented (retinal or three-dimensional). Another project has probed the effects of perceptual learning with extended practice at detecting particular sets of targets; the results suggest that automatization in search is highly specific to the practiced task and has little effect on other perceptual tests. Six graduate students are at present, working on projects wholly or partly supported by the grant.

Abstract: Results of recent studies comparing the spelling errors of children with varying discrepancies between their reading and spelling skills have yielded conflicting results. Some studies suggest that good readers-poor spellers (mixed) are characterized by a set of deficits that differentiates them from poor readers-poor spellers (poor). Other studies fail to find differences between groups of poor spellers who differ in their reading skills. The present study attempted to determine the degree to which these discrepant results reflected differences in methods of subject selection and of error analysis. Two different sets of criteria were used to identify poor spellers-good readers. Subjects were selected on the basis of standardized reading comprehension and spelling test scores or on the basis of standardized single-word-recognition and spelling-test scores. The phonetic accuracy of the spelling errors was assessed using two different scoring systems – one that took positional constraints into account and one that did not. In addition, children were identified at two different age levels, allowing for developmental comparisons. Regardless of age or reading ability, poor and mixed spellers had difficulty converting sounds into positionally appropriate graphemes. Only older children with good word recognition but poor spelling skills provided some evidence for a distinct subgroup of poor spellers. These children had relatively good visual memory for words and, unlike other poor spellers, showed relatively good use of rudimentary sound-letter correspondences.

Abstract: Research on totally blind subjects performing tasks that involve visual imagery has often shown that they do not behave differently from matched sighted subjects, even when their blindness is congenital. If visual imagery is based on visual perception, such tasks may not required visual imagery. In the present article visual images are considered as representations maintaining some properties of visible objects and constructed on the basis of information from various sources. Owing to the absence of visual experience, the limitations of such representations are explored in a series of experiments requiring memorization of single nouns, pairs of nouns, or triplets of nouns associated with a cue noun. Recall by blind subjects was impaired when multiple interactive images (with noun pairs and triplets) are formed. The poorer recall of blind subjects reflected also loss of order information. Recall was better for both groups with locative noun cues and high-imagery targets.

Abstract: The activity of neurons in the dorsolateral pontine nucleus (dlpn) was studied in two awake rhesus monkeys trained to participate in a variety of visual and oculomotor tests. The visual and eye movement related responses of 73 neurons encountered in the more caudal part of the dlpn were analyzed. Thirty eight of these could be assigned to one of the three following groups. Visual-only neurons (Type 1, n = 10) responded to movement of a broad range of visual stimuli in certain preferred directions. Their receptive fields were usually large, not restricted to the contralateral visual field and always included the fovea. Visual-tracking (VT) neurons (n = 28) discharged in relation to smooth pursuit of a small target in particular preferred directions. Nine of these (Type 2) did not respond to visual stimulation during stationary fixation. Nineteen VT-cells (Type 3) discharged in relation to both visual tracking and visual stimulation. In 9 of the Type 3 neurons, the preferred directions for visual stimulation and tracking were opposite, whereas they were the same in the other 10. Visual responses of Type 3 neurons were indistinguishable from those of Type 1 neurons. Testing of an additional 9 neurons driven by either visual-tracking or pattern movement was not sufficient to allow a definite assignment to one of the groups 1, 2 or 3. The distribution of preferred directions for both visual stimulation and visual tracking was widely scattered between 0 and 360 deg. Our results suggest that the dlpn is a constituent in a cerebro-cerebellar loop important for the generation of smooth pursuit eye movements.

Abstract: Induced movement, illusory movement in a stationary stimulus resulting from adjoining movement, has received steady experimental investigation over the last 70 years or so. It is observed under different viewing conditions in a wide variety of displays that differ considerably in overall size and in form of inducing and induced stimuli. Explanations have been diverse, some being based on relations within the display and others invoking mediation by other aspects of the observer's perception. Probably, no one explanation can account for all forms of induced movement. Current knowledge about induced movement may have important implications for visual perception of object morion.

Abstract: Iconic memory, which was initially regarded as a unitary phenomenon, has since been subdivided into several components. In the present work we examined the joint effects of two such components (visible persistence and the visual analog representation) on performance in a partial report task. The display consisted of 15 alphabetic characters arranged around the perimeter of an imaginary circle on the face of an oscilloscope. The observer named the character singled out by a bar-probe. Two factors were varied: exposure duration of the array (10, 50, 100, 150, 200, 300, 400 or 500 ms) and duration of blank period (interstimulus interval, ISI) between the termination of the array and the onset of the probe (0, 50, 100, 150, or 200 ms). Performance was progressively impaired as both exposure duration and ISI were increased. The results were explained in terms of a probabilistic combinatorial model in which the timecourses of visible persistence and of the visual analog representation are regarded as time-locked to the onset and to the end of stimulation, respectively. The impairing effect of exposure duration was attributed to the relatively high spatial demands of the task that could be met optimally by information in visible persistence (which declines as a function of exposure duration), but less adequately by information in the visual analog representation. A second experiment, employing a task with lesser spatial demands, confirmed this interpretation.