In this paper we offer a theory of cross-modal objects. To begin, we discuss two kinds of linkages between vision and audition. The first is a duality. The the visual system detects and identifies surfaces ; the auditory system detects and identifies sources . Surfaces are illuminated by sources of light; sound is reflected off surfaces. However, the visual system discounts sources and the auditory system discounts surfaces. These and similar considerations lead to the Theory of Indispensable (...) Attributes that states the conditions for the formation of gestalts in the two modalities. The second linkage involves the formation of audiovisual objects, integrated cross-modal experiences. We describe research that reveals the role of cross-modal causality in the formation of such objects. These experiments use the canonical example of a causal link between vision and audition: a visible impact that causes a percussive sound. (shrink)

While it is widely accepted that human vision represents objects, it is less clear which of the various philosophical notions of ‘object’ adequately characterizes visual objects. In this paper, I show that within contemporary cognitive psychology visual objects are characterized in two distinct, incompatible ways. On the one hand, models of visual organization describe visual objects in terms of combinations of features, in accordance with the philosophical bundle theories of objects. However, (...) models of visual persistence apply a notion of visual objects that is more similar to that endorsed in philosophical substratum theories. Here I discuss arguments that might show either that only one of the above notions of visual objects is adequate in the context of human vision, or that the category of visual objects is not uniform and contains entities properly characterized by different philosophical conceptions. (shrink)

One of the main functions of visual system is to construct representations of objects. These ‘visual objects’ are formed by developing the structure of more primitive visual representations. In the course of the article, I define the notions of ‘minimal visual object’, ‘maximal-non object representation’, and ‘constructing characteristic’ that differentiates minimal objects from maximal non-objects. Relying on these distinctions, I consider the type of ontological change that transforms visual regions, treated as (...) maximal non-object representations, into basic, low-level visual objects. In order to identify such a change, theories of early vision, models of figure/ground distinction, and analytic, ontological notions of objects’ structure are discussed. Finally, a thesis is stated that external relations constitute the main structural factor that determines the ontological transition between non-object representations and visual objects. (shrink)

The notion that visual attention can operate over visual objects in addition to spatial locations has recently received much empirical support, but there has been relatively little empirical consideration of what can count as an `object' in the ®rst place. We have investi- gated this question in the context of the multiple object tracking paradigm, in which subjects must track a number of independently and unpredictably moving identical items in a ®eld of identical distractors. What types of (...) feature clusters can be tracked in this manner? In other words, what counts as an `object' in this task? We investigated this question with a technique we call target merging: we alter tracking displays so that distinct target and distractor loca- tions appear perceptually to be parts of the same object by merging pairs of items (one target with one distractor) in various ways ± for example, by connecting item locations with a simple line segment, by drawing the convex hull of the two items, and so forth. The data show that target merging makes the tracking task far more dif®cult to varying degrees depending on exactly how the items are merged. The effect is perceptually salient, involving in some conditions a total destruction of subjects' capacity to track multiple items. These studies provide strong evidence for the object-based nature of tracking, con®rming that in some contexts attention must be allocated to objects rather than arbitrary collections of features. In addition, the results begin to reveal the types of spatially organized scene components that can be independently attended as a function of properties such as connectedness, part struc- ture, and other types of perceptual grouping. q 2001 Elsevier Science B.V. All rights reserved. (shrink)

Ordinary human perceivers know that visual objects are perceivable from standpoints other than their own. The aim of this paper is to provide an explanation of how perceptual experience equips perceivers with this knowledge. I approach the task by discussing a variety of action-based theories of perception. Some of these theories maintain that standpoint transcendence is required for shape perception. I argue that this standpoint transcendence must take place in the phenomenal present and that it can be explained (...) in terms of the experience of perceivers who jointly attend to an object. Joint perceivers experience objects as being perceived from standpoints other than their own. They operate in what I call “social space”, in which they single out objects by triangulating targets’ locations relative to their co-perceivers’ standpoints on these targets. It is then possible to explain the public character of the objects of individual experience by appeal to what I call “public space”. This is a spatial framework whose locations are presented as standpoints whence joint attention to the target would ensue, were they occupied by co-perceivers. If shape perception requires standpoint transcendence, then shape perceivers operate in public space and are thus capable of singling out targets by triangulating their locations from standpoints other than their own. If it doesn’t, then the introduction of a public spatial framework is an additional step whose introduction explains how perceivers come to experience objects as perceivable from standpoints other than their own. (shrink)

According to the traditional view, visual objects can be characterized as bundles of features and locations. This initially plausible idea is contested within the contemporary psychology and philosophy of perception, where it is claimed that the visual system can represent objects as merely ‘this’ or ‘that’, in abstraction from their qualities. In this paper, I consider whether philosophical and psychological arguments connected with the rejection of the ‘bundle’ view of visual objects show that it (...) is needed to postulate an additional, purely individualizing characteristic, known in the philosophical tradition as ‘thisness’, within the structure of visual objects. I argue that the phenomenon of asymmetry of errors observed in Multiple Object Tracking experiments strongly suggests that reference to ‘thisness’ is needed if we are to formulate a proper diachronic identity criterion of visual objects. (shrink)

The papers by Macpherson, O'Callaghan, and Batty reveal some startling differences in the objects and properties represented by different modalities. They also reveal some tensions between different ways of understanding what it is for any one modality to represent objects and properties.

Notions of objecthood have traditionally been cast in visuocentric terminology. As a result, theories of auditory and cross-modal perception have focused more on the differences between modalities than on the similarities. In this paper we re-examine the concept of an object in a way that overcomes the limitations of the traditional perspective. We propose a new, cross-modal conception of objecthood which focuses on the similarities between modalities instead of the differences. Further, we propose that the auditory system might consist of (...) two parallel streams of processing (the `what' and `where' subsystems) in a manner analogous to current conceptions of the visual system. We suggest that the `what' subsystems in each modality are concerned with objecthood. Finally, we present evidence for—and elaborate on—the hypothesis that the auditory `where' subsystem is in the service of the visual-motor `where' subsystem. (shrink)

The thesis that the visual system represents objects has garnered empirical support from a variety of sources in recent decades. But what kinds of things qualify as “objects” in the relevant sense? Are they ordinary three-dimensional bodies? Are they the facing surfaces of three-dimensional bodies? I argue that there is no fact of the matter: what we have are equally acceptable ways of assigning extensions to the relevant visual states. The view I defend bears obvious similarities (...) to Quine’s thesis that linguistic reference is inscrutable. Importantly, though, I argue that even if Quine was wrong about inscrutability as a thesis about language and thought, the case for the inscrutability of visual reference remains strong. (shrink)

The target and background will change continuously in the long-term tracking process, which brings great challenges to the accurate prediction of targets. The correlation filter algorithm based on manual features is difficult to meet the actual needs due to its limited feature representation ability. Thus, to improve the tracking performance and robustness, an improved hierarchical convolutional features model is proposed into a correlation filter framework for visual object tracking. First, the objective function is designed by lasso regression modeling, and (...) a sparse, time-series low-rank filter is learned to increase the interpretability of the model. Second, the features of the last layer and the second pool layer of the convolutional neural network are extracted to realize the target position prediction from coarse to fine. In addition, using the filters learned from the first frame and the current frame to calculate the response maps, respectively, the target position is obtained by finding the maximum response value in the response map. The filter model is updated only when these two maximum responses meet the threshold condition. The proposed tracker is evaluated by simulation analysis on TC-128/OTB2015 benchmarks including more than 100 video sequences. Extensive experiments demonstrate that the proposed tracker achieves competitive performance against state-of-the-art trackers. The distance precision rate and overlap success rate of the proposed algorithm on OTB2015 are 0.829 and 0.695, respectively. The proposed algorithm effectively solves the long-term object tracking problem in complex scenes. (shrink)

: One can understand the word “object” as a concrete physical object or as that which is on the receiving end of a subject-object relation, namely, that entity which a particular cognitive state or process is “of.” These latter objects are determined by the way our sensory systems exploit the ways elements of the world impinge upon our bodily surfaces. Our visual system exploits light reflected off the surfaces of objects; therefore, the objects of our (...) class='Hi'>visual experiences can be physical objects just sitting still. Our auditory system, on the other hand, exploits sound waves caused by impacts of one sort or another, and these are events. You don’t, strictly speaking, hear a billiard ball or a car: You hear a billiard ball hit another one, or a car drive past. (shrink)

We introduce a new version of the perceptual retouch model. This model was used for explaining properties of temporal interaction of successive objects in reaching conscious representation. The new model incorporates two interactive binding operations – binding features for objects and binding the bound feature-objects with a large scale oscillatory system that corresponds to perceptual consciousness. Here, the typical result of masking experiments – second object advantage in conscious perception – is achieved by applying the effects of (...) a common synchronizing oscillator with a delay. This delayed modulation of each of the feature-binding first-order oscillators that represent emerging and decaying neural activities of each of the objects guarantees that the oscillating synchrony of the feature-neurons of the following object is higher than the synchrony of the feature-neurons of the first presented object. Thus we model the fact that the following object dominates the preceding object in conscious perception. We also show the capacity of the model to simulate illusory misbinding of features from different objects. The third qualitative effect, the relative release of the first object from backward masking is achieved by priming the non-specific oscillatory modulation ahead in time. (shrink)

Visual Agnosia is a comprehensive and up-to-date review of disorders of higher vision that relates these disorders to current conceptions of higher vision from cognitive science, illuminating both the neuropsychological disorders and the nature of normal visual object recognition.Brain damage can lead to selective problems with visual perception, including visual agnosia the inability to recognize objects even though elementary visual functions remain unimpaired. Such disorders are relatively rare, yet they provide a window onto how (...) the normal brain might accomplish the complex task of vision. Visual Agnosia reviews a century of case studies of higher-level visual deficits following brain damage, places them in the general context of current neuroscience, and draws relevant conclusions about the organization of normal visual processing. It is unique in drawing on research in cognitive psychology, computational vision, visual neurophysiology, and neuropsychology to interpret the agnosias and draw inferences from them about visual object recognition.Following a historical account of agnosia research, Visual Agnosia offers a taxonomy of a wide range of agnosia syndromes, describing and interpreting the syndromes in terms of the latest theoretical models of visual processing and ultimately bringing them to bear as evidence on a variety of questions in the study of higher vision.Martha J. Farah is Associate Professor of Psychology at Carnegie Mellon University. Visual Agnosia is included in the Issues in Biology of Language and Cognition series, edited by John Marshall. (shrink)

Recognizing the potential hidden artistic contributions of persons with dementia opens new opportunities for interpretation and potential communication. This visual essay explores the authors’ responses to the fragile objects of art produced by a person with severe dementia and examines what may be learned from them.

In an essay published in 1918, Walter Benjamin sets forth a task that will concern him for the rest of his life: The task of a future epistemology is to find for knowledge the sphere of total neutr...