Cross-modal perceptual illusions occur when a stimulus to one modality impacts perceptual experience associated with another modality. Unlike synaesthesia, cross-modal illusions are intelligible as results of perceptual strategies for dealing with sensory stimulation to multiple modalities, rather than as mere quirks. I argue that understanding cross-modal illusions reveals an important flaw in a widespread conception of the senses, and of their role in perceptual experience, according to which understanding perception and perceptual experience is (...) a matter of assembling independently viable stories about vision, audition, olfaction, and the rest. (shrink)

We investigate the dynamics of sensory integration for perceiving musical performance, a complex natural behavior. Thirty musically trained participants saw, heard, or both saw and heard, performances by two clarinetists. All participants used a sliding potentiometer to make continuous judgments of tension (a measure correlated with emotional response) and continuous judgments of phrasing (a measure correlated with perceived musical structure) as performances were presented. The data analysis sought to reveal relations between the sensory modalities (vision and audition) and to quantify (...) the effect of seeing the performances on participants' overall subjective experience of the music. In addition to traditional statistics, functional data analysis techniques were employed to analyze time-varying aspects of the data. The auditory and visual channels were found to convey similar experiences of phrasing but different experiences of tension through much of the performances. We found that visual information served both to augment and to reduce the experience of tension at different points in the musical piece (as revealed by functional linear modeling and functional significance testing). In addition, the musicians' movements served to extend the sense of phrasing, to cue the beginning of new phrases, to indicate musical interpretation, and to anticipate changes in emotional content. Evidence for an interaction effect suggests that there may exist an emergent quality when musical performances are both seen and heard. The investigation augments knowledge of human communicative processes spanning language and music, and involving multiple modalities of emotion and information transfer. (shrink)

Objective: Evidence suggests people experience an oral size illusion and commonly perceive oral size inaccurately; however, the nature of the illusion remains unclear. The objectives of the present study were to confirm the presence of an oral size illusion, determine the magnitude (amount) and direction (underestimation or overestimation) of the illusion, and determine whether immediately prior crossmodal perceptual experiences affected the magnitude and direction. Design: Participants (N = 27) orally assessed 9 sizes of stainless steel spheres (1/16 in to 1/2 (...) in) categorized as small, medium, or big, and matched them with digital and visual reference sets. Each participant completed 20 matching tasks in 3 assessments. For control assessments, 6 oral spheres were matched with reference sets of same-sized spheres. For primer-control assessments, similar to control, 6 matching tasks were preceded by cross-modal experiences of the same-sized sphere. For experimental assessments, 8 matching tasks were preceded by a cross-modal experience of a differently sized sphere. Results: For control assessments, small and medium spheres were consistently underestimated, and big spheres were consistently overestimated. For experimental assessments, magnitude and direction of the oral size illusion varied according to the size of the sphere used in the cross-modal experience. Conclusion: Results seemed to confirm an oral size illusion, but direction of the illusion depended on the size of the object. Immediately prior cross-modal experiences influenced magnitude and direction of the illusion, suggesting that aspects of oral perceptual experience are dependent upon factors outside of oral perceptual anatomy and the properties of the oral stimulus. (shrink)

The thesis of this paper is that the capacity to think of one’s perceptions as cross-modally integrated is incompatible with a reductionist account of the self. In §2 I distinguish three versions of the argument from cross-modality. According to the ‘unification’ version of the argument, what needs to be explained is one’s capacity to identify an object touched as the same as an object simultaneously seen. According to the ‘recognition’ version, what needs to be explained is one’s capacity, (...) having once seen an object, to reidentify that same object by touch alone. According to the ‘objectivity’ version, what needs to be explained is one’s capacity to think of one’s perceptions in different modalities as perceptions of one and the same object. The third version seems to establish that one must conceive of oneself substantially, as the numerically identical owner of one’s experiences, a conclusion in agreement with recent work in developmental psychology claiming to show that an infant’s cross-modal capacities are essentially implicated in their development of a sense of self. There is further work to be done if this is to be tumed into an argument against reductionism: there is no swift route from the epistemology of self-consciousness to the metaphysics of the self. In the §3, I will claim that there is, nevertheless, an argument linking the two. What I propose is an argument derived, not from the token-reflexive rule for the first-person, but resting on its anaphoric behaviour spanning intensional operators. (shrink)

This paper provides a categorization of cross-modal experiences. There are myriad forms. Doing so allows us to think clearly about the nature of different cross-modal experiences and allows us to clearly formulate competing hypotheses about the kind of experiences involved in different cross-modal phenomena.

It’s been more than three hundred years since William Molyneux posed his now-famous question to John Locke. While it’s clear that Locke agrees with Molyneux that someone born blind and made to see would be unable to recognize at first sight the objects he knew previously only by touch (cross-modal recognition), why Locke thinks this is difficult to understand given Locke’s apparent reluctance to engage much with Molyneux’s question. I argue here that due to the lack of clear (...) textual support, and because previous attempts to account for Locke’s negative answer fail to recognize just how little justification Locke provides, motivate the need for a new approach to explain Locke’s answer to Molyneux’s question. My new approach is to consider what successful Lockean cross-modal recognition might look like given his “Architecture of Ideas,” the work of his Essay to account for mental content, from simple sensory ideas to knowledge. This allows us to identify which ideas and mental faculties he might likely consider essential for success at Molyneux’s task, and which, if lacking, explain the newly sighted man’s failure. Furthermore, this approach yields some surprising results: there is more than one reason the newly sighted person would fail. And adjusting the question to involve a cross-modal comparison of two-dimensional shapes does not suggest Locke would change his answer to ‘yes’. (shrink)

Modality specificity in priming is taken as evidence for independent perceptual systems. However, Easton, Greene, and Srinivas (1997) showed that visual and haptic cross-modal priming is comparable in magnitude to within-modal priming. Where appropriate, perceptual systems might share like information. To test this, we assessed priming and recognition for visual and auditory events, within- and across- modalities. On the visual test, auditory study resulted in no priming. On the auditory priming test, visual study resulted in priming that (...) was only marginally less than within-modal priming. The priming results show that visual study facilitates identification on both visual and auditory tests, but auditory study only facilitates performance on the auditory test. For both recognition tests, within-modal recognition exceeded cross-modal recognition. The results have two novel implications for the understanding of perceptual priming: First, we introduce visual and auditory priming for spatio-temporal events as a new priming paradigm chosen for its ecological validity and potential for information exchange. Second, we propose that the asymmetry of the cross-modal priming observed here may reflect the capacity of these perceptual modalities to provide cross-modal constraints on ambiguity. We argue that visual perception might inform and constrain auditory processing, while auditory perception corresponds to too many potential visual events to usefully inform and constrain visual perception. (shrink)

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In (...) a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception. (shrink)

Molyneux’s question asks whether someone born blind, who could distinguish cubes from spheres using his tactile sensation, could recognize those objects if he received his sight. Locke says no: the newly sighted person would fail to point to the cube and call it a cube. Locke never provided a complete explanation for his negative response, and there are concerns of inconsistency with other important aspects of his theory of ideas. These charges of inconsistency rest upon an unrecognized and unfounded assumption (...) that seeing entails recognition. Locke’s negative answer to Molyneux’s question is consistent with his other philosophical commitments. (shrink)

This study explored how congruency between facial mimicry and observed expressions affects the stability of conscious facial expression representations. Focusing on the congruency effect between proprioceptive/sensorimotor signals and visual stimuli for happy expressions, participants underwent a binocular rivalry task displaying neutral and happy faces. Mimicry was either facilitated with a chopstick or left unrestricted. Key metrics included Initial Percept (bias indicator), Onset Resolution Time (time from onset to Initial Percept), and Cumulative Time (content stabilization measure). Results indicated that mimicry manipulation (...) significantly impacted Cumulative Time for happy faces, highlighting the importance of congruent mimicry in stabilizing conscious awareness of facial expressions. This supports embodied cognition models, showing the integration of proprioceptive information significantly biases conscious visual perception of facial expressions. (shrink)

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence (...) processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality. (shrink)

For a robot to be capable of development it must be able to explore its environment and learn from its experiences. It must find opportunities to experience the unfamiliar in ways that reveal properties valid beyond the immediate context. In this paper, we develop a novel method for using the rhythm of everyday actions as a basis for identifying the characteristic appearance and sounds associated with objects, people, and the robot itself. Our approach is to identify and segment groups of (...) signals in individual modalities based on their rhythmic variation, then to identify and bind causally-related groups of signals across different modalities. By including proprioception as a modality, this cross-modal binding method applies to the robot itself, and we report a series of experiments in which the robot learns about the characteristics of its own body. (shrink)

Experimental investigations of cross-cultural music perception and cognition reported during the past decade are described. As globalization and Western music homogenize the world musical environment, it is imperative that diverse music and musical contexts are documented. Processes of music perception include grouping and segmentation, statistical learning and sensitivity to tonal and temporal hierarchies, and the development of tonal and temporal expectations. The interplay of auditory, visual, and motor modalities is discussed in light of synchronization and the way (...) music moves via emotional response. Further research is needed to test deep-rooted psychological assumptions about music cognition with diverse materials and groups in dynamic contexts. Although empirical musicology provides keystones to unlock musical structures and organization, the psychological reality of those theorized structures for listeners and performers, and the broader implications for theories of music perception and cognition, awaits investigation. (shrink)

Bodily perception is standardly contrasted with distal perception. In this paper, I argue that the standard view overlooks a significant respect in which bodily perception parallels distal perception. The parallel is motivated by a comparison between two cross-modal illusions. The ventriloquism effect manifests cross-modal relations between the distal senses of vision and audition and multi-sensory experiences jointly constituted by vision and audition. Thermal referral is a laboratory induced illusion that involves the bodily (...) sensory systems underlying the perception of pressure and heat. I argue that thermal referral indicates the presence of cross-modal relations and multi-sensory experiences of a type sufficiently similar to those manifested by the ventriloquism effect to suggest that pressure and thermal perception parallel vision and audition at the level of bodily perception. (shrink)

Two cross-modal experiments provide partial support for O'Regan & Noë's (O&N's) claim that sensorimotor contingencies mediate perception. Differences in locating a target sound accompanied by a spatially disparate neutral light correlate with whether the two stimuli were perceived as spatially unified. This correlation suggests that internal representations are necessary for conscious perception, which may also mediate sensorimotor contingencies.

Inner speech is commonly understood as the conscious experience of a voice within the mind. One recurrent theme in the scientific literature is that the phenomenon involves a representation of overt speech, for example, a representation of phonetic properties that result from a copy of speech instructions that were ultimately suppressed. I propose a larger picture that involves some embodied objects and their misperception. I call it “the Body Error Theory,” or BET for short. BET is a form of illusionism, (...) but the particular version I favor is a cross-modal illusion. Newly described here, my hypothesis is that the experience of inner speech arises from a mix of interoception and audition. Specifically, there is the detection of slight but well-confirmed activities in the speech musculature that occur during inner speech, which helps to transform representations of normal but quiet nonverbal sounds that inevitably occur during inner speech, from breathing to background noise, into a mistaken perception of inner speech. Simply put, activities in the speech musculature mix with sounds to create the appearance of speech sounds, which thus explains the “voice within the mind.” I also show how BET’s cross-modal system fits with standard information processing accounts for speech monitoring and how it accommodates the central insights of leading theories of inner speech. In addition, I show how BET is supported by data from experience-sampling surveys and how it can be empirically tested against its rivals. (shrink)

Abstract: In The Imaginary Jean-Paul Sartre makes what will strike many as an implausibly strong claim, namely that perception and imagination are incompatible kinds of experience - I call this the exclusion claim. This paper offers a reconstruction of Sartre’s exclusion claim. First, it frames the claim in terms of cross-modal attention distribution, such that it is not possible to simultaneously attend to what one is imagining and what one is perceiving. However, this leaves it open that (...) a subject can simultaneously imagine and perceive on the condition that either the perceived or imagined objects are not attended to. While this is a philosophically plausible position it fails to do justice to Sartre’s intended position, which suggests a more radical exclusion between perception and imagination. In light of this section 3 develops a supplementary argument to remove one of the possible configurations of attention that the ban on divided attention leaves in place by arguing that the objects of imagining must be attended to, which follows from Sartre’s characterisation of imagination as spontaneous. The resulting exclusion is as follows: attentive perception excludes imagination (and vice versa), given that the latter is necessarily attentive, but attentive imagination can co-occur with non-attentive or background perception (in this sense the exclusion is asymmetric in a way that Sartre fails to recognise). In concluding I detail how from this exclusion we get an important consequence – which Sartre wants the exclusion claim to have – namely that it rules out an imagination-based solution to the problem of perceptual presence. (shrink)

According to the cognitive penetrability hypothesis, our beliefs, desires, and possibly our emotions literally affect how we see the world. This book elucidates the nature of the cognitive penetrability and impenetrability hypotheses, assesses their plausibility, and explores their philosophical consequences. It connects the topic's multiple strands (the psychological findings, computationalist background, epistemological consequences of cognitive architecture, and recent philosophical developments) at a time when the outcome of many philosophical debates depends on knowing whether and how cognitive states can influence (...) class='Hi'>perception. All sixteen chapters were written especially for the book. The first chapters provide methodological and conceptual clarification of the topic and give an account of the relations between penetrability, encapsulation, modularity, and cross-modal interactions in perception. Assessments of psychological and neuroscientific evidence for cognitive penetration are given by several chapters. Most of the contributions analyse the impact of cognitive penetrability and impenetrability on specific philosophical topics: high-level perceptual contents, the epistemological consequences of penetration, nonconceptual content, the phenomenology of late perception, metacognitive feelings, and action. The book includes a comprehensive introduction which explains the history of the debate, its key technical concepts (informational encapsulation, early and late vision, the perception-cognition distinction, hard-wired perceptual processing, perceptual learning, theory-ladenness), and the debate's relevance to current topics in the philosophy of mind and perception, epistemology, and philosophy of psychology. (shrink)

My reply to Macpherson begins by addressing whether it is effects of cognition on early vision or perceptual performance that I am interested in. I proceed to address Macpherson’s comments on evidence from cross-modal effects, interpretations of linguistic effects on image detection, evidence from illusions, and the usefulness of predictive coding for understanding cognitive penetration. By stressing the interactive and distributed nature of neural processing, I am committing to a collapse between perception and cognition. Following such a (...) collapse, the very question of whether cognition affects perception becomes ill-posed, but this may be for the best. (shrink)

We can perceive shapes visually and tactilely, and the information we gain about shapes through both sensory modalities is integrated smoothly into and functions in the same way in our behavior independently of whether we gain it by sight or touch. There seems to be no reason in principle we couldn't perceive shapes through other sensory modalities as well, although as a matter of fact we do not. While we can identify shapes through other sensory modalities—e.g., I may know by (...) smell (the scent of mango) that the object causing my sensory experience is round—this is not perceiving an object as shaped, but rather inferring from the character of one's sensory experience and collateral information that an object of a certain shape caused it. That it is possible to perceive shape by other modalities, however, is suggested by the case of bats and aquatic mammals like dolphins which navigate through their environment by a form of sonar. It is plausible that they have some form of auditory representation of space, and so of shape. These facts about shape perception raise important questions about the relation between those features of perceptual experience which are intrinsic to different sensory modalities and the nature of our perceptual representation of shapes, and, more generally, of the space within which we perceive shaped objects to be located. John Campbell's paper, "Molyneux's Problem" (see above), raises a number of interesting and important questions about the nature of our perception of shape properties, particularly the cross-modal nature of shape perception, and ties them to more general questions about the nature both of perceptual.. (shrink)

This paper has two goals. The first is to develop a cross-linguistically valid model of modality and mood that captures the most important dimensions along which modal expressions vary. I posit a model with two such dimensions, one of volitivity, and one of event-orientation vs. speaker-orientation, mood being placed at the speaker-oriented end relative to modality proper. The second goal is to provide a new perspective on semantic change of modal expressions on the basis of the proposed (...) model. I argue that unidirectional change along the event-oriented / speaker-oriented dimension is the one overarching tendency of semantic change in modals. This stands in contrast to the widespread perception that change from deontic to epistemic is the dominant tendency. The directionality suggested in this new model is also more comprehensive than previously proposed tendencies of change, such as ‘‘from agent-oriented to epistemic’’, ‘‘from agent-oriented to speaker-oriented’’, and ‘‘from participant-internal to participant-external’’, as it better accounts for various kinds of change that have been previously neglected, including change from epistemic to deontic. (shrink)

Cognitive scientists have long known that the modalities interact during perceptual processing. Cross-modal illusions like the ventriloquism effect show that the course of processing in one modality can alter the course of processing in another. But how do the modalities interact in the specific domain of object perception? This paper distinguishes and analyzes two kinds of multisensory interaction in object perception. First, the modalities may bind features to a single object or event. Second, the modalities may (...) cooperate when differentiating an object or event from its surroundings. I critically evaluate evidence for various forms of multisensory binding. I then consider the case for multisensory differentiation. I argue that existing evidence for multisensory differentiation is inconclusive. I highlight ways that the issue might be empirically resolved. (shrink)

This paper advances a novel argument that speech perception is a complex system best understood nonindividualistically and therefore that individualism fails as a general philosophical program for understanding cognition. The argument proceeds in four steps. First, I describe a "replaceability strategy", commonly deployed by individualists, in which one imagines replacing an object with an appropriate surrogate. This strategy conveys the appearance that relata can be substituted without changing the laws that hold within the domain. Second, I advance a "counterfactual (...) test" as an alternative to the replaceability strategy. Third, I show how the typical objects of cross-modal processes (in this case, auditory-visual speech perception), more clearly irreplaceable than the objects of the unimodal process examined by Burge [(1986) Individualism and psychology, The Philosophical Review, XCV, 3-45], supply a firm basis for a nonindividualist interpretation of such cases. Finally, I demonstrate that the routine violation of the individualist's Replaceability Condition occurs even in unimodal cases - so the violation of the replaceability constraint does not derive simply from the diversity of modal sources but rather from the causal complexity of psychological processes generally. The conclusion is that philosophical progress on this issue must await progress in psychology, or, at least, philosophical progress in accounting for psychological complexity--precisely the vicissitude predicted by a thoroughgoing naturalism. (shrink)

The sounds that result from our movement and that mark the outcome of our actions typically convey useful information concerning the state of our body and its movement, as well as providing pertinent information about the stimuli with which we are interacting. Here we review the rapidly growing literature investigating the influence of non-veridical auditory cues (i.e., inaccurate in terms of their context, timing, and/or spectral distribution) on multisensory body and action perception, and on motor behavior. Inaccurate auditory cues (...) provide a unique opportunity to study cross-modal processes: the ability to detect the impact of each sense when they provide a slightly different message is greater. Additionally, given that similar cross-modal processes likely occur regardless of the accuracy or inaccuracy of sensory input, studying incongruent interactions are likely to also help us predict interactions between congruent inputs. The available research convincingly demonstrates that perceptions of the body, of movement, and of surface contact features (e.g., roughness) are influenced by the addition of non-veridical auditory cues. Moreover, auditory cues impact both motor behavior and emotional valence, the latter showing that sounds that are highly incongruent with the performed movement induce feelings of unpleasantness (perhaps associated with lower processing fluency). Such findings are relevant to the design of auditory cues associated with product interaction, and the use of auditory cues in sport performance and therapeutic situations given the impact on motor behavior. (shrink)

A recent empirical study claims to show that the answer to Molyneux’s question is negative, but, as John Schwenkler points out, its findings are inconclusive: Subjects tested in this study probably lacked the visual acuity required for a fair assessment of the question. Schwenkler is undeterred. He argues that the study could be improved by lowering the visual demands placed on subjects, a suggestion later endorsed and developed by Kevin Connolly. I suggest that Connolly and Schwenkler both underestimate the difficulties (...) involved in rectifying the study they seek to fix. The problem is that the experimental paradigm under consideration fails to account for the role that rational inference plays in newly sighted subjects’ ability or inability to recognize spatial properties across modalities. Since answering Molyneux’s question requires establishing whether spatial properties can be recognized, across modalities, by newly sighted subjects without recourse to rational inference, this is a problem. Indeed, it is a problem that may be worsened by Schwenkler and Connolly’s suggestions regarding the lowering of visual demands on subjects in cross-modal matching tasks. (shrink)

Visuo-motor adaptation to optical prisms displacing the visual scene (prism adaptation, PA) is a method used for investigating visuomotor plasticity in healthy individuals and, in clinical settings, for the rehabilitation of unilateral spatial neglect. In the standard paradigm, the adaptation phase involves repeated pointings to visual targets, while wearing optical prisms displacing the visual scene laterally. Here we explored differences in PA, and its aftereffects (AEs), as related to the sensory modality of the target. Visual, auditory, and multisensory - audio-visual (...) - targets in the adaptation phase were used, while participants wore prisms displacing the visual field rightwards by 10◦. Proprioceptive, visual, visual-proprioceptive, auditory-proprioceptive straight-ahead shifts were measured. Pointing to auditory and to audio-visual targets in the adaptation phase produces proprioceptive, visual-proprioceptive, and auditory-proprioceptive AEs, as the typical visual targets did. This finding reveals that cross-modal plasticity effects involve both the auditory and the visual modality, and their interactions (Experiment 1). Even a shortened PA phase, requiring only 24 pointings to visual and audio-visual targets (Experiment 2), is sufficient to bring about AEs, as compared to the standard 92-pointings procedure. Finally, pointings to auditory targets cause AEs, although PA with a reduced number of pointings (24) to auditory targets brings about smaller AEs, as compared to the 92-pointings procedure (Experiment 3). Together, results from the three experiments extend to the auditory modality the sensorimotor plasticity underlying the typical AEs produced by PA to visual targets. Importantly, PA to auditory targets appears characterized by less accurate pointings and error correction, suggesting that the auditory component of the PA process may be less central to the building up of the AEs, than the sensorimotor pointing activity per se. These findings highlight both the effectiveness of a reduced number of pointings for bringing about AEs, and the possibility of inducing PA with auditory targets, which may be used as a compensatory route in patients with visual deficits. (shrink)

Traditionally, the bodily senses of smell, taste, and touch have been designated ‘nonaesthetic’ senses and their objects considered unsuited to be fashioned into works of fine art. Recent innovations in the art world, however, have introduced scents, tastes, and tactile qualities into gallery exhibits, movements that, at least superficially, appear parallel to philosophical revaluations of the senses. This paper investigates the aesthetic scope of the five external senses, addressing some standard arguments about the limits of the ‘lower’ senses. I defend (...) the artistic scope of the bodily senses by appealing to cross-modal perception and to the sensuous aspects of appreciative emotional responses to art. (shrink)

A recent study published in Nature Neuroscience purports to have answered a question posed to Locke in 1688 by his friend William Molyneux, namely, whether ‘a man born blind and made to see’ would be able to identify, immediately and by vision alone, objects previously known only by touch. The answer, according to the researchers – and as predicted by Molyneux, as well as Locke, Berkeley, and others – is ‘likely negative. The newly sighted subjects did not exhibit an immediate (...) transfer of their tactile shape knowledge to the visual domain’. Since then, however, many commentators have argued that the answer is still not clear. Moreover, in the contemporary literature on Molyneux’s Question, and more generally on cross-modal perception and the individuation of the senses, it is sometimes hard to determine what question is being investigated. In this paper, I distinguish a number of different questions about the relation between visual and tactual perception that can arise when considering Molyneux’s... (shrink)

In chapter 7 of the third book of De anima Aristotle is concerned with the activity of the intellect, which, here as elsewhere in the work, he explores by developing parallels with his account of sense-perception. In this chapter his principal interest appears to be the notion of judgement, and in particular intellectual judgements about the value of some item on a scale of good and bad. In this paper I shall argue, firstly that there is in fact a (...) coherent structure and focus to this chapter, which has therefore unjustly been criticized as disorganized or corrupt; and secondly that, in the light of such a coherent understanding of the chapter as a whole, we can resolve the difficulties in interpreting the central passage concerned with cross-modal perceptual judgements, and thereby also throw some further light on the related passages in the second chapter of De anima 3, which had been directly concerned with that topic. (shrink)

Few topics in the philosophy of perception have received more attention than Molyneux’s question: would a person with congenital blindness, able to identify cubes and spheres by touch, immediately or even eventually identify these shapes by sight alone, if made to see? This special issue focuses on the new developments concerning the answers to this question, as well as on the new questions in the light of the results of the results from the sciences of the mind.

Synaesthesia is a condition in which one type of stimulation evokes the sensation of another, as when the hearing of a sound produces photisms, i.e. mental percepts of colours. R is a 20 year old colour blind subject who, in addition to the relatively common grapheme-colour synaesthesia, presents a rarely reported cross modal perception in which a variety of visual stimuli elicit aura-like percepts of colour. In R, photisms seem to be closely related to the affective valence (...) of stimuli and typically bring out a consistent pattern of emotional responses. The present case study suggests that colours might be an intrinsic category of the human brain. We developed an empirical methodology that allowed us to study the subject's otherwise inaccessible phenomenological experience. First, we found that R shows a Stroop effect elicited by photisms despite the fact that he does not show a regular Stroop with real colours. Secondly, by manipulating the colour context we confirmed that colours can alter R's emotional evaluation of the stimuli. Furthermore, we demonstrated that R's auras may actually lead to a partially inverted emotional spectrum where certain stimuli bring out emotional reactions opposite to the normal ones. These findings can only be accounted for by considering R's subjective colour experience or qualia. Therefore the present paper defends the view that qualia are a useful scientific concept that can be approached and studied by experimental methods. (shrink)

Synaesthesia is a condition in which one type of stimulation evokes the sensation of another, as when the hearing of a sound produces photisms, i.e. mental percepts of colours. R is a 20 year old colour blind subject who, in addition to the relatively common grapheme-colour synaesthesia, presents a rarely reported cross modal perception in which a variety of visual stimuli elicit aura-like percepts of colour. In R, photisms seem to be closely related to the affective valence (...) of stimuli and typically bring out a consistent pattern of emotional responses. The present case study suggests that colours might be an intrinsic category of the human brain. We developed an empirical methodology that allowed us to study the subject's otherwise inaccessible phenomenological experience. First, we found that R shows a Stroop effect (delayed response due to interference) elicited by photisms despite the fact that he does not show a regular Stroop with real colours. Secondly, by manipulating the colour context we confirmed that colours can alter R's emotional evaluation of the stimuli. Furthermore, we demonstrated that R's auras may actually lead to a partially inverted emotional spectrum where certain stimuli bring out emotional reactions opposite to the normal ones. These findings can only be accounted for by considering R's subjective colour experience or qualia. Therefore the present paper defends the view that qualia are a useful scientific concept that can be approached and studied by experimental methods. (shrink)

Synaesthesia is a condition in which one type of stimulation evokes the sensation of another, as when the hearing of a sound produces photisms, i.e. mental percepts of colours. R is a 20 year old colour blind subject who, in addition to the relatively common grapheme-colour synaesthesia, presents a rarely reported cross modal perception in which a variety of visual stimuli elicit aura-like percepts of colour. In R, photisms seem to be closely related to the affective valence (...) of stimuli and typically bring out a consistent pattern of emotional responses. The present case study suggests that colours might be an intrinsic category of the human brain. We developed an empirical methodology that allowed us to study the subject's otherwise inaccessible phenomenological experience. First, we found that R shows a Stroop effect elicited by photisms despite the fact that he does not show a regular Stroop with real colours. Secondly, by manipulating the colour context we confirmed that colours can alter R's emotional evaluation of the stimuli. Furthermore, we demonstrated that R's auras may actually lead to a partially inverted emotional spectrum where certain stimuli bring out emotional reactions opposite to the normal ones. These findings can only be accounted for by considering R's subjective colour experience or qualia. Therefore the present paper defends the view that qualia are a useful scientific concept that can be approached and studied by experimental methods. (shrink)

Bayne and McClelland (2016) raise the matching content challenge for proponents of cognitive phenomenology: if the phenomenal character of thought is determined by its intentional content, why is it that my conscious thought that there is a blue wall before me and my visual perception of a blue wall before me don’t share any phenomenology, despite their matching content? In this paper, I first show that the matching content challenge is not limited to proponents of cognitive phenomenology but extends (...) to cases of cross-modal perception, threatening representationalism about consciousness in general. I then give two responses to the challenge, both of which appeal to intentional modes. The difference in intentional mode between a thought and a visual perception can either explain why we should not expect any phenomenal overlap between the two experiences, or it can make it clear why the phenomenal overlap is easy to overlook. I show that these responses are available to the representationalist about perceptual consciousness, as well as the proponent of cognitive phenomenology. The upshot is that, when it comes to the matching content challenge, both perceptual representationalism and cognitive representationalism stand on equal dialectical footing. (shrink)

In a variety of synaesthesia, photisms result from affect-laden stimuli as emotional words, or faces of familiar people. For R, who participated in this study, the sight of a familiar person triggers a mental image of "a human silhouette filled with colour". Subjective descriptions of synaesthetic experiences induced by the visual perception of people's figures and faces show similarities with the reports of those who claim to possess the ability to see the aura. It has been proposed that the (...) purported auric perception may be easily explained by the presence of a specific subtype of cross-modal perception. We analyse the subjective reports of four synaesthetes who experience colours in response to human faces and figures. These reports are compared with descriptions of alleged auric phenomena found in the literature and with claims made by experts in esoteric spheres. The discrepancies found suggest that both phenomena are phenomenologically and behaviourally dissimilar. (shrink)

The phenomenon of synesthesia has undergone an invigoration of research interest and empirical progress over the past decade. Studies investigating the cognitive mechanisms underlying synesthesia have yielded insight into neural processes behind such cognitive operations as attention, memory, spatial phenomenology and inter-modal processes. However, the structural and functional mechanisms underlying synesthesia still remain contentious and hypothetical. The first section of the present paper reviews recent research on grapheme-color synesthesia, one of the most common forms of synesthesia, and addresses the (...) ongoing debate concerning the role of selective attention in eliciting synesthetic experience. Drawing on conclusions of the first half, the paper’s second half examines the various models proposed to explain the cognitive mechanisms behind grapheme-color synesthesia, and discusses the explanatory virtues of a new model suggesting that grapheme-color synesthesia is grounded in memory. The last section offers an examination of some of the broader philosophical implications of synesthesia. (shrink)