The visual system is a source of sensory information that perceives environmental stimuli and interacts with other sensory systems to generate visual and postural responses to maintain postural stability. Although the three sensory systems; the visual, vestibular, and somatosensory systems work concurrently to maintain postural control, the visual and vestibular system interaction is vital to differentiate self-motion from external motion to maintain postural stability. The visual system influences postural control playing a key role in perceiving (...) information required for this differentiation. The visual system’s main afferent information consists of optic flow and retinal slip that lead to the generation of visual and postural responses. Visual fixations generated by the visual system interact with the afferent information and the vestibular system to maintain visual and postural stability. This review synthesizes the roles of the visual system and their interaction with the vestibular system, to maintain postural stability. (shrink)

Increasing psychophysical evidence suggests that specific image features - or statistics - can appear unpleasant or induce visual discomfort in humans. Such unpleasantness tends to be particularly profound if the image's amplitude spectrum deviates from the regular 1/f spatial-frequency falloff expected in natural scenes. Here, we show that profound unpleasant impressions also result if the orientation spectrum of the image becomes flatter. Using bandpass noise with variable orientation and spatial-frequency bandwidths, we found that unpleasantness ratings decreased with spatial- frequency (...) bandwidth but increased with orientation bandwidth. Similarly, a subsequent experiment revealed that sinusoidal modulations in the amplitude spectrum of 1/f noise along the spatial frequency increased unpleasantness, but modulations along the orientation decreased it. Given that natural scenes tend to have a linear slope along the spatial frequency but an uneven spectrum along the orientation dimension, our opposing results in the spatial-frequency and orientation domains commonly support the idea that images deviating from the spectral regularity of natural scenes can give rise to unpleasant impressions. (shrink)

This study investigates the procedural learning, retention, and reactivation of temporal sensorimotor sequences in children with and without developmental coordination disorder. Twenty typically-developing children and 12 children with DCD took part in this study. The children were required to tap on a keyboard, synchronizing with auditory or visual stimuli presented as an isochronous temporal sequence, and practice non-isochronous temporal sequences to memorize them. Immediate and delayed retention of the audio-motor and visuo-motor non-isochronous sequences were tested by removing auditory or (...) visual stimuli immediately after practice and after a delay of 2 h. A reactivation test involved reintroducing the auditory and visual stimuli after the delayed recall. Data were computed via circular analyses to obtain asynchrony, the stability of synchronization and errors. Firstly, an overall deficit in synchronization with both auditory and visual isochronous stimuli was observed in DCD children compared to TD children. During practice, further improvements were found for the audio-motor non-isochronous sequence compared to the visuo-motor non-isochronous sequence in both TD children and children with DCD. However, a drastic increase in errors occurred in children with DCD during immediate retention as soon as the auditory stimuli were removed. Reintroducing auditory stimuli decreased errors in the audio-motor sequence for children with DCD. Such changes were not seen for the visuo-motor non-isochronous sequence, which was equally learned, retained and reactivated in DCD and TD children. All these results suggest that TD children benefit from both auditory and visual stimuli to memorize the sequence, whereas children with DCD seem to present a deficit in integrating an audio-motor sequence in their memory. The immediate effect of reactivation suggests a specific dependency on auditory information in DCD. Contrary to the audio-motor sequence, the visuo-motor sequence was both learned and retained in children with DCD. This suggests that visual stimuli could be the best information for memorizing a temporal sequence in DCD. All these results are discussed in terms of a specific audio-motor coupling deficit in DCD. (shrink)

In the reported, experiment participants hit a ball to aim at the vertex of a Müller–Lyer configuration. This configuration either remained stable, changed its shaft length or the orientation of the tails during movement execution. A significant illusion bias was observed in all perturbation conditions, but not in the stationary condition. The illusion bias emerged for perturbations shortly after movement onset and for perturbations during execution, the latter of which allowed only a minimum of time for making adjustments . These (...) findings indicate that allocentric information is exploited for online control when people make rapid adjustments in response to a sudden change in the environment and not when people guide their limb movements to interact with a stable environment. (shrink)

Visual images are widely used in medical and patient education to enhance spoken or written explanations. This paper considers the role of such illustrations in shaping conceptions of the body; specifically, it addresses depictions of variant sexual anatomy and their part in the discursive production of intersex bodies. Visual language—even didactic, ‘factual’ visual language—carries latent as well as manifest content, and influences self-perceptions and social attitudes. In the case of illustrations about atypical sex development, where the need (...) for non-stigmatising communication is crucial, it is especially important to consider the implicit messages conveyed by imagery and compositional strategies. (shrink)

The ability to distinguish between subtle differences among emotions of similar valence is labelled emotion differentiation (ED). Previous research has demonstrated that people high in ED are less likely to use disengagement regulation strategies (i.e. avoidance/distraction) during negative affective states.The present eye-tracking study examined associations between ED and visual attention/avoidance of affective stimuli. A total of 160 participants viewed emotional video clips (positive/ negative), which were concurrently presented with a non-affective distractor image. After each video, participants verbally described (...) their experienced emotions with adjectives in an open-response format. Moreover, they completed an ED questionnaire.The computed ED specificity index for the negative videos (the number of specific adjectives divided by all adjectives used) was positively associated with the scores on the ED questionnaire and visual revisits for the negative videos (how many times the participants gazed back and forth between video and distractor). This viewing style might reflect more active exploratory behaviour directed toward acquiring information about the negative stimulus and its context. The ED measures were not associated with the gaze behaviour for positive videos. (shrink)

Numerous philosophers accept the differentiation condition, according to which one does not see an object unless one visually differentiates it from its immediate surroundings. This paper, however, sounds a sceptical note. Based on suggestions by Dretske (2007) and Gibson (2002 [1972]), I articulate two ‘principles of occlusion’ and argue that each principle admits of a reading on which it is both plausible and incompatible with the differentiation condition. To resolve the inconsistency, I suggest we abandon the differentiation (...) condition. (shrink)

A set of images can be considered as meaningfully different for an observer if they can be distinguished phenomenally from one another. Each phenomenal difference must be supported by some neurophysiological differences. Differentiation analysis aims to quantify neurophysiological differentiation evoked by a given set of stimuli to assess its meaningfulness to the individual observer. As a proof of concept using high-density EEG, we show increased neurophysiological differentiation for a set of natural, meaningfully different images in contrast to (...) another set of artificially generated, meaninglessly different images in nine participants. Stimulus-evoked neurophysiological differentiation (over 257 channels, 800 ms) was systematically greater for meaningful vs. meaningless stimulus categories both at the group level and for individual subjects. Spatial breakdown showed a central-posterior peak of differentiation, consistent with the visual nature of the stimulus sets. Temporal breakdown revealed an early peak of differentiation around 110 ms, prominent in the central-posterior region; and a later, longer-lasting peak at 300–500 ms that was spatially more distributed. The early peak of differentiation was not accompanied by changes in mean ERP amplitude, whereas the later peak was associated with a higher amplitude ERP for meaningful images. An ERP component similar to visual-awareness-negativity occurred during the nadir of differentiation across all image types. Control stimulus sets and further analysis indicate that changes in neurophysiological differentiation between meaningful and meaningless stimulus sets could not be accounted for by spatial properties of the stimuli or by stimulus novelty and predictability. (shrink)

One of the main functions of visual system is to construct representations of objects. These ‘visual objects’ are formed by developing the structure of more primitive visual representations. In the course of the article, I define the notions of ‘minimal visual object’, ‘maximal-non object representation’, and ‘constructing characteristic’ that differentiates minimal objects from maximal non-objects. Relying on these distinctions, I consider the type of ontological change that transforms visual regions, treated as maximal non-object representations, into (...) basic, low-level visual objects. In order to identify such a change, theories of early vision, models of figure/ground distinction, and analytic, ontological notions of objects’ structure are discussed. Finally, a thesis is stated that external relations constitute the main structural factor that determines the ontological transition between non-object representations and visual objects. (shrink)

The article explores the relationship between visual culture and the fight for visibility and attention in contemporary society. It draws on a concept of visual culture which not only sees the rising significance of the visual and the proliferation of images as its defining traits, but also the fact that, today, people are—to a much higher degree—both consumers as well as producers of images. Based on this definition, it is argued that in visually oriented communication and media (...) societies, the anthropologically fundamental need for attention manifests itself as a fight for visibility which takes on the form of ever more extreme forms of public self-display. Furthermore, a portrait of two social figures—the star and the voyeur—will serve as further analysis and description of the social trends which can be tied to the emergence of today's visual culture. The article will close by discussing attention and visibility in terms of inclusion and exclusion and by proposing an analytical model for differentiating four modes of existence in a visual culture. (shrink)

The following dissertation shows how German Literature negotiates the relationship between language and the visual arts, particularly in Romantic narratives. In contrast with authors of the Enlightenment, the Romantics tend to deny specificity to visual experience and in so doing dedifferentiate visual experience from the textual. ;The initial, methodological, chapter explicates perceptual models informed by the interplay of the philosophical approaches of Kant and Wittgenstein with the psychoanalytic discourse of Freud. In Chapter Two, I turn to Lessing's (...) Laokoon Uder uber die Grenzen der Malerei und Poesie , in which he divides the arts into pictoral and linguistic signs. While the boundary between the two appears quite clear in Laokoon, his play Emilia Galotti reveals Lessing's anxiety that the difference cannot be so easily maintained. ;The subsequent chapter explores the representation of the visual arts in Tieck's Franz Sternbalds Wanderungen . After a discussion of Wackenroder's Herzensergiessungen eines kunstliebenden Klosterbruders , 1 turn to Tieck's novel about a young student of Albrecht Durer. The novel responds to the ostensible binary between language and the visual arts by transmuting the distinction into one between readable landscape paintings and phantasmatic images that guide the protagonist. ;As another example of this Romantic viewpoint, I analyze Brentano's Godwi oder das steinerne Bild der Mutter . Here I use the distinction between symbol and allegory to point out the ways in which the text turns the difference between the arts into one between rhetorical figures. A similar manifestation of the problem occurs in Eichendorff's Das Marmorbild , discussed in Chapter Five. The novella follows the same lines as Lessing's Laokoon, thematizing the materiality of its eponymous marble statue. My final chapter concerns Kleist's model of visual perception, which is closely bound to his theology in his tales "Die heilige Cacilie" and "Der Findling" . ;Writing Images interprets the role of visuality in German Romantic literature in order to understand an unresolved problematic of late eighteenth and early nineteenth-century thought for those who would too quickly either differentiate between or conflate the visual and the written. (shrink)

One of the crucial fields of study that is getting more attention is association rule mining. It is crucial to databases' knowledge discovery (KDD). KDD and association rule mining have a very broad use. It has evolved at a rapid rate over the past fifteen years. Association Rule Mining is a novel technology, although it is still in the discovery and development stages. Video is an illustration of interactive media data since it contains text, pictures, meta-data, visual, sound, and (...) different kinds of data. It is frequently used for a variety of important likely reasons, such as security and reconnaissance, amusement, healthcare, educational endeavours, and sports. One of the main issues for the local data-mining research community is video data mining, which aims to find and comprehend fascinating examples from the large volume of video data. Video data mining is still in its infancy when compared to mining other sorts of data. It is pivotal to grasp and naturally mine the information from video databases considering the continually extending computerized libraries and video databases. Differentiating association rules between components in a significant video library is critical in the field of video data mining. As per continuous imaginative work, association rule mining is being utilized rapidly in various tasks, including perception, social affairs, broadcast news, sports, records, films, clinical data, as well as on the web and individual media assortments. This exploration tries to give a far-reaching method to association rule extraction from video databases. (shrink)

Determining the compositional properties of surfaces in the environment is an important visual capacity. One such property is specular reflectance, which encompasses the range from matte to shiny surfaces. Visual estimation of specular reflectance can be informed by characteristic motion profiles; a surface with a specular reflectance that is difficult to determine while static can be confidently disambiguated when set in motion. Here, we used fMRI to trace the sensitivity of human visual cortex to such motion cues, (...) both with and without photometric cues to specular reflectance. Participants viewed rotating blob-like objects that were rendered as images (photometric) or dots (kinematic) with either matte-consistent or shiny-consistent specular reflectance profiles. We were unable to identify any areas in low and mid-level human visual cortex that responded preferentially to surface specular reflectance from motion. However, univariate and multivariate analyses identified several visual areas; V1, V2, V3, V3A/B, and hMT+, capable of differentiating shiny from matte surface flows. These results indicate that the machinery for extracting kinematic cues is present in human visual cortex, but the areas involved in integrating such information with the photometric cues necessary for surface specular reflectance remain unclear. (shrink)

ABSTRACTIn the present study, attentional bias was investigated as a potential predisposing mechanism for the contamination-related subtype of obsessive-compulsive disorder. Fifty healthy participants with varying degrees of subclinical C-OC symptoms performed a visual search task to measure differential attentional biases elicited by neutral, disgust-, and fear-specific pictorial material. Participants had to find a target picture within five neutral distractor pictures randomly presented on different locations in an array. The task was to decide whether the array contained an unpleasant target (...) picture or not. In randomly-selected emotional trials, participants were further asked about the content of the picture and the confidence of their answer. The results show that the reaction times significantly differed between the emotional and neutral pictures. Participants were significantly more confident in answering questions referring to fear compared to disgust pictures. This effect was mar... (shrink)

Visual perspective during autobiographical memory (AM) retrieval influences how people remember the emotional aspects of memories. Prior research in emotion regulation has also shown that shifting from an own eyes to an observer-like perspective is an efficient way of regulating the affect elicited by emotional AMs. However, the impact of shifting visual perspective is also dependent on the nature of the emotion associated with the event. The current review synthesizes behavioral and functional neuroimaging findings from the event memory (...) and emotion regulation literature that examine how adopting particular visual perspectives and actively shifting across them during retrieval alters emotional experience, by primarily focusing on emotional intensity. We review current theories explaining why shifts in perspectives may or may not change the emotional characteristics of memories, then propose a new theory, suggesting that the own eyes and observer-like perspectives are two different retrieval orientations supported by differential neural activations that lead episodic details to be reconstructed in specific ways. (shrink)

In a study concerning visual body part recognition, a “self-advantage” effect, whereby self-related body stimuli are processed faster and more accurately than other-related body stimuli, was revealed, and the emergence of this effect is assumed to be tightly linked to implicit motor simulation, which is activated when performing a hand laterality judgment task in which hand ownership is not explicitly required. Here, we ran two visual hand recognition tasks, namely, a hand laterality judgment task and a self-other discrimination (...) task, to investigate whether the self-advantage emerged even if implicit motor imagery was assumed to be working less efficiently and how individual traits [such as autistic traits and the extent of positive self-body image, as assessed via the Autism Spectrum Quotient and the Body Appreciation Scale-2, respectively] modulate performance in these hand recognition tasks. Participants were presented with hand images in two orientations [i.e., upright and upside-down ] and asked to judge whether it was a left or right hand. They were also asked to determine whether it was their own, or another person’s hand. Data collected from men and women were analyzed separately. The self-advantage effect in the hand laterality judgment task was not revealed, suggesting that only two orientation conditions are not enough to trigger this motor simulation. Furthermore, the men’s group showed a significant positive correlation between AQ scores and reaction times in the laterality judgment task, while the women’s group showed a significant negative correlation between AQ scores and differences in RTs and a significant positive correlation between BAS-2 scores and dprime in the self-other discrimination task. These results suggest that men and women differentially adopt specific strategies and/or execution processes for implicit and explicit hand recognition tasks. (shrink)

Diagrams have played an important role throughout the entire history of differential equations. Geometrical intuition, visual thinking, experimentation on diagrams, conceptions of algorithms and instruments to construct these diagrams, heuristic proofs based on diagrams, have interacted with the development of analytical abstract theories. We aim to analyze these interactions during the two centuries the classical theory of differential equations was developed. They are intimately connected to the difficulties faced in defining what the solution of a differential equation is and (...) in describing the global behavior of such a solution. (shrink)

It is common to account for our senses on the basis of our sensory organs. One way of glossing why Aristotle famously counted five senses—and why his count became common sense in the West and elsewhere—is because there are five rather obvious organs of sense. In more modern accounts, this organ criterion of the senses has transformed into a neurobiological criterion; that is to say, part of what it means to be a sense is to have an associated organ with (...) appropriate physiological properties. For example, part of the claim that humans have a sense of vision is that we have a non-vestigial organ (the eye) that has cells (photoreceptors) especially sensitive to the properties of electromagnetic radiation. However, the nature of this “organ criterion” is a point of some contention. Is it a sufficient criterion? Necessary? To be called “vision” need the organ mediating it give rise to “visual experiences”? This chapter will consider the neurobiological criterion as it was originally presented in Aristotle and later reconceptualized in 19th-century neurophysiologist Johannes Müller’s “Law of Specific Nerve Energies.” By understanding the role of neurobiology in these accounts, we will be able to explore the deficiencies of contemporary accounts that downplay neurobiology in differentiating the senses. We will consider one of these accounts in detail: Alva Noë’s recent arguments in favor of an enactive approach to perceptual psychology. (shrink)

East Asians and Westerners differ in various aspects of perception and cognition. For example, visual memory for East Asians is believed to be more influenced by the contextual aspects of a scene than is the case for Westerners (Masuda & Nisbett, 2001). There are also differences in visual search: for Westerners, search for a long line among short is faster than for short among long, whereas this difference does not appear to hold for East Asians (Ueda et al., (...) submitted). However, it is unclear how these group-level differences originate. To investigate the extent to which they depend upon environment, we tested visual search and visual memory in East Asian immigrants who had lived in Canada for different amounts of time. Recent immigrants were found to exhibit no search asymmetry, unlike Westerners who had spent their lives in Canada. However, immigrants who had lived in Canada for more than two years showed performance comparable to that of Westerners. These differences could not be explained by the general analytic/holistic processing distinction believed to differentiate Westerners and East Asians, since all observers showed a strong holistic tendency for visual recognition. Results instead support the suggestion that exposure to a new environment can significantly affect the particular processes used to perceive a given stimulus. (shrink)

A number of recent studies have documented rapid changes in behavioural sensory acuity induced by aversive learning in the olfactory and auditory modalities. The effect of aversive learning on the discrimination of low-level features in the visual system of humans remains unclear. Here, we used a psychophysical staircase procedure to estimate discrimination thresholds for oriented grating stimuli, before and after differential aversive learning. We discovered that when a target grating orientation was conditioned with an aversive loud noise, it subsequently (...) led to an improvement of discrimination acuity in nearly all subjects. However, no such change was observed in a control group conditioned to an orientation shifted by ±90° from the target. Our findings cannot be explained by contextual learning or sensitisation factors. The results converge with those reported in the olfactory modality and provide further evidence that early sensory systems can be rapidly modified by recently experienced reinforcement histories. (shrink)

This book was put together over the course of the past three years and is the outcome of the author’s publications in the multimodal advertising rhetoric research field and projects that were undertaken with the employment of the //rhetor.dixit//© model. It features four chapters that span different, yet interlocking aspects of ad texts’ multimodal rhetorical configuration and culminates in a practical guide for the analysis of the verbo-visual rhetorical structure of TV ad texts, based on the unique methodology of (...) the //rhetor.dixit//© model on offer by //disruptiVesemiOtics//. //rhetor.dixit//: Understanding ad texts’ rhetorical structure for differential figurative advantage neither seeks to cover exhaustively issues in any of the traditional fields of concern to the discipline of rhetoric (an impossible endeavor, indeed, within the contours of a single book), nor to address all issues on top of the current agenda in multimodal advertising rhetoric. Its mission is to present key facets of current research in multimodal advertising discourse, largely dispersed and spread out in multiple disciplines, including semiotics, in such a manner as to enable the reader to get to grips with the benefits that stem from employing a content analytic approach for the ongoing management of the modes of rhetorical configuration of advertising texts. The combination of an interpretivist approach with the methodical outlook yielded by content analysis affords to transform multimodal rhetorical analysis of advertising texts from a theoretical enterprise geared towards making sense of how meaning emerges through the figurative language of advertising to a systematic method for managing advertising textuality, in such a manner as to enable practitioners in marketing related disciplines (e.g., account planning, marketing research, brand management) to actively manage how brand meaning is generated through distinctive modes of rhetorical configuration. The managerial orientation of the //rhetor.dixit//© model is intended to enhance understanding as to how a brand’s intellectual capital is configured and, moreover, to point to directions whereby what I call a brand’s figurative first mover advantage and differential figurative advantages may be furnished to a brand’s discourse. The systematic understanding of a brand’s distinctive modes of rhetorical configuration is not just a ‘nice-to-have’ add-on in a metrics dashboard, but a prerequisite for managing brands as constellations of figurative elements and modes of connectivity among figurative elements, which are part and parcel of a brand’s textual essence. (shrink)

Individuals often describe objects in their world in terms of perceptual dimensions that span a variety of modalities; the visual (e.g., brightness: dark–bright), the auditory (e.g., loudness: quiet–loud), the gustatory (e.g., taste: sour–sweet), the tactile (e.g., hardness: soft vs. hard) and the kinaesthetic (e.g., speed: slow–fast). We ask whether individuals use perceptual dimensions to differentiate emotions from one another. Participants in two studies (one where respondents reported on abstract emotion concepts and a second where they reported on specific emotion (...) episodes) rated the extent to which features anchoring 29 perceptual dimensions (e.g., temperature, texture and taste) are associated with 8 emotions (anger, fear, sadness, guilt, contentment, gratitude, pride and excitement). Results revealed that in both studies perceptual dimensions differentiate positive from negative emotions and high arousal from low arousal emotions. They also differentiate among emotions that are similar in arousal and valence (e.g., high arousal negative emotions such as anger and fear). Specific features that anchor particular perceptual dimensions (e.g., hot vs. cold) are also differentially associated with emotions. (shrink)

In marketing, the use of visual-art-based designs on products or packaging crucially impacts consumers’ decision-making when purchasing. While visual art in product packaging should be designed to induce consumer’s favorable evaluations, it should not evoke excessive affective arousal, because this may lead to the depletion of consumer’s cognitive resources. Thus, consumers may use heuristic decision-making and commit an inadvertent mistake while purchasing. Most existing studies on visual arts in marketing have focused on preference using subjective evaluations. To (...) address this, we applied a neuroscientific measure, electroencephalogram to increase experimental validity. Two successive tasks were designed to examine the effects of affective arousal and affective valence, evoked by visual artwork, on the consecutive cognitive decision-making. In task 1, to evaluate the effect of visual art, EEG of two independent groups of people was measured when they viewed abstract artwork. The abstract art of neoplasticism group was showing Mondrian’s artwork, while the abstract art of expressionism group viewed Kandinsky’s artwork. The neoplasticism movement strove to eliminate emotion in art and expressionism to express the feelings of the artist. Building on Gallese’s embodied simulation theory, AbNP and AbEX artworks were expected to induce lower and higher affect, respectively. In task 2, we investigated how the induced affect differentially influenced a succeeding cognitive Stroop task. We anticipated that the AbEX group would deplete more cognitive resources than AbNP group, based on capacity limitation theory. Significantly stronger affect was induced in the AbEX group in task 1 than in the AbNP group, especially in affective arousal. In task 2, the AbEX group showed a faster reaction time and higher error rate in the Stroop task. According to our hypotheses, the higher affective arousal state of the AbEX group might deplete more cognitive resources during task 1 and result in poorer performance in task 2 because affect impacted their cognitive resources. This is the first study using neuroscientific measures to prove that high affective arousal induced by visual arts on packaging may induce heuristic decision-making in consumers, thereby advancing our understanding of neuromarketing. (shrink)

We tested whether cognitive fusion impairs emotion differentiation and thereby mediates relations between cognitive fusion and depression and panic symptoms among 55 adults, 50.9% women). Using visual stimuli, we elicited multiple emotion states and measured emotional intensity – the subjective emotion intensity of elicited emotions, as well as emotional differentiation – the degree of co-activation of multiple negative emotions when a specific emotion was elicited. First, as hypothesised, we found that cognitive fusion predicted lower levels of emotion (...) differentiation. In contrast, as hypothesised, these effects were significantly greater than the effects of cognitive fusion on emotion intensity. Second, as predicted, MECA, but not SEI, predicted depression and panic symptoms. Finally, we found that MECA mediated the effects of cognitive fusion on depression and panic symptoms. The present findings contribute novel, preliminary empirical insight into associations between cognitive fusion, impaired emotion differentiation and mental ill-health. (shrink)

Journal Name: Semiotica Issue: Ahead of print.

Awareness is a personal experience, which is only accessible to the rest of world through interpretation. We set out to identify a neural correlate of visual awareness, using brief subliminal and supraliminal verbal stimuli while measuring cerebral blood flow distribution with H215O PET. Awareness of visual verbal stimuli differentially activated medial parietal association cortex (precuneus), which is a polymodal sensory cortex, and dorsolateral prefrontal cortex, which is thought to be primarily executive. Our results suggest participation of these higher (...) order perceptual and executive cortical structures in visual verbal awareness. (shrink)

Highly mobile computing devices promise to improve quality of life, productivity, and performance. Increased situation awareness and reduced mental workload are two potential means by which this can be accomplished. However, it is difficult to measure these concepts in the ‘wild’. We employed an ultra-portable battery operated and wireless functional near infrared spectroscopy (fNIRS) to non-invasively measure hemodynamic changes in the brain’s prefrontal cortex. Measurements were taken during navigation of a college campus with either a hand-held display, or an augmented (...) reality wearable display. Hemodynamic measures were also paired with secondary tasks of visual perception and auditory working memory to provide behavioral assessment of situation awareness and mental workload. Navigating with an augmented reality wearable display produced the least workload during both secondary tasks. The hemodynamics associated with errors were also different between the two devices. Errors with an augmented reality wearable display were associated with increased prefrontal activity and the opposite was observed for the hand-held display. This suggests that the cognitive mechanisms underlying errors between the two devices differ. These findings show fNIRS is a valuable tool for assessing new technology in ecologically valid settings and that head-mounted displays offer benefits with regards to mental workload while navigating, and potentially superior situation awareness with improved display design. (shrink)

The human experience is shaped by information from different perceptual channels, but it is still debated whether and how differential experience influences language use. To address this, we compared congenitally blind, blindfolded, and sighted people's descriptions of the same motion events experienced auditorily by all participants (i.e., via sound alone) and conveyed in speech and gesture. Comparison of blind and sighted participants to blindfolded participants helped us disentangle the effects of a lifetime experience of being blind versus the task-specific effects (...) of experiencing a motion event by sound alone. Compared to sighted people, blind people's speech focused more on path and less on manner of motion, and encoded paths in a more segmented fashion using more landmarks and path verbs. Gestures followed the speech, such that blind people pointed to landmarks more and depicted manner less than sighted people. This suggests that visual experience affects how people express spatial events in the multimodal language and that blindness may enhance sensitivity to paths of motion due to changes in event construal. These findings have implications for the claims that language processes are deeply rooted in our sensory experiences. (shrink)

Participants who were unable to detect familiarity from masked 17 ms faces did report a vague, partial visual percept. Two experiments investigated the relative strength of the visual percept generated by famous and unfamiliar faces, using masked 17 ms exposure. Each trial presented simultaneously a famous and an unfamiliar face, one face in LVF and the other in RVF. In one task, participants responded according to which of the faces generated the stronger visual percept, and in the (...) other task, they attempted an explicit familiarity decision. The relative strength of the visual percept of the famous face compared to the unfamiliar face was moderated by response latency and participants’ attitude towards the famous person. There was also an interaction of visual field with response latency, suggesting that the right hemisphere can generate a visual percept differentiating famous from unfamiliar faces more rapidly than the left hemisphere. Participants were at chance in the explicit familiarity decision, confirming the absence of awareness of facial familiarity. (shrink)

The number of studies examining visual perspective during retrieval has recently grown. However, the way in which perspective has been conceptualized differs across studies. Some studies have suggested perspective is experienced as either a first-person or a third-person perspective, whereas others have suggested both perspectives can be experienced during a single retrieval attempt. This aspect of perspective was examined across three studies, which used different measurement techniques commonly used in studies of perspective. Results suggest that individuals can experience more (...) than one perspective when recalling events. Furthermore, the experience of the two perspectives correlated differentially with ratings of vividness, suggesting that the two perspectives should not be considered in opposition of one another. We also found evidence of a gender effect in the experience of perspective, with females experiencing third-person perspectives more often than males. Future studies should allow for the experience of more than one perspective during retrieval. (shrink)