How does sign language compare with gesture, on the one hand, and spoken language on the other? Sign was once viewed as nothing more than a system of pictorial gestures without linguistic structure. More recently, researchers have argued that sign is no different from spoken language, with all of the same linguistic structures. The pendulum is currently swinging back toward the view that sign is gestural, or at least has gestural components. The goal of this review is to elucidate (...) the relationships among sign language, gesture, and spoken language. We do so by taking a close look not only at how sign has been studied over the past 50 years, but also at how the spontaneous gestures that accompany speech have been studied. We conclude that signers gesture just as speakers do. Both produce imagistic gestures along with more categorical signs or words. Because at present it is difficult to tell where sign stops and gesture begins, we suggest that sign should not be compared with speech alone but should be compared with speech-plus-gesture. Although it might be easier (and, in some cases, preferable) to blur the distinction between sign and gesture, we argue that distinguishing between sign (or speech) and gesture is essential to predict certain types of learning and allows us to understand the conditions under which gesture takes on properties of sign, and speech takes on properties of gesture. We end by calling for new technology that may help us better calibrate the borders between sign and gesture. (shrink)

The book represents a historical overview of the way the topic of gesture and sign language has been treated in the 18th century French philosophy. The texts treated are grouped into several categories based on the view they present of deafness and gesture. While some of those texts obviously view deafness and sign language in negative terms, i.e. as deficiency, others present deafness essentially as difference, i.e. as a set of competences that might provide some insights into how spoken language (...) works. One of the arguments of the book is that these two views of deafness and sign language still represent two dominant paradigms present in the current debates on the issue. The aim of the book, therefore, is not only to provide a historical overview but to trace what might be called a "history of the present". (shrink)

Speakers frequently perform representational gestures to depict concepts in an iconic fashion. For example, a speaker may hold her index finger and thumb apart to indicate the size of a matchstick. However, the process by which a physical handshape is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which we call “gesture form.” We provide quantitative (...) evidence for several key properties that play a role in this process. First, “profiling,” the ability to focus on a structural subunit within the complex form of the physical hand. Second, “perspective,” for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity,” the fact that gestures focus on specific spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible. (shrink)

In spoken languages, children acquire locative terms in a cross‐linguistically stable order. Terms similar in meaning to in and on emerge earlier than those similar to front and behind, followed by left and right. This order has been attributed to the complexity of the relations expressed by different locative terms. An additional possibility is that children may be delayed in expressing certain spatial meanings partly due to difficulties in discovering the mappings between locative terms in speech and spatial relation they (...) express. We investigate cognitive and mapping difficulties in the domain of spatial language by comparing how children map spatial meanings onto speech versus visually motivated forms in co‐speech gesture across different spatial relations. Twenty‐four 8‐year‐old and 23 adult native Turkish‐speakers described four‐picture displays where the target picture depicted in‐on, front‐behind, or left‐right relations between objects. As the complexity of spatial relations increased, children were more likely to rely on gestures as opposed to speech to informatively express the spatial relation. Adults overwhelmingly relied on speech to informatively express the spatial relation, and this did not change across the complexity of spatial relations. Nevertheless, even when spatial expressions in both speech and co‐speech gesture were considered, children lagged behind adults when expressing the most complex left‐right relations. These findings suggest that cognitive development and mapping difficulties introduced by the modality of expressions interact in shaping the development of spatial language. (shrink)

How do teachers’ gestures influence students’ learning? This article reviews research investigating the role of gestures in communication, focusing on teachers’ communication with their students, primarily in mathematics and science instruction. We first briefly consider gesture's role in communication more generally as a backdrop for considering teaching as a special context for communication. We then describe teachers’ spontaneous gesturing in teaching contexts, and we consider how teachers’ spontaneous gestures might influence students’ learning. We then consider experimental studies (...) that provide causal support for the effects of teachers’ gestures on students’ learning. We conclude by discussing future directions and implications for educational practice. (shrink)

Gestures’ Contribution to Collective Metaphorical Thinking in a Community of Philosophical Inquiry (CPI). This paper explores an idea expressed by a student discussing where our thoughts come from: to think we have to move our hands. Such sentence echoes the literature on the role of gesture for thinking. This study also focuses on the collective advancement of reasoning in a CPI. The instructor chooses to conclude by asking each student to suggest an analogy of thinking. This closing sequence reveals (...) how the instructor, through metaphorical gestures, fosters collective awareness of new propositions, and their further elaboration. After characterizing the cognitive models so produced, video analysis is used to follow their collective, verbal and gestural construction along the discussion. (shrink)

This study aims to corroborate Merleau-Ponty’s interpretations of fundamental ideas from Saussure’s linguistics by linking them to works that were independently elaborated by Jan Mukařovský, Czech structuralist aesthetician and literary theorist. I provide a comparative analysis of the two authors’ theories of language and their interpretations of thought as fundamentally determined by language. On this basis, I investigate how they conceive linguistic innovation and its translation into changes in the constituted language and other social codes and institutions. I explain how (...) they elaborate on Saussure’s idea of language as a system of oppositions by interpreting cultural innovation as a systematic variation of pre-established social norms and, similarly, linguistic innovation as gesturing within language. Connectedly, I show how Mukařovský’s works help clarify Merleau-Ponty’s focus on the gestural dimension of language. By discussing the two thinkers’ arguments in favour of linguistic innovation, I explore what could be called phenomenological limits of structuralism. (shrink)

The ubiquitous human practice of spontaneously gesturing while speaking demonstrates the embodiment, embeddedness, and sociality of cognition. The present essay takes gestural practice to be a paradigmatic example of a more general claim: human cognition is social insofar as our embedded, intelligent, and interacting bodies select and construct meaning in a way that is intersubjectively constrained and defeasible. Spontaneous co-speech gesture is markedly interesting because it at once confirms embodied aspects of linguistic meaning-making that formalist and linguistic turn-type philosophical approaches (...) fail to appreciate, and it also forefronts intersubjectivity as an inherent and inherently normative dimension of communicative action. Co-speech hand gestures, as linguistically meaningful speech acts, demonstrate both sedimentation and spontaneity (in the sense of Maurice Merleau-Ponty’s dialectic of linguistic expression ( 2002 )), or features of convention and nonconvention in a Gricean sense ( 1989 ). Yet neither pragmatic nor classic phenomenological approaches to communication can accommodate the practice of co-speech hand gesturing without some rehabilitation and reorientation. Pragmatic criteria of intersubjectivity, normativity, and rationality need to confront the non-propositional and nonverbal meaning-making of embodied encounters. Phenomenological treatments of expression and intersubjectivity must consider the normative nature of high-order social practices like language use. Reciprocally critical exchanges between these traditions and gesture studies yield an improved philosophy that treats language as a multi-modal medium for collaborative meaning achievement. The proper paradigm for these discussions is found in enactive approaches to social cognition. Co-speech hand gestures are first and foremost emergent elements of social interaction, not the external whirring of an isolated internal consciousness. In contrast to current literature that frequently presents gestures as uncontrollable bodily upsurge or infallible imagistic phenomenon that drives and dances with verbal or “linguistic” convention (McNeill 1992 , 2005 ), I suggest that we study gestures as dynamic, embodied, and shared tools for collaborative sense-making. (shrink)

There has long been interest in why languages are shaped the way they are, and in the relationship between sign language and gesture. In sign languages, entity classifiers are handshapes that encode how objects move, how they are located relative to one another, and how multiple objects of the same type are distributed in space. Previous studies have shown that hearing adults who are asked to use only manual gestures to describe how objects move in space will use (...) class='Hi'>gestures that bear some similarities to classifiers. We investigated how accurately hearing adults, who had been learning British Sign Language for 1–3 years, produce and comprehend classifiers in locative and distributive constructions. In a production task, learners of BSL knew that they could use their hands to represent objects, but they had difficulty choosing the same, conventionalized, handshapes as native signers. They were, however, highly accurate at encoding location and orientation information. Learners therefore show the same pattern found in sign-naïve gesturers. In contrast, handshape, orientation, and location were comprehended with equal accuracy, and testing a group of sign-naïve adults showed that they too were able to understand classifiers with higher than chance accuracy. We conclude that adult learners of BSL bring their visuo-spatial knowledge and gestural abilities to the tasks of understanding and producing constructions that contain entity classifiers. We speculate that investigating the time course of adult sign language acquisition might shed light on how gesture became conventionalized during the genesis of sign languages. (shrink)

As a speculative and abstract discipline, philosophy is traditionally considered to be in dialectical tension with physical experience and daily practice. In contrast to this conventional and idealistic perspective, and in line with aesthetics as embodied knowledge, this article attempts to show that not only do we constantly think via gestures, movements, and physical experiences but also that there is no need to disconnect a concept from practice. Passing from Wittgenstein’s idea of “form of life” to the pragmatist aesthetics (...) initiated by Dewey’s idea of “art as experience,” I propose an analysis of the philosophical framework of postmodern dance (Yvonne Rainer) and of Happenings (Allan Kaprow), in order to underline the theoretical and conceptual research that is already at work in the field of contemporary art practice, the latter being understood as a sensorial dimension intrinsically linked to ordinary life. My general argument is that gestures, which are an inescapable and vital part of everyday life, can be foregrounded by certain artistic practices without corrupting or theatricalizing their ordinariness. (shrink)

This study examines the form and function of gestural depictions that develop over extended stretches of concept explanation by a philosopher. Building onStreeck’s (2009)explorations of depiction by gesture, we examine how this speaker’s process of exposition involves sequences of multimodal, analogical depiction by which the philosophical concepts are not only expressed through gesture forms, but also dynamically analyzed and construed through gestural activity. Drawing on perspectives of gesture as active meaning making (Müller 2014,2016,Streeck 2009), we argue that the build-up of (...) gestures in depiction sequences, activated through a multimodal metaphor (Müller & Cienki 2009), engages the wider philosophical standpoint of the speaker. Using video analysis supported by interview data, we demonstrate how examination of gestures within and across discourse can lead to understanding of how dynamic, embodied, and subjective processes of conceptualization contribute to philosophical theorizing. (shrink)

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration (...) of gestures was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

Gestures can serve as external representations of abstract concepts which may be otherwise difficult to illustrate. Gestures often accompany verbal statement as an embodiment of mental models that augment the communication of ideas, concepts or envisioned shapes of products. A gesture is also an indicator of the subject and context of the issue under discussion. We argue that if gestures can be identified and formalized they can be used as a knowledge indexing and retrieval tool and can (...) prove to be useful access point into unstructured digital video data. We present a methodology and a prototype, called I-Gesture that allows users to (1) define a vocabulary of gestures for a specific domain, (2) build a digital library of the gesture vocabulary, and (3) mark up entire video streams based on the predefined vocabulary for future search and retrieval of digital content from the archive. I-Gesture methodology and prototype are illustrated through scenarios where it can be utilized. The paper concludes with results of evaluation experiments with I-Gesture using a test bed of design-construction projects. (shrink)

Gestures is a collection of essays that proposes a daring and ambitious new conception of human behavior. Defining gesture as “a movement of the body or of a tool attached to the body for which there is no satisfactory causal explanation,” Flusser moves around the topic from different points of view, angles and distances: sometimes he zooms in on a modest, ordinary movement like taking a photograph, shaving, or smoking a pipe. Sometimes he pulls back to look at something (...) as vast and varied as human “making,” embracing everything from the fashioning of simple tools to mass manufacturing. Holding firmly to basic phenomenological principles – that consciousness is always consciousness of something, that we know others by reference to ourselves, he claims that we constantly “read” states of mind, i.e. thoughts, intentions, emotions, from gestures; still we lack a theory about how this happens. Gestures takes a first step. It offers alternatives to theories by now so veiled by habit and myth that we are hardly conscious of them, and so hardly realize that they are failing. These include the assumption that we can “know” something without being affected by it, the belief that science is value-free, and the common conviction that science and art are fundamentally different activities. (shrink)

This article proposes an analysis of the gestural production of people suffering from fluent or non-fluent aphasia in comparison with the gestures performed by speakers not suffering from any language disorder. The interest of such a study is twofold: firstly, it allows a better understanding of what happens to gestures during the numerous speech dysfluencies caused by the speech impairment. Among other things, it sheds light on the links between speech and gestures in multimodal face-to-face interaction. Despite (...) the profusion of work on aphasia, very little is still known about the characteristics of the gestures performed spontaneously by aphasic people. The study presented here is based on video examples from the AphasiaBank corpus to illustrate the specific features of the speech and gestures of atypical speakers and gives a more detailed description of the gestural production of people with aphasia. This knowledge can inform post-stroke rehabilitation procedures that rely on some form of multimodal speech therapy in order to adapt to the various communication needs of the patients. (shrink)

People frequently gesture when a word is on the tip of their tongue (TOT), yet research is mixed as to whether and why gesture aids lexical retrieval. We tested three accounts: the lexical retrieval hypothesis, which predicts that semantically related gestures facilitate successful lexical retrieval; the cognitive load account, which predicts that matching gestures facilitate lexical retrieval only when retrieval is hard, as in the case of a TOT; and the motor movement account, which predicts that any motor (...) movements should support lexical retrieval. In Experiment 1 (a between‐subjects study; N = 90), gesture inhibition, but not neck inhibition, affected TOT resolution but not overall lexical retrieval; participants in the gesture‐inhibited condition resolved fewer TOTs than participants who were allowed to gesture. When participants could gesture, they produced more representational gestures during resolved than unresolved TOTs, a pattern not observed for meaningless motor movements (e.g., beats). However, the effect of gesture inhibition on TOT resolution was not uniform; some participants resolved many TOTs, while others struggled. In Experiment 2 (a within‐subjects study; N = 34), the effect of gesture inhibition was traced to individual differences in verbal, not spatial short‐term memory (STM) span; those with weaker verbal STM resolved fewer TOTs when unable to gesture. This relationship between verbal STM and TOT resolution was not observed when participants were allowed to gesture. Taken together, these results fit the cognitive load account; when lexical retrieval is hard, gesture effectively reduces the cognitive load of TOT resolution for those who find the task especially taxing. (shrink)

Recent studies in human and nonhuman primates demonstrate that auditory objects, including speech sounds, are identified in anterior superior temporal cortex projecting directly to inferior frontal regions and not along a posterior pathway, as classically assumed. By contrast, the role of posterior temporal regions in speech and language remains largely unexplained, although a concept of vocal gestures may be helpful.

Gestures of Grace is a celebration of the life and career of Robert Sweetman, H. Evan Runner Chair in the History of Philosophy at the Institute for Christian Studies (2001–present). These essays, written by students and colleagues, testify to the remarkable breadth and depth of Sweetman’s research and teaching, from his early scholarly career at the Pontifical Institute of Medieval Studies to his time at ICS. Throughout the volume, there is extensive engagement with Sweetman’s influential historical scholarship on topics (...) such as the emergence and development of the Dominican order in the twelfth and thirteenth centuries, medieval women authors, Thomas Aquinas and Duns Scotus, and indeed on Sweetman’s own systematic contribution to the nature and promise of Christian scholarship today. (shrink)

The paper deals with the theory of gesture from the point of view of relational sociology. On the one hand, the thesis of the ‘complete gesture’ developed by Giovanni Maddalena is appreciated as a significant step forward from classical pragmatism. On the other hand, since theories based essentially on phenomenology and semiotics are at risk of nominalism and constructivism, if we want to understand the gesture from a critical realistic perspective, we need to complement the theory of gesture with a (...) relational social ontology. This means that the theory of the gesture as action (unit act) must be placed within an ontological and epistemological framework, in which Peirce’s triangle is related to the latent value of the real as indicated by the sign. A relational alternative to Peirce's semiotic triangle is presented here with the aim of connecting the sign of the gesture to the underlying reality. (shrink)

In this paper I propose to read and understand gestures as logical tools within a synthetic paradigm of knowledge. This interpretation of gesture is drawn from a new pragmatist reading of reasoning in general, and synthetic reasoning in particular. Complete gestures are actions with a beginning and an end that bear a meaning. It is our regular way to embody vague ideas into singular actions with general meaning. The tool is forged by a dense blending of icons, indices, (...) and symbols and by a complexity of phenomenological characteristics as feelings, actual actions, general concepts and habits. The paper illustrates this new way to look at gestures and different kinds of complete and incomplete gestures. (shrink)

Social cognition researchers have become increasingly interested in the ways that behavioral, physiological, and neural coupling facilitate social interaction and interpersonal understanding. We distinguish two ways of conceptualizing the role of such coupling processes in social cognition: strong and moderate interactionism. According to strong interactionism (SI), low-level coupling processes are alternatives to higher-level individual cognitive processes; the former at least sometimes render the latter superfluous. Moderate interactionism (MI) on the other hand, is an integrative approach. Its guiding assumption is that (...) higher-level cognitive processes are likely to have been shaped by the need to coordinate, modulate, and extract information from low-level coupling processes. In this paper, we present a case study on Möbius Syndrome (MS) in order to contrast SI and MI. We show how MS—a form of congenital bilateral facial paralysis—can be a fruitful source of insight for research exploring the relation between high-level cognition and low-level coupling. Lacking a capacity for facial expression, individuals with MS are deprived of a primary channel for gestural coupling. According to SI, they lack an essential enabling feature for social interaction and interpersonal understanding more generally and thus ought to exhibit severe deficits in these areas. We challenge SI’s prediction and show how MS cases offer compelling reasons for instead adopting MI’s pluralistic model of social interaction and interpersonal understanding. We conclude that investigations of coupling processes within social interaction should inform rather than marginalize or eliminate investigation of higher-level individual cognition. (shrink)

Empirical studies of gesture in a subject who has lost proprioception and the sense of touch from the neck down show that specific aspects of gesture remain normal despite abnormal motor processes for instrumental movement. The experiments suggest that gesture, as a linguistic phenomenon, is not reducible to instrumental movement. They also support and extend claims made by Merleau-Ponty concerning the relationship between language and cognition. Gesture, as language, contributes to the accomplishment of thought.

A beneficial effect of gesture on learning has been demonstrated in multiple domains, including mathematics, science, and foreign language vocabulary. However, because gesture is known to co-vary with other non-verbal behaviors, including eye gaze and prosody along with face, lip, and body movements, it is possible the beneficial effect of gesture is instead attributable to these other behaviors. We used a computer-generated animated pedagogical agent to control both verbal and non-verbal behavior. Children viewed lessons on mathematical equivalence in which an (...) avatar either gestured or did not gesture, while eye gaze, head position, and lip movements remained identical across gesture conditions. Children who observed the gesturing avatar learned more, and they solved problems more quickly. Moreover, those children who learned were more likely to transfer and generalize their knowledge. These findings provide converging evidence that gesture facilitates math learning, and they reveal the potential for using technology to study non-verbal behavior in controlled experiments. (shrink)

Gestures are a special sort of action. They communicate the individual's moods and desires to the world and they operate under different psychological and cognitive constraints to other actions. The connections between gesture and language - spoken and signed - pose some fascinating questions. How intimately are gesture and language connected? Did one evolve from the other? To what extent are they similarly processed in the brain? In what ways are signed languages akin to spoken language and gestures? (...) Gesture, Speech, and Sign examines these questions, bringing together an international array of expertise to explore the origins, neurobiology, and uses of these three communication systems. A unique feature of the book is its discussion of how a greater understanding of these issues can be used to improve human-computer interactions. Designed to appeal to a multi-disciplinary audience Gesture, Speech, and Sign will be of interest to advanced students and researchers in neuroscience, psychology, linguistics, computer science, and those involved in deaf studies. (shrink)

In debates about the proper analysis of demonstrative expressions, ostensive gestures and speaker intentions are often seen as competing for primary importance in securing reference. Underlying some of these debates is the mistaken assumption that ostensive gestures always make the demonstrated object maximally salient to interlocutors. When we abandon this assumption and focus on an object’s mutually-recognized salience itself, rather than on how the object came to be salient, we can work towards a more promising analysis with a (...) uniform treatment of demonstrative reference whether or not there is an ostensive gesture, and whether reference is ordinary or deferred. (shrink)

“Thought requires achievement for its own development, and without this development it is nothing. Thought must live and grow in incessant new and higher translations, or it proves itself not to be genuine thought.” – C. S. Peirce (CP 5.595) Introduction: Captivating Pictures and Liberating Gestures At the center of one of the most famous anecdotes involving a famous philosopher, we encounter what is commonly called in English a gesture, in fact, a Neapolitan gesture, though one made by a (...) Tur... (shrink)

When authors act by either publishing or non-publishing their texts, they sometimes use a language of gestures. These gestures can assist to position the author in the intellectual field. In this way some German eighteenth-century philosophers who thought against the grain of mainstream rationalism withdrew from the public sphere, using the image of the Egyptian god Harpocrates, who puts his index finger to his lips—a symbol for maintaining silence. In a sense one can thus label this kind of (...) quietism as “harpocratism.” The essay examines the imagery and contextualizes it in three case studies from the years 1720-50. Moreover, it explores its sources in political as well as antiquarian and hermetic discourses of the sixteenth and seventeenth centuries. The essay serves as a model for defining intellectual positions not so much by their content, but rather by their practices of symbolic distancing from others, of building identities in emotional communities, and of shaping free zones of inquiry where they could flourish. (shrink)

The goal of the article is to offer a framework against which relations between gesture and sign can be systematically explored beyond the current literature. It does so by (a) reconstructing the history of the discussion in the field of gesture studies, focusing on three leading positions (Kendon, McNeill, and Goldin-Meadow); and (b) by formulating a position to illustrate how this can be achieved. The paper concludes by emphasizing the need for systematic cross-linguistic research on multimodal use of language in (...) its signed and spoken forms. (shrink)

Susan Goldin-Meadow is the 2021 Recipient of the Rumelhart Prize. Goldin-Meadow's body of research addresses the roles of gesture in language creation, communication, learning, and cognition. In one major strand of her research, Goldin-Meadow has studied gestures in children who are not exposed to any structured language input, specifically, deaf children of hearing parents who do not expose their children to sign language. These children create a highly structured, language-like system with their hands—a homesign. In another major strand, Goldin-Meadow (...) has focused on the gestures that people produce along with speech. She has examined how gestures contribute to producing and comprehending language at the moment of speaking or signing, how gestures contribute to learning language and to learning other concepts and skills, and how gestures may actually constitute and change people's thinking. This topic collection is made up of papers that represent and extend these strands of Goldin-Meadow's work. This introductory article provides a brief biography of Goldin-Meadow, and it highlights ways in which the contributions to the topic collection exemplify several notable characteristics of Goldin-Meadow's body of work, including (1) a focus on multiple timescales of behavior and behavior change; (2) use of diverse methods, approaches, and populations; and (3) considerations of equity and inclusion, both in research and in educational and clinical practice. (shrink)

Developed through a series of conceptual analyses (Edmund Husserl, Vilém Flusser, Ludwig Wittgenstein and Walter Benjamin) and case studies (Fernando Lopes’s Belarmino and Jeff Wall’s Mimic), this article delves into the relationship between gesture, attunement and atmosphere and how it unfolds in photographic works dealing with urban space. The first section focuses on the role played by photography in the film Belarmino, which raises questions about both the representation of urban phenomena and issues related to expression and gesture in boxing. (...) The second section discusses Husserl’s thinking on image consciousness and his surprising reference to a “photograph” of a boxer, which reveals the relevance of his phenomenological approach when it comes to defining the aesthetic properties of gesture-images. The third section examines the principles of Flusser’s philosophy of gestures, focusing on the semantic field of attunement and its connection with various elements related to photography, gesture, moods and affects. The question of gesture in photography—both the gestures of the photographed and those of the photographer—can be articulated with the notions of attunement and atmosphere, which go beyond semiological, psychological and communicational approaches and are important for our understanding of aesthetic and artistic experiences. Finally, if photography is a privileged way of studying atmospheres and gestures (as suggested by the Benjaminian notion of optical unconscious) and their connection with the inner life of the subject, in relation to urban space this study often acquires an intersubjective, social and political dimension, as in Jeff Wall’s Mimic. (shrink)

Throughout his career, the influential new media theorist Vilém Flusser kept the idea of gesture in mind: that people express their being in the world through a sweeping range of movements. He reconsiders familiar actions—from speaking and painting to smoking and telephoning—in terms of particular movement, opening a surprising new perspective on the ways we share and preserve meaning. A gesture may or may not be linked to specialized apparatus, though its form crucially affects the person who makes it. These (...) essays, published here as a collection in English for the first time, were written over roughly a half century and reflect both an eclectic array of interests and a durable commitment to phenomenological thought. Defining gesture as “a movement of the body or of a tool attached to the body for which there is no satisfactory causal explanation,” Flusser moves around the topic from diverse points of view, angles, and distances: at times he zooms in on a modest, ordinary movement such as taking a photograph, shaving, or listening to music; at others, he pulls back to look at something as vast and varied as human “making,” embracing everything from the fashioning of simple tools to mass manufacturing. But whatever the gesture, Flusser analyzes it as the expression of a particular form of consciousness, that is, as a particular relationship between the world and the one who gestures. (shrink)

This paper explores the intertwinement of ontology and history that happened after the idealist turn of Kantian transcendentalism, particularly in classic German idealism and later in American pragmatism. The paper focuses on the less remarked-upon consequence of this intertwinement, namely the possibility of a new reading of history based on changes in concepts and habitual mentality. The paper proposes a new take on historiography that vindicates Hegel’s insight but changes his approach to a pragmatist one, more apt to face historical (...) changes in a technical way and less easily twistable into ideological frameworks. The paper argues that the notion of habit, as phenomenologically and semiotically described by Peirce, is the fundamental cellule of the pragmatist take on the entanglement of history and ontology. The paper elaborates on the notion of habit, singling out a special form of it called “gesture” that can be a useful tool for reading the history of the human spirit without incorporating Hegel’s dialectic and Absolute. The paper compares the notion of gesture as it originated in the pragmatist tradition with the parallel use of the term in the early studies of Michel Foucault and argues that the notion of gesture is better equipped to tackle a theoretical reading of history. (shrink)

David McNeill, a pioneer in the ongoing study of the relationship between gesture and language, here argues that gestures are active participants in both speaking and thinking. He posits that gestures are key ingredients in an “imagery-language dialectic” that fuels speech and thought. The smallest unit of this dialectic is the growth point, a snapshot of an utterance at its beginning psychological stage. In _Gesture and Thought,_ the central growth point comes from a Tweety Bird cartoon. Over the (...) course of twenty-five years, the McNeill Lab showed this cartoon to numerous subjects who spoke a variety of languages, and a fascinating pattern emerged. The shape and timing of gestures depends not only on what speakers see but on what they take to be distinctive; this, in turn, depends on the context. Those who remembered the same context saw the same distinctions and used similar gestures; those who forgot the context understood something different and changed gestures or used none at all. Thus, the gesture becomes part of the growth point—the building block of language and thought. _Gesture and Thought _is an ambitious project in the ongoing study of how we communicate and how language is connected to thought. (shrink)

사진은 사진의 발명 이전의 이미지들과 비교할 때, 무엇을 지시하고 있는지가 너무나 명확하게 드러나 있는 것처럼 보여서, 이미지를 생산한 사람의 의도가 그 이면에 숨겨져 있을 여지가 없는 것으로 여겨졌다. 다시 말해 사진 역시 전통적 그림과 같은 이차원 평면의 이미지이긴 하지만, 전통적 그림의 의미가 다의적(konnotativ)일 수 있는 것과 달리, 사진은 마치 숫자처럼 그 지시대상이 명확한 일의적(denotativ) 이미지로 간주되어왔다. 이는 예술적 측면에서는 특히 회화와 비교되며 폄하되는 요소로 작용해 왔고, 기술적 측면에서는 때때로 과장되게 수용되어 사진을 마치 세상을 투영하고 있는 창문처럼 여기게 하는 근거가 되어왔다.BR빌렘 (...) 플루서(Vilém Flusser)는 이러한 현상에 대해 사진을 전통적 그림과 동일한 존재 층위에 위치시킨 결과로 인한 오해라고 보았다. 이는 이미지와 실재라는 관계항 속에서 새로운 이미지인 사진에 대해, 새로운 존재론적 질문이 제기되어야 함을 의미하는 것이라 하겠다. 기존의 사진 이론들이 사진에 대해 ‘어떻게 실제적으로 사진이 존재하는가’라던지, 혹은 ‘하나의 보편적인 사진 언어가 존재하는가’와 같은 질문에 집중해왔던 것 모두, 사진 의미의 일의성이라는 특징이 전제되어 있기 때문이며, 이러한 전제는 사진이 그 원본과의 관계, 즉 지표성(Indexikalität)이라는 관점에서 해석되어 왔음을 보여주는 예라 하겠다.BR그러나 플루서는 이러한 방식의 사진 이해에 비판적 견해를 가지고서, 사진을 지표성의 관점에서가 아니라, 현상학적 관점에서 관찰하고자 하였다. 그리고 이를 통해 사진을 통한 새로운 철학적 방법론을 모색하고자 하였다. 이는 후설의 현상학적 개념, 예를 들어 지향성이나 판단중지와 같은 개념들을 자신의 사진 철학에 수용함으로써 이뤄졌다.BR이에 본고는 ‘사진 촬영자의 몸짓(fotografische Geste)’ 개념을 통해 플루서가 사진을 지표성이라는 관점에서 벗어나, 어떻게 후설의 현상학에 접목시키고 있는지에 대해서 분석함으로써, 플루서에 의해 시도된 사진에 대한 새로운 철학적 해석에 대해 고찰하는 것을 목적으로 한다. (shrink)

Georges Didi-Huberman, Uprisings (Paris: Gallimard, 2016), 232 pp, ISBN 9782072697296 Georges Didi-Huberman's Uprisings is at once heavy and light. It weaves complex (and sometimes burdensome) political traditions and histories of thought concerned with uprising, rebellion and revolution, with bursts of poetry which, it seems, are meant to take flight off the page like the butterfly tracts that Didi-Huberman so admires. It is also vast in its scale and depth, tracing histories of uprising and rebellion from Atlas, Prometheus and Eve, through (...) to future uprisings which are as yet unknown and, as the author reminds us, endless: 'the uprising is a gesture without end' (p. 17). (shrink)

The framework of depicting put forward byClark (2016)offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American (...) TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. (shrink)

Speakers of different languages (e.g., English vs. Turkish) show a binary split in how they package and order components of a motion event in speech and co‐speech gesture but not in silent gesture. In this study, we focused on Mandarin Chinese, a language that does not follow the binary split in its expression of motion in speech, and asked whether adult Chinese speakers would follow the language‐specific speech patterns in co‐speech but not silent gesture, thus showing a pattern akin to (...) Turkish and English adult speakers in their description of animated motion events. Our results provided evidence for this pattern, with Chinese—as well as English and Turkish—speakers following language‐specific patterns in speech and co‐speech gesture but not in silent gesture. Our results provide support for the “thinking‐for‐speaking” account, namely that language influences thought only during online, but not offline, production of speech. (shrink)

In this paper, I develop a phenomenological investigation of gestures that focuses on their temporal formation and their historical sedimentation. My approach combines a genetic phenomenological analysis with psychoanalytic investigations, to elaborate on the idea of an archeology of gestures that explores the hidden historicity of their fugitive expression and the consistent patterns of their bodily manifestation. The paper examines four aspects of gestures—hovering, exhibition, mimesis, and resistance—in order to question their relationship to truth. In the last (...) part of the paper, I explore the role of gestures in difficult processes of mourning and melancholia, focusing on the somatic incorporation of a lost other in oneself. In the light of these analyses, I propose to consider gestures as bodily archives that speak for cryptic inscriptions of past experiences, whose role is to keep alive a past that we cannot let go but also for emancipatory transitions toward new horizons, where the sense of our experience can finally be conquered as our own. (shrink)

This book demonstrates the vital connection between language and gesture, and why it is critical for research on second language acquisition to take into account the full spectrum of communicative phenomena. The study of gesture in applied linguistics is just beginning to come of age. This edited volume, the first of its kind, covers a broad range of concerns that are central to the field of SLA. The chapters focus on a variety of second-language contexts, including adult classroom and naturalistic (...) learners, and represent learners from a variety of language and cultural backgrounds. Gesture: Second Language Acquisition and Classroom Research is organized in five sections: Part I, Gesture and its L2 Applications, provides both an overview of gesture studies and a review of the L2 gesture research. Part II, Gesture and Making Meaning in the L2, offers three studies that all take an explicitly sociocultural view of the role of gesture in SLA. Part III, Gesture and Communication in the L2, focuses on the use and comprehension of gesture as an aspect of communication. Part IV, Gesture and Linguistic Structure in the L2, addresses the relationship between gesture and the acquisition of linguistic features, and how gesture relates to proficiency. Part V, Gesture and the L2 Classroom, considers teachers’ gestures, students’ gestures, and how students’ interpret teachers’ gestures. Although there is a large body of research on gesture across a number of disciplines including anthropology, communications, psychology, sociology, and child development, to date there has been comparatively little investigation of gesture within applied linguistics. This volume provides readers unfamiliar with L2 gesture studies with a powerful new lens with which to view many aspects of language in use, language learning, and language teaching. (shrink)

During face‐to‐face conversation, transitions between speaker turns are incredibly fast. These fast turn exchanges seem to involve next speakers predicting upcoming semantic information, such that next turn planning can begin before a current turn is complete. Given that face‐to‐face conversation also involves the use of communicative bodily signals, an important question is how bodily signals such as co‐speech hand gestures play into these processes of prediction and fast responding. In this corpus study, we found that hand gestures that (...) depict or refer to semantic information started before the corresponding information in speech, which held both for the onset of the gesture as a whole, as well as the onset of the stroke (the most meaningful part of the gesture). This early timing potentially allows listeners to use the gestural information to predict the corresponding semantic information to be conveyed in speech. Moreover, we provided further evidence that questions with gestures got faster responses than questions without gestures. However, we found no evidence for the idea that how much a gesture precedes its lexical affiliate (i.e., its predictive potential) relates to how fast responses were given. The findings presented here highlight the importance of the temporal relation between speech and gesture and help to illuminate the potential mechanisms underpinning multimodal language processing during face‐to‐face conversation. (shrink)

Gestural viewpoint research suggests that several dimensions determine which perspective a narrator takes, including properties of the event described. Events can evoke gestures from the point of view of a character , an observer , or both perspectives. CVPT and OVPT gestures have been compared to constructed action and classifiers in signed languages. We ask how CA and CL, as represented in ASL productions, compare to previous results for CVPT and OVPT from English-speaking co-speech gesturers. Ten ASL signers (...) described cartoon stimuli from Parrill . Events shown by Parrill to elicit a particular gestural strategy were coded for signers' instances of CA and CL. CA was divided into three categories: CA-torso, CA-affect, and CA-handling. Signers used CA-handling the most when gesturers used CVPT exclusively. Additionally, signers used CL the most when gesturers used OVPT exclusively and CL the least when gesturers used CVPT exclusively. (shrink)

Although Arbib's extension of the mirror-system hypothesis neatly sidesteps one problem with the “gesture-first” theory of language origins, it overlooks the importance of gestures that occur in current-day human linguistic performance, and this lands it with another problem. We argue that, instead of gesture-first, a system of combined vocalization and gestures would have been a more natural evolutionary unit.

In the recent years, gesture recognition based on the surface electromyography (sEMG) signals has been extensively studied. However, the accuracy and stability of gesture recognition through traditional machine learning algorithms are still insufficient to some actual application scenarios. To enhance this situation, this paper proposed a method combining feature selection and ensemble extreme learning machine (EELM) to improve the recognition performance based on sEMG signals. First, the input sEMG signals are preprocessed and 16 features are then extracted from each channel. (...) Next, features that mostly contribute to the gesture recognition are selected from the extracted features using the recursive feature elimination (RFE) algorithm. Then, several independent ELM base classifiers are established using the selected features. Finally, the recognition results are determined by integrating the results obtained by ELM base classifiers using the majority voting method. The Ninapro DB5 dataset containing 52 different hand movements captured from 10 able-bodied subjects was used to evaluate the performance of the proposed method. The results showed that the proposed method could perform the best (overall average accuracy 77.9%) compared with decision tree (DT), ELM, and random forest (RF) methods. (shrink)

For a robot to cohabit with people, it should be able to learn people’s nonverbal social behavior from experience. In this paper, we propose a novel machine learning method for recognizing gestures used in interaction and communication. Our method enables robots to learn gestures incrementally during human–robot interaction in an unsupervised manner. It allows the user to leave the number and types of gestures undefined prior to the learning. The proposed method (HB-SOINN) is based on a self-organizing (...) incremental neural network and the hidden Markov model. We have added an interactive learning mechanism to HB-SOINN to prevent a single cluster from running into a failure as a result of polysemy of being assigned more than one meaning. For example, a sentence: “Keep on going left slowly” has three meanings such as, “Keep on (1)”, “going left (2)”, “slowly (3)”. We experimentally tested the clustering performance of the proposed method against data obtained from measuring gestures using a motion capture device. The results show that the classification performance of HB-SOINN exceeds that of conventional clustering approaches. In addition, we have found that the interactive learning function improves the learning performance of HB-SOINN. (shrink)

More than a century ago, reviewing the raging controversy over pragmatism, Jean Bourdeau wrote that “Pragmatism is an Anglo-Saxon reaction against the intellectualism and rationalism of the Latin mind […] It is a philosophy without words, a philosophy of gestures and of acts, which abandons what is general and holds only to what is particular” (Trans. William James, W:MT, 113). Bourdeau certainly missed the point of the first pragmatist revolution, but it can also be argued that, ironically,...