How does sign language compare with gesture, on the one hand, and spoken language on the other? Sign was once viewed as nothing more than a system of pictorial gestures without linguistic structure. More recently, researchers have argued that sign is no different from spoken language, with all of the same linguistic structures. The pendulum is currently swinging back toward the view that sign is gestural, or at least has gestural components. The goal of this review is to elucidate (...) the relationships among sign language, gesture, and spoken language. We do so by taking a close look not only at how sign has been studied over the past 50 years, but also at how the spontaneous gestures that accompany speech have been studied. We conclude that signers gesture just as speakers do. Both produce imagistic gestures along with more categorical signs or words. Because at present it is difficult to tell where sign stops and gesture begins, we suggest that sign should not be compared with speech alone but should be compared with speech-plus-gesture. Although it might be easier (and, in some cases, preferable) to blur the distinction between sign and gesture, we argue that distinguishing between sign (or speech) and gesture is essential to predict certain types of learning and allows us to understand the conditions under which gesture takes on properties of sign, and speech takes on properties of gesture. We end by calling for new technology that may help us better calibrate the borders between sign and gesture. (shrink)

People frequently gesture when a word is on the tip of their tongue (TOT), yet research is mixed as to whether and why gesture aids lexical retrieval. We tested three accounts: the lexical retrieval hypothesis, which predicts that semantically related gestures facilitate successful lexical retrieval; the cognitive load account, which predicts that matching gestures facilitate lexical retrieval only when retrieval is hard, as in the case of a TOT; and the motor movement account, which predicts that any motor (...) movements should support lexical retrieval. In Experiment 1 (a between‐subjects study; N = 90), gesture inhibition, but not neck inhibition, affected TOT resolution but not overall lexical retrieval; participants in the gesture‐inhibited condition resolved fewer TOTs than participants who were allowed to gesture. When participants could gesture, they produced more representational gestures during resolved than unresolved TOTs, a pattern not observed for meaningless motor movements (e.g., beats). However, the effect of gesture inhibition on TOT resolution was not uniform; some participants resolved many TOTs, while others struggled. In Experiment 2 (a within‐subjects study; N = 34), the effect of gesture inhibition was traced to individual differences in verbal, not spatial short‐term memory (STM) span; those with weaker verbal STM resolved fewer TOTs when unable to gesture. This relationship between verbal STM and TOT resolution was not observed when participants were allowed to gesture. Taken together, these results fit the cognitive load account; when lexical retrieval is hard, gesture effectively reduces the cognitive load of TOT resolution for those who find the task especially taxing. (shrink)

Gestures of Grace is a celebration of the life and career of Robert Sweetman, H. Evan Runner Chair in the History of Philosophy at the Institute for Christian Studies (2001–present). These essays, written by students and colleagues, testify to the remarkable breadth and depth of Sweetman’s research and teaching, from his early scholarly career at the Pontifical Institute of Medieval Studies to his time at ICS. Throughout the volume, there is extensive engagement with Sweetman’s influential historical scholarship on topics such (...) as the emergence and development of the Dominican order in the twelfth and thirteenth centuries, medieval women authors, Thomas Aquinas and Duns Scotus, and indeed on Sweetman’s own systematic contribution to the nature and promise of Christian scholarship today. (shrink)

The goal of the article is to offer a framework against which relations between gesture and sign can be systematically explored beyond the current literature. It does so by (a) reconstructing the history of the discussion in the field of gesture studies, focusing on three leading positions (Kendon, McNeill, and Goldin-Meadow); and (b) by formulating a position to illustrate how this can be achieved. The paper concludes by emphasizing the need for systematic cross-linguistic research on multimodal use of (...) language in its signed and spoken forms. (shrink)

David McNeill, a pioneer in the ongoing study of the relationship between gesture and language, here argues that gestures are active participants in both speaking and thinking. He posits that gestures are key ingredients in an “imagery-language dialectic” that fuels speech and thought. The smallest unit of this dialectic is the growth point, a snapshot of an utterance at its beginning psychological stage. In _Gesture and Thought,_ the central growth point comes from a Tweety Bird cartoon. Over the course (...) of twenty-five years, the McNeill Lab showed this cartoon to numerous subjects who spoke a variety of languages, and a fascinating pattern emerged. The shape and timing of gestures depends not only on what speakers see but on what they take to be distinctive; this, in turn, depends on the context. Those who remembered the same context saw the same distinctions and used similar gestures; those who forgot the context understood something different and changed gestures or used none at all. Thus, the gesture becomes part of the growth point—the building block of language and thought. _Gesture and Thought _is an ambitious project in the ongoing study of how we communicate and how language is connected to thought. (shrink)

The complex gestures of artwork remain an under-explored theoretical topos in contemporary visual culture studies. In our turbulent mediasphere where images are constantly mobilized to enact symbolic forms of warfare and where they get entangled in all kinds of cultural conflicts and controversies, a turn to the gestural life of images promises a particularly pertinent avenue of intellectual inquiry. As both a cultural phenomenon and a philosophical concept, the notion of gesture straddles several disciplines, such as anthropology, linguistics, performance, (...) theater, film and visual studies. In this volume, contributors ask: How may one speak not only of the gestures of the body but also of the gestures of the image? What constitutes gesturality in the image and, more broadly, what are the gestures of the aesthetic itself? By thinking about images within this conceptual framework, this volume seeks to renew our understanding of the image. (shrink)

Speakers frequently perform representational gestures to depict concepts in an iconic fashion. For example, a speaker may hold her index finger and thumb apart to indicate the size of a matchstick. However, the process by which a physical handshape is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which we call “gesture form.” We provide quantitative (...) evidence for several key properties that play a role in this process. First, “profiling,” the ability to focus on a structural subunit within the complex form of the physical hand. Second, “perspective,” for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity,” the fact that gestures focus on specific spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible. (shrink)

This study aims to corroborate Merleau-Ponty’s interpretations of fundamental ideas from Saussure’s linguistics by linking them to works that were independently elaborated by Jan Mukařovský, Czech structuralist aesthetician and literary theorist. I provide a comparative analysis of the two authors’ theories of language and their interpretations of thought as fundamentally determined by language. On this basis, I investigate how they conceive linguistic innovation and its translation into changes in the constituted language and other social codes and institutions. I explain how (...) they elaborate on Saussure’s idea of language as a system of oppositions by interpreting cultural innovation as a systematic variation of pre-established social norms and, similarly, linguistic innovation as gesturing within language. Connectedly, I show how Mukařovský’s works help clarify Merleau-Ponty’s focus on the gestural dimension of language. By discussing the two thinkers’ arguments in favour of linguistic innovation, I explore what could be called phenomenological limits of structuralism. (shrink)

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

During face‐to‐face conversation, transitions between speaker turns are incredibly fast. These fast turn exchanges seem to involve next speakers predicting upcoming semantic information, such that next turn planning can begin before a current turn is complete. Given that face‐to‐face conversation also involves the use of communicative bodily signals, an important question is how bodily signals such as co‐speech hand gestures play into these processes of prediction and fast responding. In this corpus study, we found that hand gestures that depict or (...) refer to semantic information started before the corresponding information in speech, which held both for the onset of the gesture as a whole, as well as the onset of the stroke (the most meaningful part of the gesture). This early timing potentially allows listeners to use the gestural information to predict the corresponding semantic information to be conveyed in speech. Moreover, we provided further evidence that questions with gestures got faster responses than questions without gestures. However, we found no evidence for the idea that how much a gesture precedes its lexical affiliate (i.e., its predictive potential) relates to how fast responses were given. The findings presented here highlight the importance of the temporal relation between speech and gesture and help to illuminate the potential mechanisms underpinning multimodal language processing during face‐to‐face conversation. (shrink)

The ubiquitous human practice of spontaneously gesturing while speaking demonstrates the embodiment, embeddedness, and sociality of cognition. The present essay takes gestural practice to be a paradigmatic example of a more general claim: human cognition is social insofar as our embedded, intelligent, and interacting bodies select and construct meaning in a way that is intersubjectively constrained and defeasible. Spontaneous co-speech gesture is markedly interesting because it at once confirms embodied aspects of linguistic meaning-making that formalist and linguistic turn-type philosophical (...) approaches fail to appreciate, and it also forefronts intersubjectivity as an inherent and inherently normative dimension of communicative action. Co-speech hand gestures, as linguistically meaningful speech acts, demonstrate both sedimentation and spontaneity (in the sense of Maurice Merleau-Ponty’s dialectic of linguistic expression ( 2002 )), or features of convention and nonconvention in a Gricean sense ( 1989 ). Yet neither pragmatic nor classic phenomenological approaches to communication can accommodate the practice of co-speech hand gesturing without some rehabilitation and reorientation. Pragmatic criteria of intersubjectivity, normativity, and rationality need to confront the non-propositional and nonverbal meaning-making of embodied encounters. Phenomenological treatments of expression and intersubjectivity must consider the normative nature of high-order social practices like language use. Reciprocally critical exchanges between these traditions and gesture studies yield an improved philosophy that treats language as a multi-modal medium for collaborative meaning achievement. The proper paradigm for these discussions is found in enactive approaches to social cognition. Co-speech hand gestures are first and foremost emergent elements of social interaction, not the external whirring of an isolated internal consciousness. In contrast to current literature that frequently presents gestures as uncontrollable bodily upsurge or infallible imagistic phenomenon that drives and dances with verbal or “linguistic” convention (McNeill 1992 , 2005 ), I suggest that we study gestures as dynamic, embodied, and shared tools for collaborative sense-making. (shrink)

In debates about the proper analysis of demonstrative expressions, ostensive gestures and speaker intentions are often seen as competing for primary importance in securing reference. Underlying some of these debates is the mistaken assumption that ostensive gestures always make the demonstrated object maximally salient to interlocutors. When we abandon this assumption and focus on an object’s mutually-recognized salience itself, rather than on how the object came to be salient, we can work towards a more promising analysis with a uniform treatment (...) of demonstrative reference whether or not there is an ostensive gesture, and whether reference is ordinary or deferred. (shrink)

There has long been interest in why languages are shaped the way they are, and in the relationship between sign language and gesture. In sign languages, entity classifiers are handshapes that encode how objects move, how they are located relative to one another, and how multiple objects of the same type are distributed in space. Previous studies have shown that hearing adults who are asked to use only manual gestures to describe how objects move in space will use gestures (...) that bear some similarities to classifiers. We investigated how accurately hearing adults, who had been learning British Sign Language for 1–3 years, produce and comprehend classifiers in locative and distributive constructions. In a production task, learners of BSL knew that they could use their hands to represent objects, but they had difficulty choosing the same, conventionalized, handshapes as native signers. They were, however, highly accurate at encoding location and orientation information. Learners therefore show the same pattern found in sign-naïve gesturers. In contrast, handshape, orientation, and location were comprehended with equal accuracy, and testing a group of sign-naïve adults showed that they too were able to understand classifiers with higher than chance accuracy. We conclude that adult learners of BSL bring their visuo-spatial knowledge and gestural abilities to the tasks of understanding and producing constructions that contain entity classifiers. We speculate that investigating the time course of adult sign language acquisition might shed light on how gesture became conventionalized during the genesis of sign languages. (shrink)

The book represents a historical overview of the way the topic of gesture and sign language has been treated in the 18th century French philosophy. The texts treated are grouped into several categories based on the view they present of deafness and gesture. While some of those texts obviously view deafness and sign language in negative terms, i.e. as deficiency, others present deafness essentially as difference, i.e. as a set of competences that might provide some insights into how (...) spoken language works. One of the arguments of the book is that these two views of deafness and sign language still represent two dominant paradigms present in the current debates on the issue. The aim of the book, therefore, is not only to provide a historical overview but to trace what might be called a "history of the present". (shrink)

A beneficial effect of gesture on learning has been demonstrated in multiple domains, including mathematics, science, and foreign language vocabulary. However, because gesture is known to co-vary with other non-verbal behaviors, including eye gaze and prosody along with face, lip, and body movements, it is possible the beneficial effect of gesture is instead attributable to these other behaviors. We used a computer-generated animated pedagogical agent to control both verbal and non-verbal behavior. Children viewed lessons on mathematical equivalence (...) in which an avatar either gestured or did not gesture, while eye gaze, head position, and lip movements remained identical across gesture conditions. Children who observed the gesturing avatar learned more, and they solved problems more quickly. Moreover, those children who learned were more likely to transfer and generalize their knowledge. These findings provide converging evidence that gesture facilitates math learning, and they reveal the potential for using technology to study non-verbal behavior in controlled experiments. (shrink)

Analogy researchers do not often examine gesture, and gesture researchers do not often borrow ideas from the study of analogy. One borrowable idea from the world of analogy is the importance of distinguishing between attributes and relations. Gentner observed that some metaphors highlight attributes and others highlight relations, and called the latter analogies. Mirroring this logic, we observe that some metaphoric gestures represent attributes and others represent relations, and propose to call the latter analogical gestures. We provide examples (...) of such analogical gestures and show how they relate to the categories of iconic and metaphoric gestures described previously. Analogical gestures represent different types of relations and different degrees of relational complexity, and sometimes cohere into larger analogical models. Treating analogical gestures as a distinct phenomenon prompts new questions and predictions, and illustrates one way that the study of gesture and the study of analogy can be mutually informative. (shrink)

Spoken language is an innate ability of the human being and represents the most widespread mode of social communication. The ability to share concepts, intentions and feelings, and also to respond to what others are feeling/saying is crucial during social interactions. A growing body of evidence suggests that language evolved from manual gestures, gradually incorporating motor acts with vocal elements. In this evolutionary context, the human mirror mechanism (MM) would permit the passage from “doing something” to “communicating it to someone (...) else.” In this perspective, the MM would mediate semantic processes being involved in both the execution and in the understanding of messages expressed by words or gestures. Thus, the recognition of action related words would activate somatosensory regions, reflecting the semantic grounding of these symbols in action information. Here, the role of the sensorimotor cortex and in general of the human MM on both language perception and understanding is addressed, focusing on recent studies on the integration between symbolic gestures and speech. We conclude documenting some evidence about MM in coding also the emotional aspects conveyed by manual, facial and body signals during communication, and how they act in concert with language to modulate other’s message comprehension and behavior, in line with an “embodied” and integrated view of social interaction. (shrink)

Speakers of different languages (e.g., English vs. Turkish) show a binary split in how they package and order components of a motion event in speech and co‐speech gesture but not in silent gesture. In this study, we focused on Mandarin Chinese, a language that does not follow the binary split in its expression of motion in speech, and asked whether adult Chinese speakers would follow the language‐specific speech patterns in co‐speech but not silent gesture, thus showing a (...) pattern akin to Turkish and English adult speakers in their description of animated motion events. Our results provided evidence for this pattern, with Chinese—as well as English and Turkish—speakers following language‐specific patterns in speech and co‐speech gesture but not in silent gesture. Our results provide support for the “thinking‐for‐speaking” account, namely that language influences thought only during online, but not offline, production of speech. (shrink)

Deficits in gestures act as early signs of impairment in social interaction and communication in children with autism spectrum disorder. However, the pieces of literature on atypical gesture patterns in ASD children are contradictory. This investigation aimed to explore the atypical gesture pattern of ASD children from the dimensions of quantity, communicative function, and integration ability; and its relationship with social ability and adaptive behavior. We used a semi-structured interactive play to evaluate gestures of 33 ASD children and (...) 24 typically developing children. And we evaluated the social ability, adaptive behavior, and productive language of ASD and TD children by using the Adaptive Behavior Assessment System version II and Chinese Communication Development Inventory. No matter the total score of CCDI was corrected or not, the relative frequency of total gestures, behavior regulation gestures, SI gestures, and joint attention gestures of ASD children were lower than that of TD children, as well as the proportion of JA gestures. However, there was no significant group difference in the proportion of BR and SI gestures. Before adjusting for the total score of CCDI, the relative frequency of gestures without vocalization/verbalization integration and vocalization/verbalization-integrated gestures in ASD children was lower than that in TD children. However, after matching the total score of CCDI, only the relative frequency of gestures without vocalization/verbalization integration was lower. Regardless of the fact that the total score of CCDI was corrected or not, the relative frequency and the proportion of eye-gaze-integrated gestures in ASD children were lower than that in TD children. And the proportion of gestures without eye-gaze integration in ASD children was higher than that in TD children. For ASD children, the social skills score in ABAS-II was positively correlated with the relative frequency of SI gesture and eye-gaze-integrated gestures; the total score of ABAS-II was positively correlated with the relative frequency of total gestures and eye-gaze-integrated gestures. In conclusion, ASD children produce fewer gestures and have deficits in JA gestures. The deficiency of integrating eye gaze and gesture is the core deficit of ASD children’s gesture communication. Relatively, ASD children might be capable of integrating vocalization/verbalization into gestures. SI gestures and the ability to integrate gesture and eye gaze are related to social ability. The quantity of gestures and the ability to integrate gesture with eye gaze are related to adaptive behavior.Clinical Trial Registration:www.ClinicalTrials.gov, identifier ChiCTR1800019679. (shrink)

Gestures’ Contribution to Collective Metaphorical Thinking in a Community of Philosophical Inquiry (CPI). This paper explores an idea expressed by a student discussing where our thoughts come from: to think we have to move our hands. Such sentence echoes the literature on the role of gesture for thinking. This study also focuses on the collective advancement of reasoning in a CPI. The instructor chooses to conclude by asking each student to suggest an analogy of thinking. This closing sequence reveals (...) how the instructor, through metaphorical gestures, fosters collective awareness of new propositions, and their further elaboration. After characterizing the cognitive models so produced, video analysis is used to follow their collective, verbal and gestural construction along the discussion. (shrink)

In this paper I propose to read and understand gestures as logical tools within a synthetic paradigm of knowledge. This interpretation of gesture is drawn from a new pragmatist reading of reasoning in general, and synthetic reasoning in particular. Complete gestures are actions with a beginning and an end that bear a meaning. It is our regular way to embody vague ideas into singular actions with general meaning. The tool is forged by a dense blending of icons, indices, and (...) symbols and by a complexity of phenomenological characteristics as feelings, actual actions, general concepts and habits. The paper illustrates this new way to look at gestures and different kinds of complete and incomplete gestures. (shrink)

How do teachers’ gestures influence students’ learning? This article reviews research investigating the role of gestures in communication, focusing on teachers’ communication with their students, primarily in mathematics and science instruction. We first briefly consider gesture's role in communication more generally as a backdrop for considering teaching as a special context for communication. We then describe teachers’ spontaneous gesturing in teaching contexts, and we consider how teachers’ spontaneous gestures might influence students’ learning. We then consider experimental studies that provide (...) causal support for the effects of teachers’ gestures on students’ learning. We conclude by discussing future directions and implications for educational practice. (shrink)

In the recent years, gesture recognition based on the surface electromyography (sEMG) signals has been extensively studied. However, the accuracy and stability of gesture recognition through traditional machine learning algorithms are still insufficient to some actual application scenarios. To enhance this situation, this paper proposed a method combining feature selection and ensemble extreme learning machine (EELM) to improve the recognition performance based on sEMG signals. First, the input sEMG signals are preprocessed and 16 features are then extracted from (...) each channel. Next, features that mostly contribute to the gesture recognition are selected from the extracted features using the recursive feature elimination (RFE) algorithm. Then, several independent ELM base classifiers are established using the selected features. Finally, the recognition results are determined by integrating the results obtained by ELM base classifiers using the majority voting method. The Ninapro DB5 dataset containing 52 different hand movements captured from 10 able-bodied subjects was used to evaluate the performance of the proposed method. The results showed that the proposed method could perform the best (overall average accuracy 77.9%) compared with decision tree (DT), ELM, and random forest (RF) methods. (shrink)

This article examines the formal and functional features of a recurring ‘away’ gesture in Syuba (Tibeto-Burman, Nepal). The formal properties of this gesture include a pronation of the forearms to bring the palms downward while the fingers spread away, and is most often performed with both hands. Functionally, it is found with utterances that signal negation, particularly the absence of something. A growing body of literature links ‘away’ trajectories with negation, or negative evaluation of speech content cross-linguistically. The (...) temporal alignment between these gesture and lexical content also shows that cross-linguistic differences in word order appear to affect performance of gestures associated with negated content. (shrink)

Gestures is a collection of essays that proposes a daring and ambitious new conception of human behavior. Defining gesture as “a movement of the body or of a tool attached to the body for which there is no satisfactory causal explanation,” Flusser moves around the topic from different points of view, angles and distances: sometimes he zooms in on a modest, ordinary movement like taking a photograph, shaving, or smoking a pipe. Sometimes he pulls back to look at something (...) as vast and varied as human “making,” embracing everything from the fashioning of simple tools to mass manufacturing. Holding firmly to basic phenomenological principles – that consciousness is always consciousness of something, that we know others by reference to ourselves, he claims that we constantly “read” states of mind, i.e. thoughts, intentions, emotions, from gestures; still we lack a theory about how this happens. Gestures takes a first step. It offers alternatives to theories by now so veiled by habit and myth that we are hardly conscious of them, and so hardly realize that they are failing. These include the assumption that we can “know” something without being affected by it, the belief that science is value-free, and the common conviction that science and art are fundamentally different activities. (shrink)

For Greek antiquity, the question of right or fitting measure constituted the very heart of both ethics and politics. But can the Good of the ethical life and the Justice of the political be reduced to measurement and calculation? If they are matters of measure, are they not also absolutely immeasurable? In critical dialogue with texts by Plato, Hölderlin, Rilke, Heidegger, Benjamin, Adorno, Marx, Merleau-Ponty, Levinas, and Levi, the author argues that the question of measure has become ever more urgent (...) in the context of a modernity pressured by the conditions of a technological economy and a relativism that threatens to destroy a vital sense of moral responsibility and the commitment to justice that underlies the possibility of freedom. Conceived as a task for the “metaphysics” of memory, this book explores the normative problematic of measure, bringing its deeply buried redemptive promise to appearance in our gestures, uses and abuses of the hands, the dialectic of tact, and the manners of social existence. (shrink)

Speakers perform manual gestures in the physical space nearest them, called gesture space. We used a controlled elicitation task to explore whether speakers use gesture space in a consistent way and whether they use space in a contrastive way when talking about abstract referents. Participants answered two questions designed to elicit contrastive, abstract discourse. We investigated manual gesture behavior. Gesture hand, location on the horizontal axis, and referent in corresponding speech were coded. We also coded contrast (...) in speech. Participants’ overall tendency to use the same hand = 13.12, p =.001, 95% CI [.31,.43], d = 2.53) and same location = 7.47, p =.001, 95% CI [.27,.47], d = 1.69) when referring to an entity was higher than expected frequency. When comparing pairs of gestures produced with contrastive speech to pairs of gestures produced with non-contrastive speech, we found a greater tendency to produce gestures with different hands for contrastive speech: = 4.19, p =.001, 95% CI [.27,.82], d = 1.42). We did not find associations between dominant side and positive concepts or between left, center, and right space and past, present, and future, respectively, as predicted by previous studies. Taken together, our findings suggest that speakers do produce spatially consistent and contrastive gestures for abstract as well as concrete referents. They may be using spatial resources to assist with abstract thinking, and/or to help interlocutors with reference tracking. Our findings also highlight the complexity of predicting gesture hand and location, which appears to be the outcome of many competing variables. (shrink)

Research in formal theoretical semantics has recently expanded its scope to include gestural communication, focusing in particular on gestures that contribute to the content of an accompanying utterance, e.g., size gestures (LARGE, WIDE), pointing gestures, and gestures that depict objects (TELESCOPE) or actions (SLAP). At the same time, fruitful inquiries at the intersection of primatology and linguistics have given rise to the hypothesis that human and non-human great apes share a common set of directive (=imperative) gestures. Directive gestures such as (...) STOP or COME-CLOSER, pose non-trivial issues for a semantic analysis: we inherit the challenges that pertain to the analysis of imperative utterances (Come closer!), while adding a further challenge that stems from the underspecified mapping between a directive body movement and its potential counterparts in human language. We begin by outlining the problem and surveying the nascent state-of-the-art with regards to a formal semantics of directive gestures. Particular attention is given to the multifunctionality of directive gestures, which typically have different effects in different contexts; for example, a non-human ape gesture may communicate "Stop that" in some contexts and "Move away" in others, with similar patterns found in humans. We show that this multifunctionality can be derived from a single, rich abstract lexical entry, "Not…!", a candidate for a universal building block of meaning, shared by human and non-human great apes. "Not…!", which incorporates negation/rejection, temporal reference and presuppositionality is more explanatory in comparison to a minimal alternative. This chapter lays out the hypothesis space, addressing the foundational question of how to explain attested gestural overlap between human and non-human great apes. We conclude the chapter by reviewing potential expansions of the analysis to the pragmatic gestures of humans, which are thus placed on the primate gestural meaning continuum and connected to the directive gestures we share with our non-human relatives in the great ape family. (shrink)

Adults and children spontaneously produce gestures while they speak, and such gestures appear to support and expand on the information communicated by the verbal channel. Little research, however, has been carried out to examine the role played by gesture in the listener's representation of accumulating information. Do listeners attend to the gestures that accompany narrative speech? In what kinds of relationships between gesture and speech do listeners attend to the gestural channel? If listeners do attend to information received (...) in gesture, how is this information represented— is it 'tagged' as originating in the gestural channel? In this article research is described that addresses these questions. Results show that listeners do attend to information conveyed in gesture, when that information supplements or even contradicts the information conveyed by speech. And information received via gesture is available for retelling in speech. These results are taken to demonstrate that gesture is not taken by the listener to be epiphenomenal to the act of speaking, or a simple manual translation of speech. But they also suggest that the information conveyed in a discourse may be represented in a manner that is neither gesture nor language, although accessible to both channels. (shrink)

Language and speech depend on a relatively well defined neural circuitry, located predominantly in the left hemisphere. In this article, I discuss the origin of the speech circuit in early humans, as an expansion of an auditory-vocal articulatory network that took place after the last common ancestor with the chimpanzee. I will attempt to converge this perspective with aspects of the Mirror System Hypothesis, particularly those related to the emergence of a meaningful grammar in human communication. Basically, the strengthening of (...) auditory-vocal connectivity via the arcuate fasciculus and related tracts generated an expansion of working memory capacity for vocalizations, that was key for learning complex utterances. This process was concomitant with the development of a robust interface with visual working memory, both in the dorsal and ventral streams of auditory and visual processing. This enabled the bidirectional translation of sequential codes into hierarchical visual representations, through the development of a multimodal interface between both systems. (shrink)

Empirical studies of gesture in a subject who has lost proprioception and the sense of touch from the neck down show that specific aspects of gesture remain normal despite abnormal motor processes for instrumental movement. The experiments suggest that gesture, as a linguistic phenomenon, is not reducible to instrumental movement. They also support and extend claims made by Merleau-Ponty concerning the relationship between language and cognition. Gesture, as language, contributes to the accomplishment of thought.

The framework of depicting put forward byClark (2016)offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American (...) TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. (shrink)

One of the central charges that Žižek levels down against Adorno is that his critique of ideology comes dangerously close to a post-ideological position in which all ideological contents, political actions or rituals are reduced to a cynical consciousness which automatically obeys certain social imperatives though being aware of their falsity. Against this, Žižek comes up with an alternative understanding of cynicism as operating not at the level of consciousness, but everyday practices. What the present article tries to show is (...) that Žižek's critique is misplaced, for Adorno has a much more subtle approach in which the problem of ideology lies neither simply in theory, nor in practice, but somewhere in-between, in the compulsion of gestures. Moreover, from an Adornian perspective, Žižek's commitment to a Hegelian self-referential approach obliterates the double-edge character of determinate negation, that of addressing both the present social-historical context and the possibility of an alternative social reality. (shrink)

The idea of ‘gesture’ is present in the philosophical world in various forms. All of them might find an important theoretical grounding in pragmatist philosophy, if we combine pragmatism with some French philosophies of mathematics and read it as a way out of the Kantian philosophy of representation. The paper uses the insights of Jean Cavaillès to set out the problem of the weakness of the epistemic Kantian defense of mathematical and logical thought. Cavaillès rejected the possible amendments to (...) Kant’s explanation provided by both Husserl and Bolzano and their heirs. He used the word ‘gesture’ in order to explain the activity of mathematicians who have to act synthetically, following rules, with some physical representation, and being aware of the possibility of failure. Cavaillès conceived the use of gesture as an alternative to the Heidegerian idea of event defended by Albert Lautman. The paper then follows the idea of gesture in the French philosophy of mathematics of Gilles Châtelet and Giuseppe Longo. Finally, the paper illustrates how Peirce’s study of Existential Graphs and the main insights of pragmatism complete Cavaillès’s idea by giving to gestures a phenomenological and semiotic structure. The pragmatist philosophy of gesture is thus a new way of overthrowing Kant’s philosophy of representation without surrendering to irrationalism. (shrink)

Temporal perspectives allow us to place ourselves and temporal events on a timeline, making it easier to conceptualize time. This study investigates how we take different temporal perspectives in our temporal gestures. We asked participants (n = 36) to retell temporal scenarios written in the Moving‐Ego, Moving‐Time, and Time‐Reference‐Point perspectives in spontaneous and encouraged gesture conditions. Participants took temporal perspectives mostly in similar ways regardless of the gesture condition. Perspective comparisons showed that temporal gestures of our participants resonated (...) better with the Ego‐ (i.e., Moving‐Ego and Moving‐Time) versus Time‐Reference‐Point distinction instead of the classical Moving‐Ego versus Moving‐Time contrast. Specifically, participants mostly produced more Moving‐Ego and Time‐Reference‐Point gestures for the corresponding scenarios and speech; however, the Moving‐Time perspective was not adopted more than the others in any condition. Similarly, the Moving‐Time gestures did not favor an axis over the others, whereas Moving‐Ego gestures were mostly sagittal and Time‐Reference‐Point gestures were mostly lateral. These findings suggest that we incorporate temporal perspectives into our temporal gestures to a considerable extent; however, the classical Moving‐Ego and Moving‐Time classification may not hold for temporal gestures. (shrink)

Gestures are usually regarded as a casual element of communication processes between logicians. By contrast, we aim to show that gestures have played a significant role in logic. We argue that the development of communication techniques and their standardization have led to the rise of formal notation systems commonly used in logic today. In order to substantiate this claim, the historical development of the use of gestures in (early) modern logic is investigated. This investigation uncovers exemplary communication and proof techniques (...) that illustrate the efficacy of gestures as representational media in formal logic. Revisiting the tradition of gestures in logic offers promising paths and insights for today’s logic as a communication practice in the digital age. (shrink)

This study investigated gesture–speech integration among adolescents who are deaf or hard of hearing and those with typical hearing. Thirty-eight adolescents performed a Stroop-like task in which they watched 120 short video clips of gestures and actions twice at random. Participants were asked to press one button if the visual content of the speaker’s movements was related to a written word and to press another button if it was unrelated to a written word while accuracy rates and response times (...) were recorded. We found stronger GSI effects among DHH participants than hearing participants. The semantic congruency effect was significantly larger in DHH participants than in hearing participants, and results of our experiments indicated a significantly larger gender congruency effect in DHH participants as compared to hearing participants. Results of this study shed light on GSI among DHH individuals and suggest future avenues for research examining the impact of gesture on language processing and communication in this population. (shrink)

When asked to explain their solutions to a problem, both adults and children gesture as they talk. These gestures at times convey information that is not conveyed in speech and thus reveal thoughts that are distinct from those revealed in speech. In this study, we use the classic Tower of Hanoi puzzle to validate the claim that gesture and speech taken together can reflect the activation of two cognitive strategies within a single response. The Tower of Hanoi is (...) a well‐studied puzzle, known to be most efficiently solved by activating subroutines at theoretically defined choice points. When asked to explain how they solved the Tower of Hanoi puzzle, both adults and children produced significantly more gesture‐speech mismatches—explanations in which speech conveyed one path and gesture another—at these theoretically defined choice points than they produced at non‐choice points. Even when the participants did not solve the problem efficiently, gesture could be used to indicate where the participants were deciding between alternative paths. Gesture can, thus, serve as a useful adjunct to speech when attempting to discover cognitive processes in problem‐solving. (shrink)

As a speculative and abstract discipline, philosophy is traditionally considered to be in dialectical tension with physical experience and daily practice. In contrast to this conventional and idealistic perspective, and in line with aesthetics as embodied knowledge, this article attempts to show that not only do we constantly think via gestures, movements, and physical experiences but also that there is no need to disconnect a concept from practice. Passing from Wittgenstein’s idea of “form of life” to the pragmatist aesthetics initiated (...) by Dewey’s idea of “art as experience,” I propose an analysis of the philosophical framework of postmodern dance (Yvonne Rainer) and of Happenings (Allan Kaprow), in order to underline the theoretical and conceptual research that is already at work in the field of contemporary art practice, the latter being understood as a sensorial dimension intrinsically linked to ordinary life. My general argument is that gestures, which are an inescapable and vital part of everyday life, can be foregrounded by certain artistic practices without corrupting or theatricalizing their ordinariness. (shrink)

This paper explores the intertwinement of ontology and history that happened after the idealist turn of Kantian transcendentalism, particularly in classic German idealism and later in American pragmatism. The paper focuses on the less remarked-upon consequence of this intertwinement, namely the possibility of a new reading of history based on changes in concepts and habitual mentality. The paper proposes a new take on historiography that vindicates Hegel’s insight but changes his approach to a pragmatist one, more apt to face historical (...) changes in a technical way and less easily twistable into ideological frameworks. The paper argues that the notion of habit, as phenomenologically and semiotically described by Peirce, is the fundamental cellule of the pragmatist take on the entanglement of history and ontology. The paper elaborates on the notion of habit, singling out a special form of it called “gesture” that can be a useful tool for reading the history of the human spirit without incorporating Hegel’s dialectic and Absolute. The paper compares the notion of gesture as it originated in the pragmatist tradition with the parallel use of the term in the early studies of Michel Foucault and argues that the notion of gesture is better equipped to tackle a theoretical reading of history. (shrink)

Gestures can serve as external representations of abstract concepts which may be otherwise difficult to illustrate. Gestures often accompany verbal statement as an embodiment of mental models that augment the communication of ideas, concepts or envisioned shapes of products. A gesture is also an indicator of the subject and context of the issue under discussion. We argue that if gestures can be identified and formalized they can be used as a knowledge indexing and retrieval tool and can prove to (...) be useful access point into unstructured digital video data. We present a methodology and a prototype, called I-Gesture that allows users to (1) define a vocabulary of gestures for a specific domain, (2) build a digital library of the gesture vocabulary, and (3) mark up entire video streams based on the predefined vocabulary for future search and retrieval of digital content from the archive. I-Gesture methodology and prototype are illustrated through scenarios where it can be utilized. The paper concludes with results of evaluation experiments with I-Gesture using a test bed of design-construction projects. (shrink)