A revolutionary study of the correlations between facial expressions and type, as first defined by C.G. Jung. This book rewrites what we know of typology and presents an empirical case for its existence.

Honest signalling theory suggests that humans and chimpanzees can extract socially relevant information relating to personality from the faces of their conspecifics. Humans are also able to extract information from chimpanzees’ faces. Here, we examine whether personality characteristics of chimpanzees, including measures of psychopathy, can be discerned based purely on facial morphology in photographs. Twenty-one chimpanzees were given naïve and expert personality ratings on the Ten Item Personality Inventory (TIPI) and the Chimpanzee Triarchic Model of Psychopathy (CHMP-Tri) before and (...) following behavioural observations. Characteristics relating to openness, conscientiousness, extraversion, and disinhibition could be distinguished from the faces of chimpanzees. Individuals higher on disinhibition have lower scores on conscientiousness and emotional stability and higher scores on extraversion, while those higher on meanness have lower conscientiousness and agreeableness. Facial expressions are linked to personality traits present in the TIPI and CHMP-Tri models: the Relaxed Face and the Grooming Face were displayed more by chimpanzees higher on agreeableness, whereas the Compressed Lips Face was observed more in those individuals higher on boldness, and the Full Open Grin was displayed more by chimpanzees higher on extraversion but lower on emotional stability and conscientiousness. Facial expressions were also found to be associated with particular behavioural contexts, namely the Grooming Face in affiliative contexts and the Relaxed and Relaxed Open Mouth Faces in neutral contexts. Dominant chimpanzees display higher levels of boldness and more Compressed Lips Faces, Relaxed Open Mouth Faces, and Grooming Faces than subordinate individuals. These findings support and extend evidence for an honest signalling system and a personality structure shared between humans and chimpanzees. Future research could further explore how personality is conveyed through the face, perhaps through more than just singular aspects of character, and maybe reflecting what chimpanzees themselves are able to do. (shrink)

The present work aims at developing a scale for the assessment of a construct that we called “physical–digital integration”, which refers to the tendency of some individuals not to perceive a clear differentiation between feelings and perceptions that pertain to the physical or digital environment. The construct is articulated in four facets: identity, social relationships, time–space perception, and sensory perception. Data from a sample of 369 participants were collected to evaluate factor structure (unidimensional model, bifactor model, correlated four-factor model), internal (...) consistency (Cronbach’s _α_, McDonald’s _ω_), and correlations of the physical–digital integration scale with other measures. Results showed that the scale is valid and internally consistent, and that both the total score and the scores at its four subscales are worthy of consideration. The physical–digital integration scores were found to be differently associated with digital and non-digital behaviors, individuals’ ability to read emotions in the facial expressions of others, and indicators of psychosocial functioning (anxiety, depression, and satisfaction with social relationships). The paper proposes a new measure whose scores are associated with several variables that may have relevant consequences at both individual and social levels. (shrink)

In this article we discuss the aspects of designing facial expressions for virtual humans (VHs) with a specific culture. First we explore the notion of cultures and its relevance for applications with a VH. Then we give a general scheme of designing emotional facial expressions, and identify the stages where a human is involved, either as a real person with some specific role, or as a VH displaying facial expressions. We discuss how the display and the (...) emotional meaning of facial expressions may be measured in objective ways, and how the culture of displayers and the judges may influence the process of analyzing human facial expressions and evaluating synthesized ones. We review psychological experiments on cross-cultural perception of emotional facial expressions. By identifying the culturally critical issues of data collection and interpretation with both real and VHs, we aim at providing a methodological reference and inspiration for further research. (shrink)

Although we have learned much about the neuropsychological control of facial expressions of emotion, there is still much work to do. We suggest that future work integrate advances in our theoretical understanding of the roles of volition and consciousness in the elicitation of emotion and the production of facial expressions with advances in our understanding of its underlying neurophysiology. We first review the facial musculature and the neural paths thought to innervate it, as well as previous attempts (...) at understanding the neural control of facial expressions of emotion, focusing on the voluntary-involuntary dichotomy and studies of hemispheric specialization. In the second section, we discuss four major aspects of the psychology of facial expressions of emotion that have particular import to their neurophysiological substrates. We offer these as a starting point for a better integration of psychological and neurophysiological perspectives in considering the neuropsychological control of facial expressions of emotion. (shrink)

This paper proposes that human expression of pain in the presence or absence of caregivers, and the detection of pain by observers, arises from evolved propensities. The function of pain is to demand attention and prioritise escape, recovery, and healing; where others can help achieve these goals, effective communication of pain is required. Evidence is reviewed of a distinct and specific facial expression of pain from infancy to old age, consistent across stimuli, and recognizable as pain by (...) observers. Voluntary control over amplitude is incomplete, and observers can better detect pain that the individual attempts to suppress rather than amplify or simulate. In many clinical and experimental settings, the facial expression of pain is incorporated with verbal and nonverbal vocal activity, posture, and movement in an overall category of pain behaviour. This is assumed by clinicians to be under operant control of social contingencies such as sympathy, caregiving, and practical help; thus, strong facial expression is presumed to constitute an attempt to manipulate these contingencies by amplification of the normal expression. Operant formulations support skepticism about the presence or extent of pain, judgments of malingering, and sometimes the withholding of caregiving and help. To the extent that pain expression is influenced by environmental contingencies, however, could equally plausibly constitute the release of suppression according to evolved contingent propensities that guide behaviour. Pain has been largely neglected in the evolutionary literature and the literature on expression of emotion, but an evolutionary account can generate improved assessment of pain and reactions to it. (shrink)

Emotional facial expressions can inform researchers about an individual's emotional state. Recent technological advances open up new avenues to automatic Facial Expression Recognition (FER). Based on machine learning, such technology can tremendously increase the amount of processed data. FER is now easily accessible and has been validated for the classification of standardized prototypical facial expressions. However, applicability to more naturalistic facial expressions still remains uncertain. Hence, we test and compare performance of three different FER systems (...) (Azure Face API, Microsoft; Face++, Megvii Technology; FaceReader, Noldus Information Technology) with human emotion recognition (A) for standardized posed facial expressions (from prototypical inventories) and (B) for non-standardized acted facial expressions (extracted from emotional movie scenes). For the standardized images, all three systems classify basic emotions accurately (FaceReader is most accurate) and they are mostly on par with human raters. For the non-standardized stimuli, performance drops remarkably for all three systems, but Azure still performs similarly to humans. In addition, all systems and humans alike tend to misclassify some of the non-standardized emotional facial expressions as neutral. In sum, emotion recognition by automated facial expression recognition can be an attractive alternative to human emotion recognition for standardized and non-standardized emotional facial expressions. However, we also found limitations in accuracy for specific facial expressions; clearly there is need for thorough empirical evaluation to guide future developments in computer vision of emotional facial expressions. (shrink)

This paper proposes that human expression of pain in the presence or absence of caregivers, and the detection of pain by observers, arises from evolved propensities. The function of pain is to demand attention and prioritise escape, recovery, and healing; where others can help achieve these goals, effective communication of pain is required. Evidence is reviewed of a distinct and specific facial expression of pain from infancy to old age, consistent across stimuli, and recognizable as pain by (...) observers. Voluntary control over amplitude is incomplete, and observers can better detect pain that the individual attempts to suppress rather than amplify or simulate. In many clinical and experimental settings, the facial expression of pain is incorporated with verbal and nonverbal vocal activity, posture, and movement in an overall category of pain behaviour. This is assumed by clinicians to be under operant control of social contingencies such as sympathy, caregiving, and practical help; thus, strong facial expression is presumed to constitute an attempt to manipulate these contingencies by amplification of the normal expression. Operant formulations support skepticism about the presence or extent of pain, judgments of malingering, and sometimes the withholding of caregiving and help. To the extent that pain expression is influenced by environmental contingencies, however, “amplification” could equally plausibly constitute the release of suppression according to evolved contingent propensities that guide behaviour. Pain has been largely neglected in the evolutionary literature and the literature on expression of emotion, but an evolutionary account can generate improved assessment of pain and reactions to it. Key Words: adaptation; evolutionary psychology; facial expression; pain. (shrink)

The question whether facial expression processing may be impaired in Parkinson’s disease (PD) patients so far has yielded equivocal results – existing studies, however, have focused on testing expression processing in recognition tasks with static images of six standard, emotional facial expressions. Given that non-verbal communication contains both emotional and non-emotional, conversational expressions and that input to the brain is usually dynamic, here we address the question of potential facial expression processing differences in a (...) novel format: we test a range of conversational and emotional, dynamic facial expressions in three groups – PD patients ( n = 20), age- and education-matched older healthy controls ( n = 20), and younger adult healthy controls ( n = 20). This setup allows us to address both effects of PD and age-related differences. We employed a rating task for all groups in which 12 rating dimensions were used to assess evaluative processing of 27 expression videos from six different actors. We found that ratings overall were consistent across groups with several rating dimensions (such as arousal or outgoingness) having a strong correlation with the expressions’ motion energy content as measured by optic flow analysis. Most importantly, we found that the PD group did not differ in any rating dimension from the older healthy control group (HCG), indicating highly similar evaluation processing. Both older groups, however, did show significant differences for several rating scales in comparison with the younger adults HCG. Looking more closely, older participants rated negative expressions compared to the younger participants as more positive, but also as less natural, persuasive, empathic, and sincere. We interpret these findings in the context of the positivity effect and in-group processing advantages. Overall, our findings do not support strong processing deficits due to PD, but rather point to age-related differences in facial expression processing. (shrink)

A key feature of facial behavior is its dynamic quality. However, most previous research has been limited to the use of static images of prototypical expressive patterns. This article explores the role of facial dynamics in the perception of emotions, reviewing relevant empirical evidence demonstrating that dynamic information improves coherence in the identification of affect (particularly for degraded and subtle stimuli), leads to higher emotion judgments (i.e., intensity and arousal), and helps to differentiate between genuine and fake expressions. (...) The findings underline that using static expressions not only poses problems of ecological validity, but also limits our understanding of what facial activity does. Implications for future research on facial activity, particularly for social neuroscience and affective computing, are discussed. (shrink)

Research on facial emotion expression has mostly focused on emotion recognition, assuming that a small number of discrete emotions is elicited and expressed via prototypical facial muscle configurations as captured in still photographs. These are expected to be recognized by observers, presumably via template matching. In contrast, appraisal theories of emotion propose a more dynamic approach, suggesting that specific elements of facial expressions are directly produced by the result of certain appraisals and predicting the facial (...) patterns to be expected for certain appraisal configurations. This approach has recently been extended to emotion perception, claiming that observers first infer individual appraisals and only then make categorical emotion judgments based on the estimated appraisal patterns, using semantic inference rules. Here we report two related studies to empirically investigate the facial action unit configurations that are used by actors to convey specific emotions in short affect bursts and to examine to what extent observers can infer a person’s emotions from the predicted facial expression configurations. The results show that 1) professional actors use many of the predicted facial action unit patterns to enact systematically specified appraisal outcomes in a realistic scenario setting, and 2) naïve observers infer the respective emotions based on highly similar facial movement configurations with a degree of accuracy comparable to earlier research findings. Based on estimates of underlying appraisal criteria for the different emotions we conclude that the patterns of facial action units identified in this research correspond largely to prior predictions and encourage further research on appraisal-driven expression and inference. (shrink)

Emotional development is one of the largest and most productive areas of psychological research. For decades, researchers have been fascinated by how humans respond to, detect, and interpret emotional facial expressions. Much of the research in this area has relied on controlled stimulus sets of adults posing various facial expressions. Here we introduce a new stimulus set of emotional facial expressions into the domain of research on emotional development—The Child Affective Facial Expression set (CAFE). (...) The CAFE set features photographs of a racially and ethnically diverse group of 2- to 8-year-old children posing for six emotional facial expressions—angry, fearful, sad, happy, surprised, and disgusted—and a neutral face. In the current work, we describe the set and report validity and reliability data on the set from 100 untrained adult participants. (shrink)

This article aims to determine to what extent photographic practices in psychology, psychiatry and physiology contributed to the definition of the external bodily signs of passions and emotions in the second half of the 19th century in France. Bridging the gap between recent research in the history of emotions and photographic history, the following analyses focus on the photographic production of scientists and photographers who made significant contributions to the study of expressions and gestures, namely Duchenne de Boulogne, Charles Darwin, (...) Paul Richer and Albert Londe. This article argues that photography became a key technology in their works due to the adequateness of the exposure time of different cameras to the duration of the bodily manifestations to be recorded, and that these uses constituted facial expressions and bodily gestures as particular objects for the scientific study. (shrink)

This article discusses how research on the image-based analysis of facial images has informed this debate by demonstrating that a single representational system for facial identity and facial expression is not only computationally viable, but can simulate existing cognitive data demonstrating apparent dissociable processing of these two facial properties. It discusses the increasing number of cognitive studies that provide support for this view. Neuropsychological case studies of brain-injured patients and provide limited evidence for separate visual (...) routes processing facial identity and facial expression. It deals with neuroimaging studies addressing both facial identity and facial expression processing which shows that the fusiform gyrus contributes to the recognition of both facial properties. Research continues to reinforce the proposal that a common visual framework supports the representation of at least some aspects of facial identity and facial expression. (shrink)

We discuss here one of our projects, aimed at developing an automatic facial expression interpreter, mainly in terms of signaled emotions. We present some of the relevant findings on facial expressions from cognitive science and psychology that can be understood by and be useful to researchers in Human-Computer Interaction and Artificial Intelligence. We then give an overview of HCI applications involving automated facial expression recognition, we survey some of the latest progresses in this area reached (...) by various approaches in computer vision, and we describe the design of our facial expression recognizer. We also give some background knowledge about our motivation for understanding facial expressions and we propose an architecture for a multimodal intelligent interface capable of recognizing and adapting to computer users¿ affective states. Finally, we discuss current interdisciplinary issues and research questions which will need to be addressed for further progress to be made in the promising area of computational facial expression recognition. (shrink)

To avoid contagion, we need information about the health status of those whom we engage with. This is especially important when we have cause for concern that the other is indeed sick, such as is the case during the world-wide outbreak of the coronavirus in 2020. In three studies, one conducted several years before the pandemic, and two during the pandemic, we showed that facial expressions of emotions are used as signals of health status. Specifically, happy expressers are perceived (...) as healthier than expressers showing negative emotions or neutrality (Studies 1–3), whereas anger was interpreted as a signal of ill health (Study 3). Importantly, however, facial expressions affected health perception only when there was a prior reason to suspect ill health. This was the case for older expressers before and after the pandemic for whom age-related stereotypes set expectations of ill health and for all ages during a wide-spread pandemic, which extends this suspicion to everyone. In Study 3, we showed that the effect of emotion expressions was also generalized to the physical distance that the observer wishes to keep from the expresser. Overall, this research is the first to show a role of emotion expressions in informing health perception. (shrink)

The present study examined how emotional fit with culture – the degree of similarity between an individual’ emotional response to the emotional response of others from the same culture – relates to well-being in a sample of Asian American and European American college students. Using a profile correlation method, we calculated three types of emotional fit based on self-reported emotions, facial expressions, and physiological responses. We then examined the relationships between emotional fit and individual well-being (depression, life satisfaction) as (...) well as collective aspects of well-being, namely collective self-esteem (one’s evaluation of one’s cultural group) and identification with one’s group. The results revealed that self-report emotional fit was associated with greater individual well-being across cultures. In contrast, culture moderated the relationship between self-report emotional fit and collective self-esteem, such that emotional fit predicted greater collective self-esteem in Asian Americans, but not in European Americans. Behavioral emotional fit was unrelated to well-being. There was a marginally significant cultural moderation in the relationship between physiological emotional fit in a strong emotional situation and group identification. Specifically, physiological emotional fit predicted greater group identification in Asian Americans, but not in European Americans. However, this finding disappeared after a Bonferroni correction. The current finding extends previous research by showing that, while emotional fit may be closely related to individual aspects of well-being across cultures, the influence of emotional fit on collective aspects of well-being may be unique to cultures that emphasize interdependence and social harmony, and thus being in alignment with other members of the group. (shrink)

Facial expressions are a vital way for humans to show their perceived emotions. It is convenient for detecting and recognizing expressions or micro-expressions by annotating a lot of data in deep learning. However, the study of video-based expressions or micro-expressions requires that coders have professional knowledge and be familiar with action unit coding, leading to considerable difficulties. This paper aims to alleviate this situation. We deconstruct facial muscle movements from the motor cortex and systematically sort out the relationship (...) among facial muscles, AU, and emotion to make more people understand coding from the basic principles: We derived the relationship between AU and emotion based on a data-driven analysis of 5,000 images from the RAF-AU database, along with the experience of professional coders.We discussed the complex facial motor cortical network system that generates facial movement properties, detailing the facial nucleus and the motor system associated with facial expressions.The supporting physiological theory for AU labeling of emotions is obtained by adding facial muscle movements patterns.We present the detailed process of emotion labeling and the detection and recognition of AU.Based on the above research, the video's coding of spontaneous expressions and micro-expressions is concluded and prospected. (shrink)

Deficits in recognition of facial expressions of emotions are considered to be an important factor explaining impairments in social functioning and affective reactions of schizophrenic patients. Many studies confirmed such deficits while controversies remained concerning the emotion valence and modality. The aim of the study was to explore the process of recognizing facial expressions of emotion in the group of schizophrenic patients by analyzing the role of emotion valence, modality and gender of the model. Results of the group (...) of 35 patients and 35 matched controls indicate that while schizophrenic patients show general impairment in recognizing facial expressions of both positive and the majority of negative emotions, there are differences in deficits for particular emotions. Expressions also appeared to be more ambiguous for the patients while variables connected with gender were found less significant. (shrink)

Traditional research on emotion-face processing has primarily focused on the expression of basic emotions using adult emotional face stimuli. Stimulus sets featuring child faces or emotions other than basic emotions are rare. The current study describes the acquisition and evaluation of the Qingdao Preschooler Facial Expression set, a facial stimulus set with images featuring 54 Chinese preschoolers’ emotion expressions. The set includes 712 standardized color photographs of six basic emotions, five discrete positive emotions, and a neutral (...) expression. The validity of the pictures was examined based on 43 adult raters’ online evaluation, including agreement between designated emotions and raters’ labels, as well as intensity and representativeness scores. Overall, these data should contribute to the developmental and cross-cultural research on children’s emotion expressions and provide insights for future research on positive emotions. (shrink)

There are many ways to assess face perception skills. In this study, we describe a novel task battery FEAST (Facial Expression Action Stimulus Test) developed to test recognition of identity and expressions of human faces as well as stimulus control categories. The FEAST consists of a neutral and emotional face memory task, a face and object identity matching task, a face and house part-to-whole matching task, and a human and animal facial expression matching task. The identity (...) and part-to-whole matching tasks contain both upright and inverted conditions. The results provide reference data of a healthy sample of controls in two age groups for future users of the FEAST. (shrink)

In two experiments, we tested whether fearful facial expressions capture attention in an awareness-independent fashion. In Experiment 1, participants searched for a visible neutral face presented at one of two positions. Prior to the target, a backward-masked and, thus, invisible emotional or neutral face was presented as a cue, either at target position or away from the target position. If negative emotional faces capture attention in a stimulus-driven way, we would have expected a cueing effect: better performance where fearful (...) or disgusted facial cues were presented at target position than away from the target. However, no evidence of capture of attention was found, neither in behavior, nor in event-related lateralizations. In Experiment 2, we went one step further and used fearful faces as visible targets, too. Thereby, we sought to boost awareness-independent capture of attention by fearful faces. However, still, we found no significant attention-capture effect. Our results show that fearful facial expressions do not capture attention in an awareness-independent way. Results are discussed in light of existing theories. (shrink)

Most experimental studies of facial expression processing have used static stimuli (photographs), yet facial expressions in daily life are generally dynamic. In its original photographic format, the Karolinska Directed Emotional Faces (KDEF) has been frequently utilized. In the current study, we validate a dynamic version of this database, the KDEF-dyn. To this end, we applied animation between neutral and emotional expressions (happy, sad, angry, fearful, disgusted, and surprised; 1,033-ms unfolding) to 40 KDEF models, with morphing software. Ninety-six (...) human observers categorized the expressions of the resulting 240 video-clip stimuli, and automated face analysis assessed the evidence for 6 expressions and 20 facial action units (AUs) at 31 intensities. Low-level image properties (luminance, signal-to-noise ratio, etc.) and other purely perceptual factors (e.g., size, unfolding speed) were controlled. Human recognition performance (accuracy, efficiency, and confusions) patterns were consistent with prior research using static and other dynamic expressions. Automated assessment of expressions and AUs was sensitive to intensity manipulations. Significant correlations emerged between human observers’ categorization and automated classification. The KDEF-dyn database aims to provide a balance between experimental control and ecological validity for research on emotional facial expression processing. The stimuli and the validation data are available to the scientific community. (shrink)

Recent application of theories of embodied or grounded cognition to the recognition and interpretation of facial expression of emotion has led to an explosion of research in psychology and the neurosciences. However, despite the accelerating number of reported findings, it remains unclear how the many component processes of emotion and their neural mechanisms actually support embodied simulation. Equally unclear is what triggers the use of embodied simulation versus perceptual or conceptual strategies in determining meaning. The present article integrates (...) behavioral research from social psychology with recent research in neurosciences in order to provide coherence to the extant and future research on this topic. The roles of several of the brain's reward systems, and the amygdala, somatosensory cortices, and motor centers are examined. These are then linked to behavioral and brain research on facial mimicry and eye gaze. Articulation of the mediators and moderators of facial mimicry and gaze are particularly useful in guiding interpretation of relevant findings from neurosciences. Finally, a model of the processing of the smile, the most complex of the facial expressions, is presented as a means to illustrate how to advance the application of theories of embodied cognition in the study of facial expression of emotion. (shrink)

Recent work in social robotics, which is aimed both at creating an artificial intelligence and providing a test-bed for psychological theories of human social development, involves building robots that can learn from ‘face-to-face’ interaction with human beings — as human infants do. The building-blocks of this interaction include the robot’s ‘expressive’ behaviours, for example, facial-expression and head-and-neck gesture. There is here an ideal opportunity to apply Wittgensteinian conceptual analysis to current theoretical and empirical work in the sciences. (...) Wittgenstein’s philosophical psychology is sympathetic to embodied and situated Artificial Intelligence (see Proudfoot, 2002, 2004b), and his discussion of facial-expression is remarkably modern. In this chapter, I explore his approach to facial-expression, using smiling as a representative example, and apply it to the canonical interactive face robot, Cynthia Breazeal’s Kismet (see e.g. Breazeal, 2009, 2002). I assess the claim that Kismet has expressive behaviours, with the aim of generating philosophical insights for AI. (shrink)

People often judge trustworthiness based on others’ faces (e.g., facial expression and facial gender). However, it is unclear whether social context plays a moderating role in forming trustworthiness judgments. Based on the emotions as social information (EASI) model, differing contexts may impact the effect of facial expression; however, there is no evidence demonstrating that differing contexts will or will not influence the effect of facial gender. In this study, we used two experiments to examine (...) how facial expression and facial gender affect facial trustworthiness judgments and whether the effects on facial trustworthiness judgments are consistent in cooperative and competitive settings. Twenty-seven undergraduates (14 female; Mage = 21.81 years, SD = 2.66) participated in experiment 1. The results showed significant main effects of facial expression and facial gender as well as the interaction between them. To examine the social context effect, 28 undergraduates (18 female; Mage = 20.93 years, SD = 2.94) participated in experiment 2. The results showed the main effects of facial expression, facial gender, and social context. Moreover, there was a significant interaction between facial gender and facial expression and a marginally significant interaction between social context and facial expression. These results suggest that in the process of judging facial trustworthiness, individuals’ judgments are affected by both facial expression and facial gender. Furthermore, the effect of facial gender on facial trustworthiness judgments presents cross-situational stability, and the role of facial expression is influenced by the settings. These findings support and expand the EASI model. (shrink)

When building personal relationships, it is important to select optimal partners, even based on the first meeting. This study was inspired by the idea that people who smile are considered more trustworthy and attractive. However, this may not always be true in daily life. Previous studies have used a relatively simple method of judging others by presenting a photograph of one person’s face. To move beyond this approach and examine more complex situations, we presented the faces of two people confronted (...) with each other to participants and asked them to judge them from a third-person perspective. Through three experiments, participants were asked to judge which of the two persons was more appropriate for forming alliances, more trustworthy, or more attractive, respectively. In all experiments, images were shown for a short or a long time. In all three experiments, the results showed that participants were more likely to choose persons with happy faces than those with neutral, sad, or angry faces when the image presentation was short. Contrarily, the facial expressions did not affect those judgments when the image presentation was long. Instead, judgments were correlated with personality estimated from the model’s neutral face in a single-person presentation. These results suggest that although facial expressions can affect the judgments of others when observing two-person confrontations from a third-person perspective, when participants have more time to elaborate their judgments, they go beyond expressions. (shrink)

Is there a substantial difference between a portrait depicting the sitter’s face made by an artist and an image captured by a machine able to simulate the neuro-physiology of facial perception? Drawing on the later Wittgenstein, this paper answers this question by reference to the relation between seeing a visual pattern as (i) a series of shapes and colours, and (ii) a face with expressions. In the case of the artist, and not of the machine, the portrait’s creative process (...) involves the ability to see both aspects. From the perspective of the image’s viewer, the distinction is more difficult to draw. I address this difficulty by further distinguishing between two attributes of portraits: their representational accuracy, and their ability to convey the artist’s reflection on her experience of seeing the sitter face-to-face. While artificial intelligence can mimic this latter reflective ability, it cannot exactly reproduce it. (shrink)

Although cognitive science was multidisciplinary from the start, an under-emphasis on anthropology has left the field with limited research in small scale, indigenous societies. Neglecting the anthropological perspective is risky, given that once-canonical cognitive science findings have often been shown to be artifacts of enculturation rather than cognitive universals. This imbalance has become more problematic as the increased use of Western theory-driven approaches, many of which assume human uniformity (“universality”), confronts the absence of a robust descriptive base that might provide (...) clarifying or even contrary evidence. We highlight the need for remedies to such shortcomings by suggesting a two-fold methodological shift. First, studies conducted in indigenous societies can benefit by relying on multidisciplinary research groups to diminish ethnocentrism and enhance the quality of the data. Second, studies devised for Western societies can readily be adapted to the changing settings encountered in the field. Here, we provide examples, drawn from the areas of emotion and facial expressions, to illustrate potential solutions to recurrent problems in enhancing the quality of data collection, hypothesis testing, and the interpretation of results. (shrink)