Self-resemblance has been found to have a context-dependent effect when expressing preferences for faces. Whereas dissimilarity preference during mate choice in animals is often explained as an evolutionary adaptation to increase heterozygosity of offspring, self-resemblance can be also favored in humans, reflecting, e.g., preference for kinship cues. We performed two studies, using transformations of facial photographs to manipulate levels of resemblance with the rater, to examine the influence of self-resemblance in single vs. coupled individuals. Raters (...) assessed facial attractiveness of other-sex and same-sex photographs according to both short-term and long-term relationship contexts. We found a preference for dissimilarity of other-sex and same-sex faces in single individuals, but no effect of self-resemblance in coupled raters. No effect of sex of participant or short-term vs. long-term attractiveness rating was observed. The results support the evolutionary interpretation that dissimilarity of other-sex faces is preferred by uncoupled individuals as an adaptive mechanism to avoid inbreeding. In contrast, lower dissimilarity preference of other-sex faces in coupled individuals may reflect suppressed attention to attractiveness cues in potential alternative partners as a relationship maintenance mechanism, and its substitution by attention to cues of kinship and psychological similarity connected with greater likelihood of prosocial behavior acquisition from such persons. (shrink)

Many nonhuman animals produce facial expressions which sometimes bear clear resemblance to the facial expressions seen in humans. An understanding of this evolutionary continuity between species, and how this relates to social and ecological variables, can help elucidate the meaning, function, and evolution of facial expression. This aim, however, requires researchers to overcome the theoretical and methodological differences in how human and nonhuman facial expressions are approached. Here, we review the literature relating to nonhuman (...) class='Hi'>facial expressions and suggest future directions that could facilitate a better understanding of facial expression within an evolutionary context. (shrink)

Trivers’s theory of parental investment suggests that adults should decide whether or not to invest in a given infant using a cost-benefit analysis. To make the best investment decision, adults should seek as much relevant information as possible. Infant facial cues may serve to provide information and evoke feelings of parental care in adults. Four specific infant facial cues were investigated: resemblance (as a proxy for kinship), health, happiness, and cuteness. It was predicted that these cues would (...) influence feelings of parental care for both sexes, but that resemblance would be more important for men than women because of the importance of paternity uncertainty in the ancestral environment. Seventy-six men and 76 women participated in a hypothetical adoption task in which they made judgments of infant faces. Average zero-order, partial, and component score correlations all revealed that men placed primary emphasis on cues of resemblance, while women placed primary emphasis on cues of health and cuteness (cues of infant quality). The correlations also showed that men placed a significantly greater emphasis on cues of resemblance than did women. (shrink)

Human homogamy may be caused in part by individuals’ preference for phenotypic similarities. Two types of preference can result in homogamy: individuals may prefer someone who is similar to themselves (self-referent phenotype matching) or to their parents (a sexual-imprinting-like mechanism). In order to examine these possibilities, we compare faces of couples and their family members in two ways. First, “perceived” similarity between a pair of faces is quantified as similarity ratings given to the pair. Second, “physical” similarity between two groups (...) of faces is evaluated on the basis of correlations in principal component scores generated from facial measurements. Our results demonstrate a tendency to homogamy in facial characteristics and suggest that the tendency is due primarily to self-referent phenotype matching. Nevertheless, the presence of a sexual-imprinting-like effect is also partially indicated: whether individuals are involved in facial homogamy may be affected by their relationship with their parents during childhood. (shrink)

The human face conveys a myriad of social meanings within an overlapping array of features. Herein, we examine such features within the context of gender-emotion stereotypes. First we detail the pervasive set of gender-emotion expectations known to exist. We then review new research revealing that gender cues and emotion expression often share physical properties that represent a confound of overlapping features characteristic of low versus high facial maturity/dominance. As such, gender-related facial appearance and facial expression of emotions (...) often share social meaning and physical resemblance. Thus, stereotypic and phenotypic information conveyed by the face are intertwined—sometimes confounded, sometimes clashing. We discuss implications of this work for gender-emotion stereotypes, as well as for emotion and face processing more generally. (shrink)

Emoji faces, which are ubiquitous in our everyday communication, are thought to resemble human faces and aid emotional communication. Yet, few studies examine whether emojis are perceived as a particular emotion and whether that perception changes based on rendering differences across electronic platforms. The current paper draws upon emotion theory to evaluate whether emoji faces depict anatomical differences that are proposed to differentiate human depictions of emotion. We modified the existing Facial Action Coding System to apply to emoji faces. (...) An equivalent “emoji FACS” rubric allowed us to evaluate two important questions: First, Anatomically, does the same emoji face “look” the same across platforms and versions? Second, Do emoji faces perceived as a particular emotion category resemble the proposed human facial expression for that emotion? To answer these questions, we compared the anatomically based codes for 31 emoji faces across three platforms and two version updates. We then compared those codes to the proposed human facial expression prototype for the emotion perceived within the emoji face. Overall, emoji faces across platforms and versions were not anatomically equivalent. Moreover, the majority of emoji faces did not conform to human facial expressions for an emotion, although the basic anatomical codes were shared among human and emoji faces. Some emotion categories were better predicted by the assortment of anatomical codes than others, with some individual differences among platforms. We discuss theories of emotion that help explain how emoji faces are perceived as an emotion, even when anatomical differences are not always consistent or specific to an emotion. (shrink)

Signed languages employ finely articulated facial and head displays to express grammatical meanings such as mood and modality, complex propositions, information structure, assertions, content and yes/no questions, imperatives, and miratives. In this paper we examine two facial displays: an upper face display in which the eyebrows are pulled together called brow furrow, and a lower face display in which the corners of the mouth are turned down into a distinctive configuration that resembles a frown or upside-down U-shape. Our (...) analysis employs Cognitive Grammar, specifically the control cycle and its manifestation in effective control and epistemic control. Our claim is that effective and epistemic control are associated with embodied actions. Prototypical physical effective control requires effortful activity and the forceful exertion of energy and is commonly correlated with upper face activity, often called the “face of effort.” The lower face display has been shown to be associated with epistemic indetermination, uncertainty, doubt, obviousness, and skepticism. We demonstrate that the control cycle unifies the diverse grammatical functions expressed by each facial display within a language, and that they express similar functions across a wide range of signed languages. (shrink)

Where behavior defies economic analysis, one explanation is that individuals consider more than the immediate payoff. We present evidence that noneconomic factors influence behavior. Attractiveness influences offers in the Ultimatum and Dictator Games. Facial resemblance, a cue of relatedness, increases trusting in a two-node trust game. Only by considering the range of possible influences will game-playing behavior be explained.

People dedicate significant attention to others’ facial expressions and to deciphering their meaning. Hence, knowing whether such expressions are genuine or deliberate is important. Early research proposed that authenticity could be discerned based on reliable facial muscle activations unique to genuine emotional experiences that are impossible to produce voluntarily. With an increasing body of research, such claims may no longer hold up to empirical scrutiny. In this article, expression authenticity is considered within the context of senders’ ability to (...) produce convincing facial displays that resemble genuine affect and human decoders’ judgments of expression authenticity. This includes a discussion of spontaneous vs. posed expressions, as well as appearance- vs. elicitation-based approaches for defining emotion recognition accuracy. We further expand on the functional role of facial displays as neurophysiological states and communicative signals, thereby drawing upon theencoding-decodingandaffect-inductionperspectives of emotion expressions. Theoretical and methodological issues are addressed with the aim to instigate greater conceptual and operational clarity in future investigations of expression authenticity. (shrink)

A variety of theoretical frameworks predict the resemblance of behaviors between two people engaged in communication, in the form of coordination, mimicry, or alignment. However, little is known about the time course of the behavior matching, even though there is evidence that dyads synchronize oscillatory motions (e.g., postural sway). This study examined the temporal structure of nonoscillatory actions—language, facial, and gestural behaviors—produced during a route communication task. The focus was the temporal relationship between matching behaviors in the interlocutors (...) (e.g., facial behavior in one interlocutor vs. the same facial behavior in the other interlocutor). Cross-recurrence analysis revealed that within each category tested (language, facial, gestural), interlocutors synchronized matching behaviors, at temporal lags short enough to provide imitation of one interlocutor by the other, from one conversational turn to the next. Both social and cognitive variables predicted the degree of temporal organization. These findings suggest that the temporal structure of matching behaviors provides low-level and low-cost resources for human interaction. (shrink)

It has been repeatedly stated that approach and avoidance reactions to emotional faces are triggered by the intention signalled by the emotion. This line of thought suggests that each emotion signals a specific intention triggering a specific behavioural reaction. However, empirical results examining this assumption are inconsistent, suggesting that it might be too short-sighted. We hypothesise that the same emotional expression can signal different social messages and, therefore, trigger different reactions; which social message is signalled by an emotional expression should (...) be influenced by moderating variables, such as the group membership of the expresser. In two experiments, we show that group membership influences approach and avoidance reactions to emotional expressions: Emotions (fear and happiness) expressed by in-group members elicited concordant behaviour, whereas emotions expressed by out-group members activated the reverse pattern. A third experiment, in which participants directly evaluated smiling and fearful individuals resembling in-group and out-group members supported this result. (shrink)

The ArgumentPain has important biomedical socioanthropological, semiotic, and other facets. In this contribution pain and the experssion of pain are looked at from the perspective of evolutionary biology, utilizing, among others, cross-cultural data from field work in Melanesia.No other being cares for sick and suffering conspecifics in the way humans do. Notwithstanding aggression and neglect, common in all cultures, human societies can be characterized as empathic, comforting, and promoting the health and well-being of their members. One important stimulus triggering this (...) caring response in others is the expression of pain. The nonverbal channel of communication, particularly certain universal — i.e., culture-independent facial expressions, gestures, and body postures, convey much of the message from the painstricken person to the group.These behaviors signal the person's physical and psychical pain, sadness, grief, and despair in ways very similar to the signs given by infants and small children: the body loses tonus and sinks or drops to the ground, the gestures are those of helplessness. Pain and grief may be so strong that control is lost not only over the body's posture but also over the mind's awareness. In such cases the afflicted person may carry out actions endangering himself or others. In general, these behavior patterns resemble those of infants in situations of distress and danger, and it is not surprising that the response of the members of the group is basically parental: taking care, assisting and consoling.Perceptive and behavioral patterns which developed in the course of avian and mammalian phylogeny to serve the well-being of the young have proven, as was shown by Eibl-Eibesfeldt, to be powerful building blocks for actions in other spheres of human interaction. Love is one such field, the reactions to a conspecific suffering pain is another. (shrink)

The reverse correlation (RC) method has been widely used, because it allows visualization of mental representations without a priori assumptions about relevant dimensions. We employed the RC method to visualize mental representations of self and examined their relationships with traits related to self-image. For this purpose, 110 participants (70 women) performed a two-image forced choice RC task to generate a classification image of self (self-CI). Participants perceived their self-CIs as bearing a stronger resemblance to themselves than did CIs of (...) others (filler-CIs). Valence ratings of participants who performed the RC task (RC sample) and of 30 independent raters both showed positive correlations with self-esteem, explicit self-evaluation, and extraversion. Moreover, valence ratings of independent raters were negatively correlated with social anxiety symptoms. On the other hand, valence ratings of the RC sample and independent raters were not correlated with depression symptoms, trait anxiety, or social desirability. The results imply that mental representations of self can be properly visualized by using the RC method. (shrink)

Previous research has demonstrated how emotion resembling cues in the face help shape impression formation. Perhaps most notable in the literature to date, has been work suggesting that gender-related appearance cues are visually confounded with certain stereotypic expressive cues. Only a couple studies to date have used computer vision to directly map out and test facial structural resemblance to emotion expressions using facial landmark coordinates to estimate face shape. In one study using a Bayesian network classifier trained (...) to detect emotional expressions structural resemblance to a specific expression on a non-expressive face was found to influence trait impressions of others. In another study, a connectionist model trained to detect emotional expressions found different emotion-resembling cues in male vs. female faces. Despite this seminal work, direct evidence confirming the theoretical assertion that humans likewise utilize these emotion-resembling cues when forming impressions has been lacking. Across four studies, we replicate and extend these prior findings using new advances in computer vision to examine gender-related, emotion-resembling structure, color, and texture and their impact on gender-stereotypic impression formation. We show that all three are meaningfully related to human impressions of emotionally neutral faces. Further when applying the computer vision algorithms to experimentally manipulate faces, we show that humans derive similar impressions from them as did the computer. (shrink)

This article focuses on situations and emotional perception. To this end, I start with the Kuleshov effect wherein identical shots of performers manifest different expressions when cut to different contexts. However, I conducted experiments with a twist, using Darth Vader and non-primates, and even here expressions varied with contexts. Building on historically and conceptually linked Gibsonian, Gestalt, phenomenological and pragmatic schools, along with consonant experimental work, I extrapolate these results to defend three interconnected points. First, I argue that while perceiving (...) expression is sometimes about reading minds, it is more squarely about perceiving solicitations or closures for action. Second, I frame expressions as a subcategory of Gibson’s affordances. This includes those showing up through context, in turn suggesting Kuleshov-like scenarios are not mere perceptual tricks. Third, I maintain that situations—with or without other human beings—have action-motivating expressive qualities or what Gestalt theorists called physiognomic characters, following Werner. These likewise emerge through ecological relations, and are very much like affordances and in the world as much as them. With resemblance theories, my account agrees that we perceive expression in the world. However, it indicates a broad range of cases in which expression shows up as consequences of overall situations that solicit or close actions, as opposed to mere resemblance between entities and human expressions. (shrink)

At Aristophanes, Equites 230–2, one of the slaves who speak the prologue informs the audience that, when the Paphlagonian appears onstage, his mask will not resemble him, for the σκεoπoιoí were afraid to make one that depicted him accurately. In an important article, K. J. Dover argued that it must in fact have been very difficult to create easily recognizable portrait-masks, and suggested that the joke in Eq. 230–2 may be that the Paphlagonian's mask is horribly ugly but allegedly still (...) nowhere near ugly enough. In response, D. Welsh, following an anonymous ancient commentator on Lucian, argued that Cratinus fr. 228 K-A shows that the historical Kleon had strikingly unattractive eyebrows. Had anyone wished to caricature the demagogue's physical appearance, therefore, he coule easily have done so, and portrait-masks may not have been so uncommon after all. Welsh's argument is at first glance quite appealing, and has been endorsed without further comment or argument by Sommerstein and Storey. I suggest, however, that the ancient commentator was confused, and that Cratinus’ remark is much more easily explained by reference to what is known about the use of facial expression as a communicative strategy in classical and early Hellenistic Athens, particularly as it appears in the comic poets. Kleon's eyebrows were probably no more ugly than those of anyone else, although he may have used them in an offensive way, and as Dover saw long ago, Eq. 230–2 cannot be taken as evidence for the use of portrait-masks on the late 5th-century comic stage. (shrink)

This book contains three essays: "The Mask and the Face: The Perception of Physiognomic Likeness in Life and Art" by Gombrich, the renowned art historian and critic; "The Representation of Things and People" by psychologist, Julian Hochberg; and "How Do Pictures Represent" by philosopher, Max Black. The book is based upon lectures delivered in the Johns Hopkins 1970 Thalheimer Lectures, where, taking off from the question "how there can be an underlying identity in the manifold and changing facial expression (...) of a single individual," there is an interdisciplinary attempt at clarifying the problem of representation. Gombrich’s central thesis is that the key to artistic representation is empathy and projection, which is guided by the interlocking display of the permanent and mobile features of the object represented. Perceptual activity and empathy rely more on the muscular imitation than on passive visual reception. He holds that what is singled out as the likeness-factor uniting the permanent and mobile features in, for example, the photograph of the four-year old Lord Russell and such factors in the ninety-year old Russell is the "general tonus, the melody of transition from given ranges of relaxations to forms of tenseness." Hochberg’s essay spells out the position that perception is purposive behavior, wherein the purpose is the information sought and behavior is the "succession of glances in different directions." Holding that perceptual activity is grounded in expectations, he lays aside Gombrich’s muscularity-thesis in favor of a learned expectation of feature characteristics. Black’s essay is a conceptual analysis of "depiction," or more precisely, of "P displays a subject S if and only if R, where R ‘will constitute the necessary and sufficient condition for P displaying S'." The essay, which proceeds in a Wittgensteinian Investigations-type fashion ends where the reader would hope it begin. He concludes that the problem can only be adequately answered by moving from logical investigation to the world of the artisan and art lover. To arrive at this conclusion he debunks six candidates that claim to meet the depiction conditions: causal history, selective information, intention, mimesis, resemblance, and "looking-like." At best, depiction may be considered a "cluster" concept of all six. Further determination, he holds, requires knowledge of the purpose of a particular depiction, and this takes us out of logic and into art; and so Black stops, unfortunately.—W. A. F. (shrink)

Mark Coeckelbergh starts his book with a very powerful picture based on a real incident: On the 9th of January 2020, Robert Williams was wrongfully arrested by Detroit police officers in front of his two young daughters, wife and neighbors. For 18 hours the police would not disclose the grounds for his arrest (American Civil Liberties Union 2020; Hill 2020). The decision to arrest him was primarily based on a facial detection algorithm which matched Mr. Williams’ driving license photo (...) with the picture of a man who was suspected of watch theft two years earlier. Not only did the computer ‘get it wrong’ as one of the detectives said, when Mr. Williams made them aware that the picture of the suspect obviously wasn’t resembling him, the probably unreliable algorithm very likely contributed to racial discrimination (Hill 2020). It is well documented that many available facial detection algorithms at this time had significant problems (e.g. a comparably high false positive rate) with respect to black persons, like Mr. Williams (NIST 2019). Multiple causes may exist, such as unbalanced training datasets and insufficient optimization. Coeckelbergh compares the disturbing case of Mr. Williams with a political interpretation of Franz Kafka’s The Trial, where the protagonist, Josef K., is accused of an unspecified crime by an opaque, oppressive and absurd bureaucracy: “In the 21st-century United States, Josef K. is black and is falsely accused by an algorithm, without explanation” (p. 2). (shrink)

Recent scientific and technological developments enable the generation of increasingly sophisticated organoids: three-dimensional, lab-grown stem cell-based entities that model human organs anatomi...

We argue that one important aspect of the “cognitive neuroscience revolution” identified by Boone and Piccinini :1509–1534. doi: 10.1007/s11229-015-0783-4, 2015) is a dramatic shift away from thinking of cognitive representations as arbitrary symbols towards thinking of them as icons that replicate structural characteristics of their targets. We argue that this shift has been driven both “from below” and “from above”—that is, from a greater appreciation of what mechanistic explanation of information-processing systems involves, and from a greater appreciation of the problems (...) solved by bio-cognitive systems, chiefly regulation and prediction. We illustrate these arguments by reference to examples from cognitive neuroscience, principally representational similarity analysis and the emergence of dynamical models as a central postulate in neurocognitive research. (shrink)

To define the determinants of impaired facial emotion recognition (FER) in patients with mesial temporal lobe epilepsy associated with hippocampal sclerosis (MTLE-HS), we examined 76 patients with unilateral MTLE-HS, 36 prior to antero-mesial temporal lobectomy (AMTL) and 40 after AMTL, and 28 healthy control subjects with a FER test consisting of 60 items (20 each for anger, fear, and happiness). Mean percentages of the accurate responses were calculated for different subgroups: right vs. left MTLE-HS, early (age at onset <6 (...) years) vs. late-onset, and before vs. after AMTL. After controlling for years of education, duration of epilepsy and number of antiepileptic drugs (AEDs) taken, on multivariate analysis, fear recognition was profoundly impaired in early-onset right MTLE-HS patients compared to other MTLE patients and control subjects. Happiness recognition was significantly better in post-AMTL MTLE-HS patients compared to pre-AMTL patients while anger and fear recognition did not differ. We conclude that patients with right MTLE-HS with age at seizure onset <6 years are maximally predisposed to impaired fear recognition. In them, right AMTL does not further worsen FER abilities. Longitudinal studies comparing FER in the same patients before and after AMTL will be required to refine and confirm our cross-sectional observations. (shrink)

Emotional facial expressions can inform researchers about an individual's emotional state. Recent technological advances open up new avenues to automatic Facial Expression Recognition (FER). Based on machine learning, such technology can tremendously increase the amount of processed data. FER is now easily accessible and has been validated for the classification of standardized prototypical facial expressions. However, applicability to more naturalistic facial expressions still remains uncertain. Hence, we test and compare performance of three different FER systems (Azure (...) Face API, Microsoft; Face++, Megvii Technology; FaceReader, Noldus Information Technology) with human emotion recognition (A) for standardized posed facial expressions (from prototypical inventories) and (B) for non-standardized acted facial expressions (extracted from emotional movie scenes). For the standardized images, all three systems classify basic emotions accurately (FaceReader is most accurate) and they are mostly on par with human raters. For the non-standardized stimuli, performance drops remarkably for all three systems, but Azure still performs similarly to humans. In addition, all systems and humans alike tend to misclassify some of the non-standardized emotional facial expressions as neutral. In sum, emotion recognition by automated facial expression recognition can be an attractive alternative to human emotion recognition for standardized and non-standardized emotional facial expressions. However, we also found limitations in accuracy for specific facial expressions; clearly there is need for thorough empirical evaluation to guide future developments in computer vision of emotional facial expressions. (shrink)

This paper proposes that human expression of pain in the presence or absence of caregivers, and the detection of pain by observers, arises from evolved propensities. The function of pain is to demand attention and prioritise escape, recovery, and healing; where others can help achieve these goals, effective communication of pain is required. Evidence is reviewed of a distinct and specific facial expression of pain from infancy to old age, consistent across stimuli, and recognizable as pain by observers. Voluntary (...) control over amplitude is incomplete, and observers can better detect pain that the individual attempts to suppress rather than amplify or simulate. In many clinical and experimental settings, the facial expression of pain is incorporated with verbal and nonverbal vocal activity, posture, and movement in an overall category of pain behaviour. This is assumed by clinicians to be under operant control of social contingencies such as sympathy, caregiving, and practical help; thus, strong facial expression is presumed to constitute an attempt to manipulate these contingencies by amplification of the normal expression. Operant formulations support skepticism about the presence or extent of pain, judgments of malingering, and sometimes the withholding of caregiving and help. To the extent that pain expression is influenced by environmental contingencies, however, could equally plausibly constitute the release of suppression according to evolved contingent propensities that guide behaviour. Pain has been largely neglected in the evolutionary literature and the literature on expression of emotion, but an evolutionary account can generate improved assessment of pain and reactions to it. (shrink)

In A Treatise of Human Nature 1.4.2, entitled ‘Of Scepticism with Regard to the Senses’, Hume discussed the causes of belief in the existence of external objects. Philosophers, correcting the false...

The use of facial recognition technology (FRT) as a form of intelligence has recently made a prominent public appearance in the theater of war. During the early months of Russia's invasion of Ukraine, Ukrainian authorities relied on FRT as part of the country's defensive activities, harnessing the technology for a variety of purposes, such as unveiling covert Russian agents operating amid the Ukrainian population; revealing the identity of Russian soldiers who committed war crimes; and even identifying dead Russian soldiers. (...) This constellation of uses of FRT—in a war increasingly waged on the digital and information front—warrants ethical examination. The essay discusses some of the most serious concerns with FRT in the context of war, including the infringement of informational privacy; the indiscriminate and disproportionate harms it may inflict, particularly when the technology is coupled with social media intelligence; and the potential abuse of the technology once the fog of war dissipates. Some of these concerns parallel those to be found in nations that are not engulfed in war, but others are unique to war-torn settings. (shrink)

This article focuses on a theoretical account integrating classic and recent findings on the communication of emotions across cultures: a dialect theory of emotion. Dialect theory uses a linguistic metaphor to argue emotion is a universal language with subtly different dialects. As in verbal language, it is more challenging to understand someone speaking a different dialect—which fits with empirical support for an in-group advantage, whereby individuals are more accurate judging emotional expressions from their own cultural group versus foreign groups. Dialect (...) theory has sparked controversy with its implications for dominant theories about cross-cultural differences in emotion. This article reviews the theory, its mounting body of evidence, evidence for alternative accounts, and practical implications for multicultural societies. (shrink)

This article discusses how research on the image-based analysis of facial images has informed this debate by demonstrating that a single representational system for facial identity and facial expression is not only computationally viable, but can simulate existing cognitive data demonstrating apparent dissociable processing of these two facial properties. It discusses the increasing number of cognitive studies that provide support for this view. Neuropsychological case studies of brain-injured patients and provide limited evidence for separate visual routes (...) processing facial identity and facial expression. It deals with neuroimaging studies addressing both facial identity and facial expression processing which shows that the fusiform gyrus contributes to the recognition of both facial properties. Research continues to reinforce the proposal that a common visual framework supports the representation of at least some aspects of facial identity and facial expression. (shrink)

Research on facial emotion expression has mostly focused on emotion recognition, assuming that a small number of discrete emotions is elicited and expressed via prototypical facial muscle configurations as captured in still photographs. These are expected to be recognized by observers, presumably via template matching. In contrast, appraisal theories of emotion propose a more dynamic approach, suggesting that specific elements of facial expressions are directly produced by the result of certain appraisals and predicting the facial patterns (...) to be expected for certain appraisal configurations. This approach has recently been extended to emotion perception, claiming that observers first infer individual appraisals and only then make categorical emotion judgments based on the estimated appraisal patterns, using semantic inference rules. Here we report two related studies to empirically investigate the facial action unit configurations that are used by actors to convey specific emotions in short affect bursts and to examine to what extent observers can infer a person’s emotions from the predicted facial expression configurations. The results show that 1) professional actors use many of the predicted facial action unit patterns to enact systematically specified appraisal outcomes in a realistic scenario setting, and 2) naïve observers infer the respective emotions based on highly similar facial movement configurations with a degree of accuracy comparable to earlier research findings. Based on estimates of underlying appraisal criteria for the different emotions we conclude that the patterns of facial action units identified in this research correspond largely to prior predictions and encourage further research on appraisal-driven expression and inference. (shrink)

This paper studies dialogicity in posts and their comments. Focusing on political slogans in the Facebook page of Israel PM Binyamin Netanyahu, we examine the ways comments meta-represent the posts in various degrees of resemblance. Starting with the premise that comments/post interactions are dialogic in the Bakhtinian sense, we argue that comments are dialogic in yet another way, which is related to the form and degree of resemblance between them. The conceptualization draws on the notion of meta-representation supplemented (...) by insights gained from accommodation theory and Bakhtin’s dialogism. We argue that through resemblance, the propositional content, ideology and viewpoint conveyed by the initiating slogan are incorporated in the comment, and a tacit dialogue is constructed between them. An additional layer of polyphony is added to the multiplicity of ratified voices otherwise manifest in the interaction between separate posts and comments. (shrink)

In this paper, we report on an experiment with The Walking Dead (TWD), which is a narrative-driven adventure game with morally charged decisions set in a post-apocalyptic world filled with zombies. This study aimed to identify physiological markers of moral decisions and non-moral decisions using infrared thermal imaging (ITI). ITI is a non-invasive tool used to capture thermal variations due to blood flow in specific body regions that might be caused by sympathetic activity. Results show that moral decisions seem to (...) elicit a significant decrease in temperature in the chin region 20 seconds after participants are presented with a moral decision. However, given the small sample involved, and the lack of significance in other regions, future studies might be needed to confirm the results obtained in this work. (shrink)

To characterize human emotions, researchers have increasingly utilized Automatic Facial Expression Analysis (AFEA), which automates the Facial Action Coding System (FACS) and translates the facial muscular positioning into the basic universal emotions. There is broad interest in the application of FACS for assessing consumer expressions as an indication of emotions to consumer product-stimuli. However, the translation of FACS to characterization of emotions is elusive in the literature. The aim of this systematic review is to give an overview (...) of how FACS has been used to investigate human emotional behavior to consumer product-based stimuli. The search was limited to studies published in English after 1978, conducted on humans, using FACS or its action units to investigate affect, where emotional response is elicited by consumer product-based stimuli evoking at least one of the five senses. The search resulted in an initial total of 1,935 records, of which 55 studies were extracted and categorized based on the outcomes of interest including (i) method of FACS implementation; (ii) purpose of study; (iii) consumer product-based stimuli used; and (iv) measures of affect validation. Most studies implemented FACS manually (73%) to develop products and/or software (20%) and used consumer product-based stimuli that had known and/or defined capacity to evoke a particular affective response, such as films and/or movie clips (20%); minimal attention was paid to consumer products with low levels of emotional competence or with unknown affective impact. The vast majority of studies (53%) did not validate FACS-determined affect and, of the validation measures that were used, most tended to be discontinuous in nature and only captured affect as it holistically related to an experience. This review illuminated some inconsistencies in how FACS is carried out as well as how emotional response is inferred from facial muscle activation. This may prompt researchers to consider measuring the total consumer experience by employing a variety of methodologies in addition to FACS and its emotion-based interpretation guide. Such strategies may better conceptualize consumers' experience with products of low, unknown, and/or undefined capacity to evoke an affective response such as product prototypes, line extensions, etc. (shrink)

While numerous studies have examined the relationships between facial actions and emotions, they have yet to account for the ways that specific spontaneous facial expressions map onto emotional experiences induced without expressive intent. Moreover, previous studies emphasized that a fine-grained investigation of facial components could establish the coherence of facial actions with actual internal states. Therefore, this study aimed to accumulate evidence for the correspondence between spontaneous facial components and emotional experiences. We reinvestigated data from (...) previous research which secretly recorded spontaneous facial expressions of Japanese participants as they watched film clips designed to evoke four different target emotions: surprise, amusement, disgust, and sadness. The participants rated their emotional experiences via a self-reported questionnaire of sixteen emotions. These spontaneous facial expressions were coded using the Facial Action Coding System, the gold standard for classifying visible facial movements. We corroborated each facial action that was present in the emotional experiences by applying stepwise regression models. The results found that spontaneous facial components occurred in ways that cohere to the their evolutionary functions based on the rating values of emotional experiences (e.g., the inner brow raiser might be involved in the evaluation of novelty). This study provided new empirical evidence for the correspondence between each spontaneous facial component and first-person internal states of emotion as reported by the expresser. (shrink)