Drawn sequences of images, like those in comics and picture stories, are a pervasive and fundamental way that humans have communicated for millennia. Yet, the study of visual narratives has only recently gained traction in Cognitive Science. Here we explore what has held back the study of the cognition of visual narratives, and why researchers should join in scholarship of this ubiquitous aspect of expression.

Visual narratives like comics involve a range of complex cognitive operations in order to be understood. The Parallel Interfacing Narrative‐Semantics (PINS) Model integrates an emerging literature showing that comprehension of wordless image sequences balances two representational levels of semantic and narrative structure. The neurocognitive mechanisms that guide these processes are argued to overlap with other domains, such as language and music.

Narratives are an integral part of human expression. In the graphic form, they range from cave paintings to Egyptian hieroglyphics, from the Bayeux Tapestry to modern day comic books (Kunzle, 1973; McCloud, 1993). Yet not much research has addressed the structure and comprehension of narrative images, for example, how do people create meaning out of sequential images? This piece helps fill the gap by presenting a theory of Narrative Grammar. We describe the basic narrative categories and their relationship to a (...) canonical narrative arc, followed by a discussion of complex structures that extend beyond the canonical schema. This demands that the canonical arc be reconsidered as a generative schema whereby any narrative category can be expanded into a node in a tree structure. Narrative “pacing” is interpreted as a reflection of various patterns of this embedding: conjunction, left-branching trees, center-embedded constituencies, and others. Following this, diagnostic methods are proposed for testing narrative categories and constituency. Finally, we outline the applicability of this theory beyond sequential images, such as to film and verbal discourse, and compare this theory with previous approaches to narrative and discourse. (shrink)

Name der Zeitschrift: Semiotica - Journal of the International Association for Semiotic Studies / Revue de l'Association Internationale de Sémiotique Jahrgang: 2013 Heft: 197 Seiten: 35-63.

Cohn's (2013) theory of “Visual Narrative Grammar” argues that sequential images take on categorical roles in a narrative structure, which organizes them into hierarchic constituents analogous to the organization of syntactic categories in sentences. This theory proposes that narrative categories, like syntactic categories, can be identified through diagnostic tests that reveal tendencies for their distribution throughout a sequence. This paper describes four experiments testing these diagnostics to provide support for the validity of these narrative categories. In Experiment 1, participants (...) reconstructed unordered panels of a comic strip into an order that makes sense. Experiment 2 measured viewing times to panels in sequences where the order of panels was reversed. In Experiment 3, participants again reconstructed strips but also deleted a panel from the sequence. Finally, in Experiment 4 participants identified where a panel had been deleted from a comic strip and rated that strip's coherence. Overall, categories had consistent distributional tendencies within experiments and complementary tendencies across experiments. These results point toward an interaction between categorical roles and a global narrative structure. (shrink)

Cognitive Science, Volume 46, Issue 7, July 2022.

Morin argues that ideographies are limited because graphic codes lack a capacity for proliferating standardization. However, natural graphic systems display rich standardization and can be placed in sequences using complex combinatorial structures. In contrast, ideographies are not natural, and their limitations lie in their attempts to artificially force a graphic system to behave like a writing system.

Emoji have been ubiquitous in communication for over a decade, yet how they derive meaning remains underexplored. Here, we examine an aspect fundamental to linguistic meaning‐making: the degree to which emoji have conventional lexicalized meanings and whether that conventionalization affects processing in real‐time. Experiment 1 establishes a range of meaning agreement levels across emoji within a population; Experiment 2 measures accuracy and response times to word‐emoji pairings in a match/mismatch task. In this experiment, we found that accuracy and response time (...) both correlated significantly with the level of population‐wide meaning agreement from Experiment 1, suggesting that lexical access of single emoji may be comparable to that of words, even out of context. This is consistent with theories of a multimodal lexicon that stores links between meaning, structure, and modality in long‐term memory. Altogether, these findings suggest that emoji can allow a range of entrenched, lexicalized representations. (shrink)

Static depiction of motion, particularly lines trailing behind a mover, has long been of interest in the psychology literature. Empirical research has demonstrated that these “motion lines” benefited motion comprehension in static images by disambiguating the direction of movement. Yet, there is no consensus on how those lines derive their meaning. In this article, we review three accounts suggesting different interpretations of what motion lines represent. While a perceptual account considers motion lines originating from motion streaks in the primary visual (...) cortex, metaphorical and lexical accounts propose them as graphical conventions that should be learned—either through resemblance to sensory experiences (e.g., natural path marks) or directly being mapped to a conceptual category of paths. To contrast these three accounts, we integrate empirical research on motion lines and their understanding. Overall, developmental, proficiency, and cross-cultural variances indicate that the understanding of motion lines is neither innate nor universal, thus providing less support for lines having a purely perceptual origin. Rather, we argue the empirical findings suggest that motion lines are not iconic depictions of visual percepts but are graphical conventions indexing conceptual path information, which need to be learned and encoded in a visual lexicon. (shrink)

Visual narratives, like comics, at times show depictions of characters’ imagination, dreams, or flashbacks, which seem incongruent with the ongoing primary narrative. Such “domain constructions” thus integrate an auxiliary domain (e.g. a dream) within the primary domain (the expected, physical storyworld), and may require readers to resolve seemingly non-co-referential figures as co-referential (e.g. when a character’s dream shows that character as an animal). In three self-paced reading experiments, we investigate the processing and understanding of single vs. multiple domains in sequences (...) with co-reference issues (Exp. 1) and whether graphic cues facilitate such domain switches (Exp. 2 and 3). Domain switches incurred greater updating costs but were comprehensible, with greater similarity across panels predicting faster processing, and comic reading experience affecting viewing times. The successful integration of fantasized agents which seem to lack co-reference implies that visual narrative comprehension goes beyond event and scene perception alone, but also involves proficiency in conventional constructions related to perspective-taking and inferencing. (shrink)

This paper critically assesses whether quantum entanglement can be made compatible with Humean supervenience. After reviewing the prima facie tension between entanglement and Humeanism, I outline a recently-proposed Humean response, and argue that it is subject to two problems: one concerning the determinacy of quantities, and one concerning its relationship to scientific practice.

Governments, physicians, media and academics have all called for individuals to bear responsibility for their own health. In this article, I argue that requiring those with adverse health outcomes to bear responsibility for these outcomes is a bad basis for policy. The available evidence strongly suggests that the capacities for responsible choice, and the circumstances in which these capacities are exercised, are distributed alongside the kinds of goods we usually talk about in discussing distributive justice, and this distribution significantly explains (...) why people make bad health choices. These facts suggest that we cannot justifiably hold them responsible for these choices. We do better to hold responsible those who determine the ways in which capacities and circumstances are distributed: they are indirectly responsible for these adverse health outcomes and possess the capacities and resources to take responsibility for these facts. (shrink)

Given the tremendous proliferation of student plagiarism involving the Internet, the purpose of this study is to determine which theory of ethical reasoning students invoke when defending their transgressions: deontology, utilitarianism, rational self-interest, Machiavellianism, cultural relativism, or situational ethics. Understanding which theory of ethical reasoning students employ is critical, as preemptive steps can be taken by faculty to counteract this reasoning and prevent plagiarism. Additionally, it has been demonstrated that unethical behavior in school can lead to unethical behavior in business; (...) therefore, correcting unethical behavior in school can have a positive impact on organizational ethics. To meet this objective, a content analysis was conducted on the written records of students formally charged with plagiarizing at a large West Coast university. Each case was classified according to the primary ethical reasoning that the student used to justify plagiarism. Results indicate that students predominately invoke deontology, situational ethics, and Machiavellianism. Based on these findings, specific recommendations are offered to curb plagiarism. (shrink)

In applied ethics, debates about responsibility have been relentlessly individualistic and synchronic, even as recognition has increased in both philosophy and psychology that agency is distributed across time and individuals. I therefore warmly welcome Brown and Savulescu’s analysis of the conditions under which responsibility can be shared and extended. By carefully delineating how diachronic and dyadic responsibility interact with the long-established control and epistemic conditions, they lay the groundwork needed for identifying how responsibility may be inter-individual and intra-individual. Unsurprisingly, I (...) don’t agree with every aspect of their rich account. I strongly suspect that the privileged place the individual continues to occupy in their taxonomy is a residue of the kind of internalist intuitions which dominate WEIRD thinking.1 2 However, I won’t pursue this line of thought here. Instead, I apply Brown and Savulescu’s analysis. Moving beyond the programmatic level at which they develop their account, I will show how it provides a basis for excusing many individuals, focusing not on the dyadic level but the diachronic. Most of the …. (shrink)

Can our cultural membership excuse us from responsibility for certain actions? Ought the Aztec priest be held responsible for murder, for instance, or does the fact that his ritual sacrifice is mandated by his culture excuse him from blame? Our intuitions here are mixed; the more distant, historically and geographically, we are from those whose actions are in question, the more likely we are to forgive them their acts, yet it is difficult to pinpoint why this distance should excuse. Up (...) close, historically or geographically, we tend to be less forgiving: few of us excuse the Taliban for what they did to women and homosexuals; and if there is less of an outcry concerning treatment not all that dissimilar in Saudi Arabia and elsewhere, this is probably only because these actions are less well publicized. (shrink)

I distinguish and assess three separate arguments utilized by the opponents of cochlear implants: that treating deafness as a medical condition is inappropriate since it is not a disability; that so treating it sends a message to the Deaf that they are of lesser worth; and that the use of such implants would signal the end of Deaf culture. I give some qualified support to the first and second claim, but find that the principal weight of the argument must be (...) borne by the third argument: that use of the cochlear implants is impermissible because Deaf culture is intrinsically valuable. I show that this claim is, in practice, incompatible with the claim that deafness is not a disability: that the significant disadvantages suffered by the hearing impaired can only be corrected by measures that would end Deaf culture. Since the potential recipients of cochlear implants are, in the main, the prelingually deaf children of hearing parents, the burden of banning the implants would be borne by people who are not members of Deaf culture, and who owe that culture nothing over and above what we all owe cultures in general. I conclude that we cannot ask the parents of these children to sacrifice the interests of their children for the sake of Deaf culture. (shrink)

When it comes to scientific explanation, our parsimonious tendencies mean that we focus almost exclusively on those dispositions whose manifestations result in some sort of change – changes in properties, locations, velocities and so on. Following this tendency, our notion of causation is one that is inherently dynamic, as if the maintenance of the status quo were merely a given. Contrary to this position, I argue that a complete concept of causation must also account for dispositions whose manifestations involve no (...) changes at all, and that a causal theory that fails to include these ‘static’ dispositions alongside the dynamic ones renders static occurrences miraculous. (shrink)

Neuroethics is a rapidly growing subfield, straddling applied ethics, moral psychology and philosophy of mind. It has clear affinities to bioethics, inasmuch as both are responses to new developments in science and technology, but its scope is far broader and more ambitious because neuroethics is as much concerned with how the sciences of the mind illuminate traditional philosophical questions as it is with questions concerning the permissibility of using technologies stemming from these sciences. In this article, I sketch the two (...) branches of neuroethics, the applied and the philosophical, and illustrate how they interact. I also consider representative themes from each: the ethics of dampening memory and of cognitive enhancement, on the one hand, and the attack upon the reliability of deontological intuitions and upon free will, on the other. (shrink)

In a recent article in this journal, Storrs McCall and E.J. Lowe sketch an account of indeterminist free will designed to avoid the luck objection that has been wielded to such effect against event‐causal libertarianism. They argue that if decision‐making is an indeterministic process and not an event or series of events, the luck objection will fail. I argue that they are wrong: the luck objection is equally successful against their account as against existing event‐causal libertarianisms. Like the event‐causal libertarianism (...) their account is meant to supplant, the process view cannot offer a reasons explanation of the agent’s choice itself; that choice is explained by nothing except chance. The agent therefore fails to exercise freedom‐level control over it. (shrink)

This study examines how the Gödel phenomena are to be treated in core logic. We show in formal detail how one can use core logic in the metalanguage to prove Gödel’s incompleteness theorems for arithmetic even when classical logic is used for logical closure in the object language.

The influence of virtue theory is spreading to the professions. I argue that journalists and educators would do well to refrain from placing too much faith in the power of the virtues to guide working journalists. Rather than focus on the character of the journalist, we would do better to concentrate on institutional constraints on unethical conduct. I urge this position in the light of the critique of virtue ethics advanced, especially, by Gilbert Harman (1999). Harman believed that the empirical (...) findings of psychologists show that character-based approaches to ethics are useless. I suspect that this rather overstates the case. Nevertheless, special features of journalism make virtue-centered approaches especially inappropriate, and we had best turn to alternatives. (shrink)

Inferentialism is explained as an attempt to provide an account of meaning that is more sensitive (than the tradition of truth-conditional theorizing deriving from Tarski and Davidson) to what is learned when one masters meanings.

Papers presented at the IVR 11th World Congress, Helsinki, 1983.

I investigate the problem of contracting a dependency-network with respect to any of its nodes. The resulting contraction must not contain the node in question, but must also be a minimal mutilation of the original network. Identifying successful and minimally mutilating contractions of dependency-networks is non-trivial, especially when non-well-founded networks are to be taken into account. I prove that the contraction problem is NP-complete.1.

An epistemic trespasser is someone who lacks expertise in a domain yet expresses an opinion about its subject matter based on their own assessment of the evidence. Epistemic trespassing is prima facie problematic, but philosophers have argued that it is appropriate when the trespasser possesses relevant skills and evidence. We argue that this defence is available to epistemic trespassers more often than most philosophers have recognized, but it does not vindicate trespassing. The justified trespasser must also possess an appropriately refined (...) sense of how and to whom they ought to defer, with ‘deference’ understood as taking opinions and the shape of debates very seriously in deliberation, and as appropriate caution in dissent. This sense of what we call the guardrails is constituted largely by a kind of know-how, which arises from long experience in a domain: the epistemic trespasser almost always lacks this know-how. (shrink)

This is a reply to Timothy Williamson ’s paper ‘Tennant’s Troubles’. It defends against Williamson ’s objections the anti-realist’s knowability principle based on the author’s ‘local’ restriction strategy involving Cartesian propositions, set out in The Taming of the True. Williamson ’s purported Fitchian reductio, involving the unknown number of books on his table, is analyzed in detail and shown to be fallacious. Williamson ’s attempt to cause problems for the anti-realist by means of a supposed rigid designator generates a contradiction (...) with arithmetic right away, upon instantiating the obviously relevant theorem that every natural number is provably odd or provably even. The paper also explains and formulates a globally restricted knowability principle, which likewise blocks the attempted reductio. (shrink)

All parties to the proceedings that follow concur with DS. The question is whether there is anything more to truth than can be gleaned from DS alone. Deflationism holds that there is nothing more to truth than this. Now it would appear that 'warrantedly assertible' can play the role of T in DS. Hence it would appear that the deflationist would be able to identify truth with warranted assertibility.

The historiography of the ‘dark age’ of biochemistry between 1910–1930 is examined. The biochemistry of the period is located within a larger contemporary debate on the interrelationship between structure and function on a submicroscopic level. It is suggested that biocolloid science was an understandable part of the historical development of biochemistry, representing a conceptual bridge between the cell biology of the late nineteenth century, and the era of structural macromolecular studies of proteins that began after 1930.

Are moral properties intellectually indispensable, and, if so, what consequences does this have for our understanding of their nature, and of our talk and knowledge of them? Are mathematical objects intellectually indispensable, and, if so, what consequences does this have for our understanding of their nature, and of our talk and knowledge of them? What similarities are there, if any, in the answers to the first two questions? Can comparison of the two cases shed light on which answers are most (...) plausible in either case? This chapter – the introduction to the volume Explanation in Ethics and Mathematics – elucidates these questions and sketches their history. (shrink)

The system of natural deduction that originated with Gentzen , and for which Prawitz proved a normalization theorem, is re-cast so that all elimination rules are in parallel form. This enables one to prove a very exigent normalization theorem. The normal forms that it provides have all disjunction-eliminations as low as possible, and have no major premisses for eliminations standing as conclusions of any rules. Normal natural deductions are isomorphic to cut-free, weakening-free sequent proofs. This form of normalization theorem renders (...) unnecessary Gentzen's resort to sequent calculi in order to establish the desired metalogical properties of his logical system.Ultimate normal forms are well-adapted to the needs of the computational logician, affording valuable constraints on proof-search. They also provide an analysis of deductive relevance. There is a deep isomorphism between natural deductions and sequent proofs in the relevantized system. (shrink)

This paper considers the subjectivation of students in light of the increasing amounts of digital data that are now being produced within schools. Taking a lead from critical data studies and the sociology of numbers, the paper draws on staff interviews in three Australian secondary schools to explore the various types of student data being generated, and the forms of student subjectivities that result. In particular, the paper contrasts the ‘holistic’ possibilities that some school leaders and administrators ascribe to data (...) in terms of expanding the capacity to ‘know’ students, against the limited ways that data is actually being used within the schools. Most notably, the paper details how digital data appears to be configured within schools’ official data procedures and practices to build student subjectivities and position students in narrow terms of performance and attendance. The paper also highlights how teachers make practical use of these limited data ‘profiles’ in a relational manner – as a way of stimulating dialogue with students to know them better, rather than a source of precise calculation. In this sense, the paper considers how ‘data’ might be reframed in educational discourse as a practical starting-point for teacher inquiry and professional judgment rather than an imagined source of all-encompassing knowledge. (shrink)

The question whether and when it is morally appropriate to withdraw life-support from patients diagnosed as being in the persistent vegetative state is one of the most controversial in bioethics. Recent work on the neuroscience of consciousness seems to promise fundamentally to alter the debate, by demonstrating that some entirely unresponsive patients are in fact conscious. In this paper, I argue that though this work is extremely important scientifically, it ought to alter the debate over the moral status of the (...) patients very little. First, the data presented is complex and difficult to interpret; we should be wary of taking the claimed discovery entirely at face value (though the remaining questions will probably be settled by future research). Second, though the demonstration that some of the patients are in fact conscious would show that they are moral patients, and therefore beings whose welfare must be taken into account, it would not, by itself at any rate, show that they have an interest in continued life. (shrink)

Peter Milne (2007) poses two challenges to the inferential theorist of meaning. This study responds to both. First, it argues that the method of natural deduction idealizes the essential details of correct informal deductive reasoning. Secondly, it explains how rules of inference in free logic can determine unique senses for the existential quantifier and the identity predicate. The final part of the investigation brings out an underlying order in a basic family of free logics.