Purpose This paper aims to review and critically assess the role that data visualizations played as communication media tools to help society during a worldwide crisis. This paper re-creates and analyzes several visualizations, critically and ethically assesses their strengths and limitations and provides a set of best practices that are informative, accurate, ethical and engaging at each stage in a reader’s interest. Design/methodology/approach The paper bases its methodology on the construct of “The Network Society” (Van Dijk, 2006; (...) Castells, 2000, 2006) by creating a series of social networked visualizations, identifying the challenges and pitfalls associated with this communication approach and suggesting best practices in information communication technology. The case study is COVID-19. Findings The research in this study found that visual data dashboards and interactive Web-based charts did play a significant role in helping society understand COVID-19’s impact to make better informed decisions about society’s health and safety. Research limitations/implications Visual expositions of data do have strengths and weaknesses depending on how they are designed, how they communicate the story and how they are ethically deployed. Best practices are provided to help mitigate these limitations. Practical implications Visualizations are certainly not new, but the technology for rapidly developing and sharing them is new. Visual expositions provide an effective media for communicating complex information to a networked society. Social implications Visual expositions provide an effective media for communicating complex information to a networked society. Originality/value This paper highlights the significance of the need to understand complex data in a crisis in a visual format and to communicate the information quickly, persuasively, effectively and ethically to a networked audience. (shrink)

Data literacy – the ability to analyze, interpret, evaluate, and use data and data visualizations – has become increasingly important for understanding and communicating information in the discipline of history. In the United States, curricular standards and standardized assessments already reflect this importance, but educators lack a clear picture of how students use data visualizations when reasoning about the past. How do students use data visualizations when reasoning about a historical question? To (...) what degree does using data visualizations enhance students’ historical reasoning? What challenges do students face when attempting to use data visualizations? This study addresses these questions, investigating how fifth-grade, eighth-grade, and high school students use data visualizations from typical school textbooks. Twenty-seven students were interviewed, surveyed, and asked to think aloud about a historical question while using a textbook entry that included a data visualization. Results from qualitative and quantitative analyses highlight the potential for data visualizations to enhance historical reasoning. However, results also indicate that students are unlikely to read data visualizations on their own, underscoring the importance of providing targeted data literacy instruction. (shrink)

Climate change is difficult to connect with personally, because people only regard the phenomenon as important if it becomes a perceived threat to themselves. Arguments like statistics and policy debates are extrinsic motivators, which do not necessarily align people’s own intrinsic motives with those of climate action. Instead, narratives and visual communication can influence viewers implicitly by the way they show and reinforce actions and thoughts that align with climate action. In this design study, we used comics created for human-level (...) climate change influence to promote ideas like future-based thinking, sharing of responsibility, and caring for each other. We also created data visuals that illustrate future consequences of climate change for the purpose of averting negative alternative realities. To see whether our design can affect audience perception of climate change on the human level of goals and desires, we showed the comics to readers unfamiliar with the themes of the stories, presenting them as manga about characters and situations. The survey showed that data stories can affect the way naive readers interpret narratives to align with pro-climate attitudes such as sharing and future-vision, and that readers are focused on the human-level of the data and story as opposed to the physical resource level. Speculative fiction and data visuals provide a potentially effective way to influence individuals’ climate change attitudes by showing alternative realities and attributes of collective responsibility and planning-for-the-future as data stories. (shrink)

In response to the ubiquitous graphs and maps of COVID-19, artists, designers, data scientists, and public health officials are teaming up to create counter-plots and subaltern maps of the pandemic. In this intervention, we describe the various functions served by these projects. First, they offer tutorials and tools for both dataviz practitioners and their publics to encourage critical thinking about how COVID-19 data is sourced and modeled—and to consider which subjects are not interpellated in those data sets, (...) and why not. Second, they demonstrate how the pandemic’s spatial logics inscribe themselves in our immediate material landscapes. And third, they remind us of our capacity to personalize and participate in the creation of meaningful COVID visualizations—many of which represent other scales and dimensions of the pandemic, especially the quarantine quotidian. Together, the official maps and counter-plots acknowledge that the pandemic plays out differently across different scales: COVID-19 is about global supply chains and infection counts and TV ratings for presidential press conferences, but it is also about local dynamics and neighborhood mutual aid networks and personal geographies of mitigation and care. (shrink)

In today’s science, the output of measurement processes are often visual representations of the data detected. Moreover, we find such visual data as parts of scientific reasoning in different contexts. In this article, we will take a look at two of them. On the one hand, visual representations are used as a kind of surrogate for the real object to ask questions about it – we will call this the exploratory use of visual data. On the other (...) hand, visualisations are often used to communicate research results to scientific peers or to laymen. Instances of the latter case we will subsequently call the explanatory use of visual data. However, in both contexts the question arises what might justify these epistemic practices. Believing without reasons is epistemically irresponsible, it leads to gullibility. Thus, we will try to answer the question whether there are any reasons to support our epistemic practices concerning scientific visualisations in the above-mentioned senses and whether these are good reasons to rely on. (shrink)

Data produced by humans and machines is more and more heterogeneous, visual, and location based. This availability inspired in the last years a number of reactions from researchers, designers, and artists that, using different visual manipulations techniques, have attempted at repurposing this material to add meaning and design new perspectives with specific intentions. Three different approaches are described here: the design of interfaces for exploring satellite footage in novel ways, the analysis of urban esthetics through the visual manipulation of (...) collections of user-generated contents, and the enrichment of geo-based datasets with the selection and rearrangement of web imagery. (shrink)

This article probes the visual spatial représentations underlying the creative conceptual design of complex objects.

In today’s science, the output of measurement processes are often visual representations of the data detected. Moreover, we find such visual data as parts of scientific reasoning in different contexts. In this article, we will take a look at two of them. On the one hand, visual representations are used as a kind of surrogate for the real object to ask questions about it – we will call this the exploratory use of visual data. On the other (...) hand, visualisations are often used to communicate research results to scientific peers or to laymen. Instances of the latter case we will subsequently call the explanatory use of visual data. However, in both contexts the question arises what might justify these epistemic practices. Believing without reasons is epistemically irresponsible, it leads to gullibility. Thus, we will try to answer the question whether there are any reasons to support our epistemic practices concerning scientific visualisations in the above-mentioned senses and whether these are good reasons to rely on. (shrink)

This article explores how readers recognize their personal identities represented through data visualizations. The recognition is investigated starting from three definitions captured by the philosopher Paul Ricoeur: the identification with the visualization, the recognition of someone in the visualization, and the mutual recognition that happens between readers. Whereas these notions were initially applied to study the role of the book reader, two further concepts complete the shift to data visualization: the digital identity stays for the present-day passport (...) of human actions and the promise is the intimate reflection that projects readers towards their own future. This article reflects on the delicate meaning of digital identity and the way of representing it according to this structure: From Personal Identity to Media is a historical introduction to self-recognition, Data Visualization for Representing Identities moves the focus to visual representation, and The Course of Recognition breaks the self-recognition in through the five concepts above just before the Conclusion. (shrink)

Engineering sketches and drawings are the building blocks of technological design and production. These visual representations act as the means for organizing the design to production process, hence serving as a "social glue" both between individuals and between groups. The author discusses two main capacities such visual representations serve in facilitating distributed cognition in team design work As conscription devices, they enlist and organize group participation. As boundary objects, they facilitate the reading of alternative meanings by various groups involved in (...) the design process. The introduction of computer-aided design into this visual culture of engineering restructures relationships between workers in ways that can hamper the flexibility necessary for these crucial capacities to take place. The data are drawn from a study of the daily practices of engineers engaged in redesigning a turbine engine package. The method is participant observation. (shrink)

The study aims to investigate visual attention and perceived attractiveness to known versus unknown products above and beyond self-report applying physiological methods. A cross-cultural exploratory approach allows for comparing results gathered in the United States and China. We collected field data on physiological parameters accompanied by behavioral data. Mobile eye-tracking was employed to capture attention by measuring gaze parameters and electrodermal activity serves as indicator for arousal at an unconscious level. A traditional scale approach measuring perceived attractiveness of (...) known versus novel products provide insights at a conscious level. US-American and Chinese consumers in our sample indeed process novel products differently. This can be observed at an unconscious and conscious level. Different gaze movements and arousal levels are observed at an unconscious level. Regarding behavioral data, the level of vertical orientation shapes the perceived attractiveness of novel products at a conscious level. The study showcases how physiological methods complement behavioral ones when investigating visual attention to products. It underlines varying conscious as well as unconscious visual attention and attractiveness ratings comparing known versus novel products, driven by cultural differences. Data from a field setting further enrich the implications derived for new product development and applied marketing. (shrink)

Over the last four years I have been drawing on aspects of my own visual art practice (‘data capture’ digital drawing performances, 2004–) in my drawing teaching at the University of Cape Town. For this article I would like to share these projects and discuss the relevance of incorporating multimedia engagement in the teaching of traditional drawing at a tertiary level. First, moving images, sound, digital devices such as smartphones, tablets and engagement in online platforms are primary mediators of (...) experience for many urban citizens. I find it relevant for students to not only reflect critically on the use of digital tools and online social platforms, but to experience and explore engaging with them directly as an experience by making them physical through drawing. In my experience through my teaching practice I have observed how this embodiment of the technology can provide useful tools of processing the volume of immaterial information that we engage with on a daily basis. A physical processing of multimedia material can also operate to provide an interesting engagement with perception, cognition and orientation. At another level, by bringing different media together in the physical studio of life drawing, there can be an interesting reflection and experience of different states of being in the world. These aspects are discussed through descriptions of a selection of my own creative practice and a second-year drawing project I teach at the Michaelis School of Fine Art, University of Cape Town titled, ‘Interface: Image and text, the portrait as Dialogue’. (shrink)

Diffusions in Architecture: Artificial Intelligence and Image Generators delves into the impact of Diffusion AI algorithms and generative image models on architecture design and aesthetics. The book presents an in-depth analysis of how these new technologies are revolutionizing the field of architecture. The architects presented in the book focus on the application of specific AI techniques and tools used in generative design, such as Diffusion models, Dall-E2, Stable Diffusion, and MidJourney. It discusses how these techniques can generate synthetic images that (...) are both realistic and imaginative, creating new possibilities for architectural design and aesthetics. This comprehensive overview of the impact of Diffusion AI algorithms and generative image models on the field of architecture shows how they are changing the way architects approach their work. With a foreword by Lev Manovich—artist, writer and one of the world's most influential digital culture theorists. Sharing the work and insights of a team of designers and theorists from a range of backgrounds, offering disciplinary depth, and covering the full impact of these tools and models on architecture, Diffusions in Architecture includes information on: Fresh perspectives on design and aesthetics, with designs, images, and commentary from 22 leading architects, theorists, and designersThe potential of prompt engineering and text-to-image models applicable to a broad interdisciplinary audienceWhether image generators, or AI in general, will be an aid for human design, or potentially displace humans from the market fundamentals of a larger debate in the architectural discourse (and practice) on the use of image generatorsCollecting the different ideas that have emerged in the field, Diffusions in Architecture provides architects, designers, concept artists, and theorists with an overview of this cornucopia of architectural imaginations produced in a common effort between humans and artificial intelligence. (shrink)

Investigating the influence of perception on the control of visually guided action typically involves controlled experimentation within the laboratory setting. When appropriate, however, behavioral research of this nature may benefit from the use of methods that allow for remote data collection outside of the lab. This study tested the feasibility of using remote data collection methods to explore the influence of perceived target size on visually guided cursor movements using the Ebbinghaus illusion. Participants completed the experiment remotely, using (...) the trackpad of their personal laptop computers. The task required participants to click on a single circular target presented at either the left or right side of their screen as quickly and accurately as possible, or to emphasize speed or accuracy. On each trial the target was either surrounded by small or large context circles, or no context circles. Participants’ judgments of the targets’ perceived size were influenced by the illusion, however, the illusion failed to produce differences in click-point accuracy or movement time. Interestingly, the illusion appeared to affect participants’ movement of the cursor toward the target; more directional changes were made when clicking the Perceived Large version of the illusion compared to the Perceived Small version. These results suggest the planning of the cursor movement may have been influenced by the illusion, while later stages of the movement were not, and cursor movements directed toward targets perceived as smaller required less correction compared to targets perceived as larger. (shrink)

Visual working memory is a construct hypothesized to store a small amount of accurate perceptual information that can be brought to bear on a task. Much research concerns the construct's capacity and the precision of the information stored. Two prominent theories of VWM representation have emerged: slot-based and continuous-resource mechanisms. Prior modeling work suggests that a continuous resource that varies over trials with variable capacity and a potential to make localization errors best accounts for the empirical data. Questions remain (...) regarding the variability in VWM capacity and precision. Using a novel eye-tracking paradigm, we demonstrate that VWM facilitates search and exhibits effects of fixation frequency and recency, particularly for prior targets. Whereas slot-based memory models cannot account for the human data, a novel continuous-resource model does capture the behavioral and eye tracking data, and identifies the relevant resource as item activation. (shrink)

Attempts to introduce Gestalt theory into the realm of visual neuroscience are discussed on both theoretical and experimental grounds. To define the framework in which these proposals can be defended, this paper outlines the characteristics of a standard model, which qualifies as a received view in the visual neurosciences, and of the research into natural images statistics. The objections to the standard model and the main questions of the natural images research are presented. On these grounds, this paper defends the (...) view that Gestalt psychology and experimental phenomenology provide a contribution to the research into perception by the construction of phenomenological models for an ecologically meaningful interpretation of the empirical evidence and the hypothetical constructs of the natural image research within the visual neuroscience. A formal framework for the phenomenological models is proposed, wherein Gestalt theoretical principles and empirical evidence are represented in terms of topological properties and relationships, which account for the order and structures that make the environment accessible to observers at a relevant behavioural level. It is finally argued that these models allow us to evaluate the principles and the empirical evidence of various natures which are integrated from different fields into the research into perception, and in particular into visual neurosciences. (shrink)

The objective of this essay is to forge a more explicit link between the “visual turn” and the “practice turn” in entrepreneurship research. Specifically, we explore three key aspects of mobilizing visual methods for studying entrepreneurship-as-practice, i.e., data sources, collection strategies, and analytical perspectives, highlighting the important theoretical and empirical promises that visual methods hold for said research. This essay bears implications for researchers and educators working at the intersection of entrepreneurship research, the practice theory, and visual methods.

In online lectures, unlike in face-to-face lectures, teachers lack access to (nonverbal) cues to check if their students are still “with them” and comprehend the lecture. The increasing availability of low-cost eye-trackers provides a promising solution. These devices measure unobtrusively where students look and can visualize these data to teachers. These visualizations might inform teachers about students’ level of “with-me-ness” (i.e., do students look at the information that the teacher is currently talking about) and comprehension of the lecture, (...) provided that (1) gaze measures of “with-me-ness” are related to comprehension, (2) people not trained in eye-tracking can predict students’ comprehension from gaze visualizations, (3) we understand how different visualization techniques impact this prediction. We addressed these issues in two studies. In Study 1, 36 students watched a video lecture while being eye-tracked. The extent to which students looked at relevant information and the extent to which they looked at the same location as the teacher both correlated with students’ comprehension (score on an open question) of the lecture. In Study 2, 50 participants watched visualizations of students’ gaze (from Study 1), using six visualization techniques (dynamic and static versions of scanpaths, heatmaps, and focus maps) and were asked to predict students’ posttest performance and to rate their ease of prediction. We found that people can use gaze visualizations to predict learners’ comprehension above chance level, with minor differences between visualization techniques. Further research should investigate if teachers can act on the information provided by gaze visualizations and thereby improve students’ learning. (shrink)

One of the crucial fields of study that is getting more attention is association rule mining. It is crucial to databases' knowledge discovery (KDD). KDD and association rule mining have a very broad use. It has evolved at a rapid rate over the past fifteen years. Association Rule Mining is a novel technology, although it is still in the discovery and development stages. Video is an illustration of interactive media data since it contains text, pictures, meta-data, visual, sound, (...) and different kinds of data. It is frequently used for a variety of important likely reasons, such as security and reconnaissance, amusement, healthcare, educational endeavours, and sports. One of the main issues for the local data-mining research community is video data mining, which aims to find and comprehend fascinating examples from the large volume of video data. Video data mining is still in its infancy when compared to mining other sorts of data. It is pivotal to grasp and naturally mine the information from video databases considering the continually extending computerized libraries and video databases. Differentiating association rules between components in a significant video library is critical in the field of video data mining. As per continuous imaginative work, association rule mining is being utilized rapidly in various tasks, including perception, social affairs, broadcast news, sports, records, films, clinical data, as well as on the web and individual media assortments. This exploration tries to give a far-reaching method to association rule extraction from video databases. (shrink)

One of the main limitations of natural language‐based approaches to meaning is that they do not incorporate multimodal representations the way humans do. In this study, we evaluate how well different kinds of models account for people's representations of both concrete and abstract concepts. The models we compare include unimodal distributional linguistic models as well as multimodal models which combine linguistic with perceptual or affective information. There are two types of linguistic models: those based on text corpora and those derived (...) from word association data. We present two new studies and a reanalysis of a series of previous studies. The studies demonstrate that both visual and affective multimodal models better capture behavior that reflects human representations than unimodal linguistic models. The size of the multimodal advantage depends on the nature of semantic representations involved, and it is especially pronounced for basic‐level concepts that belong to the same superordinate category. Additional visual and affective features improve the accuracy of linguistic models based on text corpora more than those based on word associations; this suggests systematic qualitative differences between what information is encoded in natural language versus what information is reflected in word associations. Altogether, our work presents new evidence that multimodal information is important for capturing both abstract and concrete words and that fully representing word meaning requires more than purely linguistic information. Implications for both embodied and distributional views of semantic representation are discussed. (shrink)

Speakers’ perception of a visual scene influences the language they use to describe it—which objects they choose to mention and how they characterize the relationships between them. We show that visual complexity can either delay or facilitate description generation, depending on how much disambiguating information is required and how useful the scene's complexity can be in providing, for example, helpful landmarks. To do so, we measure speech onset times, eye gaze, and utterance content in a reference production experiment in which (...) the target object is either unique or non-unique in a visual scene of varying size and complexity. Speakers delay speech onset if the target object is non-unique and requires disambiguation, and we argue that this reflects the cost of deciding on a high-level strategy for describing it. The eye-tracking data demonstrate that these delays increase when speakers are able to conduct an extensive early visual search, implying that when speakers scan too little of the scene early on, they may decide to begin speaking before becoming aware that their description is underspecified. Speakers’ content choices reflect the visual makeup of the scene—the number of distractors present and the availability of useful landmarks. Our results highlight the complex role of visual perception in reference production, showing that speakers can make good use of complexity in ways that reflect their visual processing of the scene. (shrink)

Measures of visual cortical development in children demonstrate high variability and inconsistency throughout the literature. This is partly due to the specificity of the visual system in processing certain features. It may then be advantageous to activate multiple cortical pathways in order to observe maturation of coinciding networks. Visual stimuli eliciting the percept of apparent motion and shape change is designed to simultaneously activate both dorsal and ventral visual streams. However, research has shown that such stimuli also elicit variable visual (...) evoked potential (VEP) morphology in children. The aim of this study was to describe developmental changes in VEPs, including morphological patterns, and underlying visual cortical generators, elicited by apparent motion and shape change in school-aged children. Forty-one typically developing children underwent high-density EEG recordings in response to a continuously morphing, radially modulated, circle-star grating. VEPs were then compared across the age groups of 5-7, 8-10, and 11-15 years according to latency and amplitude. Current density reconstructions were performed on VEP data in order to observe activated cortical regions. It was found that two distinct VEP morphological patterns occurred in each age group. However, there were no major developmental differences between the age groups according to each pattern. Current density reconstructions further demonstrated consistent visual generators across age and pattern. These results describe two novel VEP morphological patterns in typically developing children, but with similar underlying cortical sources. The importance of these morphological patterns is discussed in terms of future studies and the investigation of a relationship to visual cognitive performance. (shrink)

Through extensive training, experts acquire specialized knowledge and abilities. In this paper, I argue that experts also acquire specialized visual experiences. Specifically, I articulate and defend the account that experts enjoy visual experiences that represent gestalt properties through perceptual learning. I survey an array of empirical studies on face perception and perceptual expertise that support this account. I also look at studies on perceptual adaptation that some might argue present a problem for my account. I show how the data (...) are subject to an interpretation that is friendly to it. Last, I address two theoretical objections to the claim that visual experiences represent gestalt properties. (shrink)

In research textbooks, and much of the research practice, they describe, qualitative processes and interpretivist epistemologies tend to dominate visual methodology. This article challenges the assumptions behind this dominance. Using exemplification from three existing visual data sets produced through one large education research project, this article considers the affordances and constraints of the research process focusing particularly on analysis. It examines how and when the visual can be incorporated, gives some critical reflections on the role and use of visual (...) methods to fulfil different research intents, and, in particular, considers combining large, open-ended data sets with acceptable and rigorous analysis techniques. We then explore arguments about the nature of visual data, what is considered epistemologically appropriate and the decision-making which accompanies any appraisal of process in education research. The intention is to challenge ourselves, and fellow visual methods researchers, to develop a more complete understanding of the theory and practice of visual research. (shrink)

This paper concerns local yet systematic problems of contrastive underdetermination of model choice in cognitive neuroscience debates about the so-called two visual systems hypothesis. The underdetermination problem is systematically generated by the way certain assumptions about the representationalist nature of computation are translated into experimental practice. The problem is that behavioural data underdetermine the choice between competing representational models. In this paper, I diagnose how these assumptions generate underdetermination problems in the choice between competing functional models of perception–action. Using (...) the tools of philosophy of science, I describe the type of underdetermination and sketch a possible cure. (shrink)

Laboratoire de Neurosciences Cognitives et Imagerie Ce´re´brale (LENA), Hoˆpital de La Salpeˆtrie`re, Centre National de la Recherche Scientifique (CNRS).

Recent philosophical analyses of the epistemic dimension of images in the sciences show a certain trend in acknowledging potential roles of these images beyond their merely decorative or pedagogical functions. We argue, however, that this new debate has yet paid little attention to a special type of pictures, we call ‘visual metaphor’, and its versatile heuristic potential in organizing data, supporting communication, and guiding research, modeling, and theory formation. Based on a case study of Conrad Hal Waddington’s epigenetic landscape (...) images in biology, we develop a descriptive framework applicable to heuristic roles of various visual metaphors in the sciences. (shrink)

A visual experience, as understood here, is a sensory event that is conscious, or like something to undergo. This chapter focuses on three issues concerning such experiences. The first issue is the so-called ‘transparency’ of experiences. The chapter distinguishes a number of different interpretations of the suggestion that visual experiences are ‘transparent’. It then discusses in what sense, if any, visual experiences are ‘transparent’, and what further conclusions one can draw from that. The second issue is which properties we are (...) presented with in visual experiences. It is widely accepted that we sometimes experience red for example. But exactly which properties do we sometimes visually experience, and which properties do we never visually experience? The third issue is which particulars, if any, we are presented with in visual experiences. Do we for example sometimes visually experience mind-independent particulars like trees? Do we sometimes visually experience mind-dependent, particular ‘sense-data’? (shrink)

One of the dominant behavioral markers of visual-expert search strategy, Holistic Visual Processing (HVP), suggests that experts process information from a larger region of space in conjunction with a more focused gaze pattern in order to improve search speed and accuracy. To date, extant literature suggests that visual search expertise is domain specific, including HVP and its associated behaviors. The current study is the first to use eye tracking to directly measure the HVP strategies of two expert groups, radiologists and (...) architects, in comparison to one another and a novice control. In doing so, we replicated and extended this prior research: visual expertise is domain specific. However, our eye tracking data indicate that contrary to this prior work, HVP strategies are transferable across domains. Yet, despite the transfer of HVP strategies, there is neither reduced search time nor greater accuracy in visual search outside of an expert’s domain. Therefore, our data suggest that HVP behaviors are a particular form of visual search mechanism that, outside of an expert’s native search-ecology, are not necessarily conducive to more general visual search success. It is in addition to explicit knowledge of an expert’s domain, how to search, and where to search, that HVP strategies are their most effective for visual search success. (shrink)

When referring to a target object in a visual scene, speakers are assumed to consider certain distractor objects to be more relevant than others. The current research predicts that the way in which speakers come to a set of relevant distractors depends on how they perceive the distance between the objects in the scene. It reports on the results of two language production experiments, in which participants referred to target objects in photo-realistic visual scenes. Experiment 1 manipulated three factors that (...) were expected to affect perceived distractor distance: two manipulations of perceptual grouping (region of space and type similarity), and one of presentation mode (2D vs. 3D). In line with most previous research on visually-grounded reference production, an offline measure of visual attention was taken here: the occurrence of overspecification with color. The results showed effects of region of space and type similarity on overspecification, suggesting that distractors that are perceived as being in the same group as the target are more often considered relevant distractors than distractors in a different group. Experiment 2 verified this suggestion with a direct measure of visual attention, eye tracking, and added a third manipulation of grouping: color similarity. For region of space in particular, the eye movements data indeed showed patterns in the expected direction: distractors within the same region as the target were fixated more often, and longer, than distractors in a different region. Color similarity was found to affect overspecification with color, but not gaze duration or the number of distractor fixations. Also the expected effects of presentation mode (2D vs. 3D) were not convincingly borne out by the data. Taken together, these results provide direct evidence for the close link between scene perception and language production, and indicate that perceptual grouping principles can guide speakers in determining the distractor set during reference production. (shrink)

The visual attention (VA) span is defined as the amount of distinct visual elements which can be processed in parallel in a multi-element array. Both recent empirical data and theoretical accounts suggest that a VA span deficit might contribute to developmental dyslexia, independently of a phonological disorder. In this study, this hypothesis was assessed in two large samples of French and British dyslexic children whose performance was compared to that of chronological-age matched control children. Results of the French study (...) show that the VA span capacities account for a substantial amount of unique variance in reading, as do phonological skills. The British study replicates this finding and further reveals that the contribution of the VA span to reading performance remains even after controlling IQ, verbal fluency, vocabulary and single letter identification skills, in addition to phoneme awareness. In both studies, most dyslexic children exhibit a selective phonological or VA span disorder. Overall, these findings support a multi-factorial view of developmental dyslexia. In many cases, developmental reading disorders do not seem to be due to phonological disorders. We propose that a VA span deficit is a likely alternative underlying cognitive deficit in dyslexia. (shrink)

Visually impaired people have unique perceptions of and usage requirements for various urban spaces. Therefore, understanding these perceptions can help create reasonable layouts and construct urban infrastructure. This study recruited 26 visually impaired volunteers to evaluate 24 sound environments regarding clarity, comfort, safety, vitality, and depression. This data was collected in seven different types of urban spaces. An independent sample non-parametric test was used to determine the significance of the differences between environmental evaluation results for each evaluation dimension and (...) to summarize the compositions of sound and space elements in the positive and negative influence spaces. The results suggested that visually impaired people (1) feel comfort, safety, and clarity in parks, residential communities, and shopping streets; (2) have negative perceptions of vegetable markets, bus stops, hospitals, and urban departments; (3) feel anxious when traffic sounds, horn sounds, manhole cover sounds, and construction sounds occur; and (4) prefer spaces away from traffic, with fewer and slower vehicles, with a suitable space scale, and moderate crowd density. These results provide a reference for the future design of activity venues (i.e., residential communities, vegetable markets, bus stops, parks, shopping streets, hospitals, and urban functional departments) and the planning of accessibility systems for visually impaired urban residents. (shrink)

This article discusses the status of transcripts in Conversation Analysis. Repeatedly, the function and the epistemic state of transcripts have been the subject of discussions and reflections in Conversation Analysis. Drawing on a range of empirical examples taken from various authors, this article discusses the question of how present forms of visuality and multi-modality in the data material or the handling of artifacts can be captured in transcripts and how the problem of ‘representation’ of complex and interactive situations can (...) be solved. It turns out that the evolution of recording media along with the medium shift in Conversation Analysis has altered the status of transcripts, effecting a twofold ‘in-between-ness’: transcripts inhabit the conceptual space between orality and literacy on the one hand and between artwork and figure on the other hand. This oscillating hybrid nature proves to be the central property of transcripts in present-day Conversation Analysis. Transcripts are described as scientific ‘objects of knowledge’ and discussed with respect to their methodological and epistemic status. (shrink)

The technologies used to govern performance at universities consist of monitoring and comparative instruments. They are designed to affect and direct behaviour. In these academic environments of exposure, comparison and self-monitoring are deeply entangled with a vulnerable affective economy. This article explores how these data may affect our moods and how academic value could be curated by other means and with care. Drawing on feminist new materialist thinking and speculative feminist storytelling, the article takes this picture of the actual (...) as a point of departure for discussing ways of experimenting with affirmative critique of the current use of data. Through a smaller experiment with thirty PhD students, the article discusses how to speculatively curate academic value by other means that provide more liveable world(ing)s than data visuals measuring performance and that engage other sensorial and affective registers. (shrink)

Visual stylometry is a new interdisciplinary research field that sits at the junction of digital humanities, empirical aesthetics, and computer science. Research in this field employs image analysis algorithms to study key aspects of artistic style. The nature of artistic style is the subject of ongoing debate within art history and philosophy of art. Computational and statistical methods in visual stylometry allow researchers to quantify and compare aspects of artistic style over the course of the career of an individual artist, (...) among artists who share in a common artistic style, and across different schools of art. The results of these studies provide clues to the image features that enable viewers to categorize works as belonging to different artistic styles. -/- We have developed a system that can act as an open access laboratory for visual stylometry. This approach is powerful enough to support advanced academic research in computer science, cognitive science, art history, and the philosophy of art while at the same time providing a user friendly interface accessible to students and researchers with little or no computer science background. Our framework is designed around the idea of scientific workflows. Scientific workflows allow users to build executable analyses in the same way they would draw a flowchart, by dragging objects representing data sets and image analysis procedures onto the work-space and drawing links between them. These workflows and data sets can be exported using open standards as web objects that can then be shared or modified by other users. -/- Our platform, Workflows for the Analysis of Images in Visual Stylometry (WAIVS), has the potential to promote computational literacy and data analytic skills among humanities students, to introduce science students to research in art and the humanities, to explore the nature of artistic style and its role in our understanding of artwork, and to help researchers in cognitive science understand how viewers perceptually categorize, recognize, and otherwise engage with artworks. (shrink)

This article examines the potential of art and archaeological remains for the study of women's social history in early Christianity. Part I considers important sources for art and archaeological data; the received method and classification criteria for the discipline of early Christian art and archaeology; and the types of problems both earlier and contemporary approaches to the material remains present for scholars. Part II proposes an approach to understanding early Christian art and material culture as part of a larger (...) ongoing social discourse in the ancient Mediterranean world where cultural representations take part in the lively social and aural culture of life lived in close proximity to others. This approach places art and archaeological evidence in the foreground and documentary sources in the background as corroborative evidence. (shrink)

In this article we explore the relationship between semiotic analysis of images and quantitative analysis of vast image corpora, in particular the work produced by Lev Manovich and the Cultural Analytics Lab, called “Media Visualization.” Media Visualization has been chosen as corpus because of its metavisual operation (images are visualized and analyzed by images) and its innovating way of conceiving analysis: by visual instruments. In this paper semiotics is used as an approach to Media Visualization and taken as an object (...) of study as well, especially visual semiotics. In this sense, a comparison between visual semiotics (close reading of small corpora) and quantitative analyses of images (distant reading of vast collections) are conducted from a semiotic point of view. Post-Greimassian semiotics guides this study with respect to the issue of the image-within-an-image and metavisual visualization; Peircean semiotics is employed to explain and develop the notion of diagram. (shrink)

O'Regan & Noë mistakenly identify visual processing with visual experience. I outline some reasons why this is a mistake, taking my data and arguments mainly from the literature on subliminal processing.

A theory of sense‐data is defended, which takes its cue from light. It is that the visual perception of outer physical objects is noticing visual sensations set in two‐dimensional body‐relative physical space, which stands in non‐deviant causal relation to outer phenomenal causes. The first leg of the argument is that there exist regular causally sufficient bodily conditions for the existence of a visual field of given colour‐bright spatial character, quite irrespective of the outer causes of those bodily causes. Now (...) if those bodily conditions were caused by piecemeal scientific intervention we would deem the resulting visual field a psychological existent of type, visual sensations. Since they are also satisfied when the bodily conditions are caused by outer visibles, the same set of sensations must occur in perception of outer items. The theory is defended against the claim that the visual field has no separate existence from our awareness of it, through showing that the criteria for the content of visual field and of visual impression ensure divergence of content. Finally, an explanatorial argument is proposed for the view that sensations generally are psychological individuals, and are not to be understood as merely the internal objects of awareness‐experiences. (shrink)

This article explores datafication as a speculative discourse that fundamentally and instrumentally misunderstands data, not as a representational system, but as an ontology. This analysis of datafication takes a semiotic and media-archaeological approach to datafication, understanding it as an imaginary media system, and the article looks to supplementary discourses in data visualization and big data to clarify and expand an understanding of datafication as a prescriptive and speculative idea. This critique is sharpened through the exploration of a (...) detailed study of the early visualizations and unpublished fictions of W. E. B. Du Bois, whose imagined technology of the “megascope” gives a remarkable blueprint for contemporary discourses in data visualization and data science. Du Bois’s liberatory perspective is contrasted to a more paranoid example coming from the self-documented delusional system of Daniel Paul Schreber, who provides a much different vision of a totalizing media system in the form of an Aufschreibesysteme, which seems to presage another side of datafication as a surveillance system. Taken together, datafication, the megascope, and the Aufschreibesysteme work as three speculative media that imagine themselves as different instances or visions of a totalizing media system, a notion that has become especially significant in the technological, cultural, and economic systems of the twenty-first century. (shrink)