This article presents a model and a case study of the narrative structures that are present in the interactive media design of multimedia applications in the mass media. As basic categories for the history and structure of media, we employ the model of the modes of the physical, analog, and digital presentation/representation. In this case study of the online edition of the New York Times, we have the case of a newspaper that in the digital edition employs multi-media (...) applications. Contrasting the traditional concept of “narrativity” with the current status quo of the digital media outlets, we will examine the specific conditions of the multimedia applications in the mass media with this sample case of the New York Times. As narrative structure of interactive design in multimedia for mass communication, we analyze the types of narrative media and general narrativity in the New York Times with the background of its processes of interactivity and media convergence. (shrink)

Multimedia technology offers instructional designers an unprecedented opportunity to create richly interactive learning environments. With greater design freedom comes complexity. The standard answer to the problems of too much choice, disorientation, and complex navigation is thought to lie in the way we design interactivity in a system. Unfortunately, the theory of interactivity is at an early state of development. After critiquing the decision cycle model of interaction—the received theory in human computer interaction—I present arguments and observational data to (...) show that humans have several ways of interacting with their environments, which resist accommodation in the decision cycle model. These additional ways of interacting include: preparing the environment, maintaining the environment, and reshaping the cognitive congeniality of the environment. Understanding how these actions simplify the computational complexity of our mental processes is the first step in designing the right sort of resources and scaffolding necessary for tractable learner controlled learning environments. (shrink)

In 2015 the first mass migration and the first geopolitical and transnational crisis of the digital age began. This brought along the awakening of a new phase in slavery trade and trafficking of human beings (THB) at the European borders. In this article I introduce an ongoing field study I began in January 2016, in collaboration with experts from Spanish and European institutions, that so far has taken me to hotspots and borders, and to the accumulation of a vast (...) class='Hi'>multimedia archive. This led to the creation of zonaautonomamilitarizada.eu, an immersive/360°, interactive and reactive audio-visual performative system conceptually rooted in military technologies, second-order cybernetics and mass media developments. (shrink)

This article attempts to establish analogies between the recent introduction into architectural thought of notions such as the human body movement, events and scenarios, and the development of navigation and interaction principles and conventions in the computer world. The study of the human–computer interface contributes to an understanding of the major role of the computer screen as a point of convergence of different representational forms, and the emergence of new ones belonging to the digital culture. The compositional structure of (...) class='Hi'>interactive multimedia works is on the one hand a visual, spatial composition and on the other a narrative and navigational structure. (shrink)

This article presents an overview of generally available applications for creating multimedia and interactive educational materials, such as presentations, instructional videos, self-tests and interactive repetitions. With the use of the presented tools, pilot materials were developed to support the teaching of biostatistics at a medical university. The authors conducted surveys among students of faculties of medicine in order to evaluate the materials used in terms of quality and usefulness. The article presents the analysis of the results obtained.

Interactive Cinema explores cinematic practices that work to transform what is often seen as a receptive activity into a participatory, multimedia experience. Combining cutting-edge theory with updated conventional film studies methodologies, Marina Hassapopoulou presses at the conceptual limits of cinema and offers an essential road map to the rapidly evolving landscape of contemporary media.

Textbooks have played the leading role in academic education for centuries and their form has evolved, adapting to the needs of students, teachers and technological possibilities. Advances in technology have caused educators to look for new sources of knowledge development, which students could use inside and outside the classroom. Today’s sophisticated learning tools range from virtual environments to interactive multimedia resources, which can be called e-textbooks. Different types of new educational materials that go beyond printed books are now (...) used to support the academic curriculum, with the most interesting ones exemplified in this article to show their value in medical and life sciences education. Certain interesting attempts by Polish publishers at applying technology to support both self-paced and tutor-paced student learning in the medical profession and related areas are presented. The data was collected through a review of literature, discussions with e-learning specialists and medical students, as well as an analysis of examples of good practices. The article also discusses the results of a countrywide survey on the use of e-textbooks to enhance medical education. The research investigates the targeted academic staff’s attitudes towards the use of e-textbooks, the limitations of their implementation, and the character of e-resources currently used by Polish higher education medical institutions. (shrink)

The complexity of biobank research raises concerns about individuals’ understanding of the information conveyed in the consent process for such research.. We report the results of a qualitative, cognitive interview study with an ethnically, linguistically, and educationally diverse sample of 43 respondents to assess the clarity and utility of a multimedia tool developed for a biobank. Using weighted randomization, respondents were assigned to either view the multimedia tool or read a written consent document . The study illustrates the (...) utility of cognitive interviews for gaining insights from prospective research participants about the clarity of informed consent tools. Findings suggest that a multimedia tool is useful for communicating key messages but should be combined with a written consent document and personal interaction with the study staff. We recommend that the potential value of multimedia tools should be more rigorously tested in a randomized controlled trial. (shrink)

How to reduce pupils’ burden and improve learning efficiency? Research shows that non-intelligence factors and learning strategies are the key factors in the effective learning process, and external intervention can play a greater role in these two aspects. The purpose of this study is to explore the effects of different learning strategies on learning motivation under the presentation of augmented reality multimedia or traditional text learning. Sixty third-grade pupils in Hebei Province were selected, and 2 × 3 between-subjects design (...) was adopted. The dependent variable is learning motivation, which includes three dimensions: surface motivation, deep motivation and achievement motivation. The results showed that Learning strategies had a significant impact on deep motivation. The deep motivation aroused by retrieval practicing strategies was significantly higher than that aroused by restudying strategies and self-generated drawing strategies. The interaction between learning materials and learning strategies was marginally significant. When learning with AR materials, the achievement motivation of pupils in the restudying strategy group was higher than that in the retrieval practicing strategy group. Retrieval practicing strategies have positive significance in cultivating deep motivation. The combination of different learning modes and learning strategies will impact achievement motivation. (shrink)

Digital media presents an array of interesting challenges adapting new modes of collaborative, online communication to traditional writing and literary practices at the practical and theoretical levels. For centuries, popular concepts of the modern author, regardless of genre, have emphasized writing as a solo exercise in human communication, while the act of reading remains associated with solitude and individual privacy. "The Community and the Algorithm: A Digital Interactive Poetics" explores important cultural changes in these relationships thanks to the rapid (...) development of digital internet technologies allowing near-instantaneous, synchronous, multimedia interaction across the globe. The radical shift in how we author and consume media as an online, electronic transmission effectively resituates the writing process across the liberal arts as less a solitary act of individual enquiry and reflection, and more an ongoing, collaborative process of creative interaction within a multimedia environment or network. Contributions in this anthology demonstrate a robust history and equally diverse contemporary approach to multimedia interaction for literary and artistic ends. Central to all media formats, computation is explored throughout this volume to critically examine how algorithmic procedures in writing help bring forward many key concepts to building creative communities in a digital environment. Each chapter in this book accordingly introduces readers to various new collaborative experiments using a broad range of different digital media formats, including VR, Natural Language Generation (NLG), and metagaming tools. This book will appeal broadly to students, instructors, and independent artists working in the digital arts, while its emphasis on social interactivity will interest theorists and teachers working in theatre, social media, and cyberpsychology. Its secondary focus on computation and media programming as a site of artistic experimentation will also interest programmers and web designers at various professional levels. (shrink)

Des revues et des ouvrages spécialisés ont préconisé l’exploitation des textes littéraires dans l’apprentissage du français langue étrangère. Mais les recherches et les pratiques pédagogiques axées sur les apports de la littérature dans l’enseignement de la prononciation sont rares. En didactique des langues, les enseignants ont tendance à négliger, très souvent, l’acquisition des compétences orales, face à la concurrence de la langue écrite, de la grammaire ou du vocabulaire. Dans cet article, nous présentons les expériences sur le développement de la (...) production orale et la correction de la prononciation en relation avec la littérature dans le dispositif de formation Campus Virtuel FLE à l’Université de León. À l’heure du numérique nous aurons recours aux multiples ressources, outils, environnements informatiques et médias sociaux en relation avec les domaines suivants : 1. Le projet Littérature Française Multimédia FLE, une base de données audiovisuelle en ligne sur la littérature française pour l’enseignement et apprentissage du FLE ; 2. Les tâches sur la littérature pour l’acquisition des compétences orales ; 3. Le corpus Oral FLE Prononciation des productions orales des apprenants hispanophones ; 4. Les techniques et méthodes de correction de la prononciation à l’aide des médias sociaux. (shrink)

Background Providing understandable information to patients is necessary to achieve the aims of the Informed Consent process: respecting and promoting patients’ autonomy and protecting patients from harm. In recent decades, new, primarily digital technologies have been used to apply and test innovative formats of Informed Consent. We conducted a systematic review to explore the impact of using digital tools for Informed Consent in both clinical research and in clinical practice. Understanding, satisfaction and participation were compared for digital tools versus the (...) non-digital Informed Consent process. Methods We searched for studies on available electronic databases, including Pubmed, EMBASE, and Cochrane. Studies were identified using specific Mesh-terms/keywords. We included studies, published from January 2012 to October 2020, that focused on the use of digital Informed Consent tools for clinical research, or clinical procedures. Digital interventions were defined as interventions that used multimedia or audio–video to provide information to patients. We classified the interventions into 3 different categories: video only, non-interactive multimedia, and interactive multimedia. Results Our search yielded 19,579 publications. After title and abstract screening 100 studies were retained for full-text analysis, of which 73 publications were included. Studies examined interactive multimedia, non-interactive multimedia, and videos, and most studies were conducted on adults. Innovations in consent were tested for clinical/surgical procedures and clinical research. For research IC, 21 outcomes were explored, with a positive effect on at least one of the studied outcomes being observed in 8/12 studies. For clinical/surgical procedures 49 outcomes were explored, and 21/26 studies reported a positive effect on at least one of the studied outcomes. Conclusions Digital technologies for informed consent were not found to negatively affect any of the outcomes, and overall, multimedia tools seem desirable. Multimedia tools indicated a higher impact than videos only. Presence of a researcher may potentially enhance efficacy of different outcomes in research IC processes. Studies were heterogeneous in design, making evaluation of impact challenging. Robust study design including standardization is needed to conclusively assess impact. (shrink)

In this paper we present the syntax and semantics of a temporal action language named Alan, which was designed to model interactive multimedia presentations where the Markov property does not always hold. In general, Alan allows the specification of systems where the future state of the world depends not only on the current state, but also on the past states of the world. To the best of our knowledge, Alan is the first action language which incorporates causality with (...) temporal formulas. In the process of defining the effect of actions we define the closure with respect to a path rather than to a state, and show that the non-Markovian model is an extension of the traditional Markovian model. Finally, we establish relationship between theories of Alan and logic programs. (shrink)

The purpose of this paper is to discuss some ways in which dialectical models can be put to computational use. In particular, we consider means of facilitating human-computer debate, means of catering for a wider range of dialogue types than purely debate and means of providing dialectical support for group dialogues. We also suggest how the computational use of dialectical theories may help to illuminate research issues in the field of dialectic itself.

Background. Informed consent (IC) is not only a regulatory but also an ethical requirement to participate in any clinical trial. It is essential to determine that research participants understand what they consent to. Studies that evaluate participants’ understanding of IC conclude that recall and understanding of IC is often low, and researchers recommend that interactive multimedia interventions should be implemented to optimise understanding. Objectives. To assess participants’ understanding of IC of the research trial that they agreed to participate (...) in.Methods. A descriptive survey design, within a quantitative research approach, was used to conduct the study at two government hospitals in the Eastern Cape Province. A semi-structured, self-administered questionnaire was used to collect information from 170 participants in research studies. Descriptive statistics were used to analyse the results.Results. Participants were recruited from among women who enrolled in any of the three studies that were ongoing at the two sites during the recruitment period. The study participants had a mean age of 25.9 years. Nearly one-third (30%) could not recall the purpose of the original trial that they consented to. The concept of randomisation was not understood by any of the participants.Conclusion. Regardless of extensive efforts to ensure that participants understood their participation, this study unveiled poor recall of essential information on IC. It is proposed that IC should be short and only address essential components such as purpose, procedure, possible risks or benefits, alternative options if not participating and explaining the concept of voluntary participation. (shrink)

The Issue of Abortion in America is an interactive multi-media CD-ROM created by the award winning Carnegie Mellon team that brought us A Right to Die?: The Dax Cowart Case. In this ground breaking CD-ROM, The Issue of Abortion in America gives users an opportunity to see and hear women and couples speak of the emotional struggles and moral dilemmas they face in their consideration of continuing or terminating a pregnancy. It also places the issue of abortion in the (...) larger social context of medical, legal, philosophical, and religious considerations. The information on the CD is presented in three student friendly sections: * Introduction: offers an introduction to the project as well as an overview of the program. * Case Histories: a set of interactive multimedia modules present situations in which women and couples describe their decisions to continue or terminate a pregnancy. * Resources: Reviews the background context that informs the discussion of the issue of abortion in America along with a summary section of the case histories. (shrink)

Changescapes - an introduction -- Aqueous aesthetics -- The rise of multimedia systems -- Complex dynamics disciplines -- The known world -- Attunement and agility -- Camouflage and changefulness -- Narrative hunger - geographical information systems, google street view and the colonial prospectus -- Wayfaring strangers: artistic investigations of the mood of dark tourism in online mapping -- Ghosts of a better tomorrow: the volatile formalism of 1980s film workshop productions in Hong Kong -- Cast against type -- What (...) the eye can hear -- A forest. A clearing. -- Motility -- Deep water time. (shrink)

Ubiquitous news, global information access, instantaneous reporting, interactivity, multimedia content, extreme customization: Journalism is undergoing the most fundamental transformation since the rise of the penny press in the nineteenth century. Here is a report from the front lines on the impact and implications for journalists and the public alike. John Pavlik, executive director of the Center for New Media at Columbia University's Graduate School of Journalism, argues that the new media can revitalize news gathering and reengage an increasingly distrustful (...) and alienated citizenry. The book is a valuable reference on everything from organizing a new age newsroom to job hunting in the new media. (shrink)

A new analytical framework for understanding literary videogames, the literary-ludic spectrum, illustrated by close readings of selected works. In this book, Astrid Ensslin examines literary videogames—hybrid digital artifacts that have elements of both games and literature, combining the ludic and the literary. These works can be considered verbal art in the broadest sense (in that language plays a significant part in their aesthetic appeal); they draw on game mechanics; and they are digital-born, dependent on a digital medium (unlike, for example, (...) conventional books read on e-readers). They employ narrative, dramatic, and poetic techniques in order to explore the affordances and limitations of ludic structures and processes, and they are designed to make players reflect on conventional game characteristics. Ensslin approaches these hybrid works as a new form of experimental literary art that requires novel ways of playing and reading. She proposes a systematic method for analyzing literary-ludic (L-L) texts that takes into account the analytic concerns of both literary stylistics and ludology. After establishing the theoretical underpinnings of her proposal, Ensslin introduces the L-L spectrum as an analytical framework for literary games. Based on the phenomenological distinction between deep and hyper attention, the L-L spectrum charts a work's relative emphases on reading and gameplay. Ensslin applies this analytical toolkit to close readings of selected works, moving from the predominantly literary to the primarily ludic, from online hypermedia fiction to Flash fiction to interactive fiction to poetry games to a highly designed literary “auteur” game. Finally, she considers her innovative analytical methodology in the context of contemporary ludology, media studies, and literary discourse analysis. (shrink)

The author considers the Digital Humanities as a tendency towards a constructive synthesis of computer technology and humanitarian science in the context of their claim to make a paradigm shift in the humanities. As part of this review, the author raises a question about the role of interactive multimedia tools in the humanities, and tried to evaluate the novelty and content that scientific and educational projects receive with their help. The author develops and justifies the principle of systematization (...) of Digital Humanities projects, based on the priority of distinguishing projects by the nature of the relationship between their humanitarian and computer (technological) components. Considering both the actual digital projects and the academic publications devoted to them in the context of their systematization, the author observes that many projects are largely experimental in nature due to the use of ever new multimedia tools, so it is premature to talk about a meaningful transformation of humanitarian science. Focusing on the issue of a successful synthesis of digital technologies and the humanities, the author notes that new technological tools (multimedia, AI or neural networks, etc) allow raising new questions, updating additional objects of research and creating new methods. However, new tools do not always set the completeness of the new content, only supplementing it, and the acquired interactivity does not always directly work for scientific character. In this case, we face with the reverse situation, when the claims of technologically determined disciplines to be scientific are intertwined with the claims of disciplinary science to manufacturability. As a result, the author concludes that the direction of Digital Humanities is significantly influenced by technoscience with its dissolution of the boundaries between fundamental and applied research and the desire for new technologies that transform the processes under study, which makes McLuhan’s concept especially relevant. (shrink)

A major cognitive framework for individuating, visualizing, and keeping track of different items of knowledge (such as who said what in a conference or what items of data go with what) is the use of real 3D spatial locations. We use space both literally (as in the desktop or office model of data organization) and also figuratively. Examples of the latter includes such techniques as mentally locating different facts and premises in certain imagined spatial loci -- a technique widely used (...) in mnemonic aids, and the use of spatial location in reasoning where so-called "spatial paralogic" provides an important scheme for keeping track of different components of a problem. The use of distinct spatial loci in reasoning and visualizing can be enhanced and its effectiveness in communication increased if distinct spatial locations can be shared. This, of course, happens routinely when people use gestures, pointing, and carving shapes in the air when they converse. Sharing a common workspace and conceptual space is now becoming technologically feasible through the use of interactive multimedia workstations, in which sound and 3D visual locations can be communicated and spatial indicators such as pointing in space can form part of the human-computer interaction. (shrink)

In 2020, the COVID-19 pandemic forced many nations to shut-down schools and universities, catapulting teachers and students into a new, challenging situation of 100% distance learning. To explore how the shift to full distance learning represented a break with previous teaching, we asked Austrian students (n = 874, 65% female, 34% male) which digital media they used before and during the first Corona lockdown, as well as which tools they wanted to use in the future. Students additionally reported on their (...) attitudes and experiences with online learning. Results showed that students used certain tools, such as video, audio, e-assessments, and web conferencing systems, much more often during lockdown than they had before. Their use of classic digital media, such as e-mail, social communication tools, such as chat or online forums, and other interactive tools, such as wikis or educational games, hardly changed at all. Their attitudes toward multimedia learning were positively related to their media use. In their open responses (n = 137), students identified advantages of online learning (flexibility and self-directed learning), as well as disadvantages (limited social interaction) and challenges (motivation and self-discipline). As a group, they also expressed a clear preference for a balanced combination of online- and offline teaching in the future. However, individual students did prefer fully online or offline learning modes, depending on their personal circumstances and educational goals. We view this as a call to researchers and educators alike to explore ways in which the advantages of online and face-to-face learning can best be combined to meet the changed needs and expectations of organizations, students, and teachers in a future “after Corona.”. (shrink)

Apresenta as orientações teóricas que serviram de fundamentação para a criação e metodologia da produção da hipermídia. Ele acompanha a hipermídia que se apresenta na forma de CD-ROM, inserido no interior da própria capa do livro. A obra oferece uma navegação reticular sobre as mais diversas relações entre a psicanálise freudo-lacaniana, a história da cultura e os sistemas hipermidiáticos. Animações, vídeos, hipertextos, trilhas e locuções mesclam-se no interior de um labirinto, interagindo com conceitos teóricos que oferecem os links entre as (...) diversas áreas. (shrink)

Communication and interaction today happen in simply one mouse click away. Language and self-expression do not only develop as a recognized tool for oneself but is an avenue for others’ re-expression and identification. Through using Twitter, the elaboration of social interaction becomes easier and accessible. It becomes the primary method of doing things together and establishes a shared meaning that becomes the common ground of understanding by individuals and groups alike. The study aims to analyze the tweets of Kris Aquino, (...) known as the Philippines’ Queen of Multimedia using speech act categories of Searle and predict the meaning based on the speech acts committed. The study used content analysis for it represents systematic and objective means of describing and quantifying phenomena. The results showed that most tweets contained the ‘assertive’ label which refers to ‘those kinds of speech acts that state what the speaker believes to be the case or not’. Further, her influence as a public figure contributed to the forceful implication of realizing the speech act reflected by her readers. Since impression is reality and intention cannot be quantified, what the general audience perceives on a certain person serves to be the truth. Thus, misinterpretation develops due to poor judgment on the elucidation in the tweets of the posters, readers and vice-versa. Keywords - Sociolinguistics, speech act theory, Twitter, micro-blogging, SNS, qualitative, content analysis, Philippines. (shrink)

Socio-cultural reality of the present time is marked by quite significant events. First, the active penetration into society of the latest information and communication technologies, which arose as a result of the rapid development of electronics. And secondly, the formation and spread of a special type of worldview under the general name of "postmodernism". It is the need for a philosophical understanding of these two events and determined the main idea of this article. The article also shows the role of (...) information technology in the transformation of the cultural reality of postmodernism. Also the main directions of application of information systems and innovative technologies in the field of education and science in general, and at studying of disciplines of a natural cycle in particular are covered. Peculiarities of studying natural sciences by students are revealed, didactic potential of ICT and its realization in the process of studying natural disciplines is considered, methodical analysis of the problem of application of information technologies in natural education is carried out. The principle of integration, multimedia clarity, interactive interaction of participants of educational process at application of new information technologies at studying of natural disciplines is allocated. It is determined that ICT in the teaching of natural sciences can intensify the educational process, accelerate the transfer of knowledge and experience, as well as improve the quality of teaching and education. (shrink)

ObjectiveThis article explores the effect of preoperative health education, in the form of animation videos, on postoperative self-reported pain levels and anxiety in femoral fractures.MethodsNinety cases of femoral fracture were divided at random into the oral instruction group, the recorded video group, and the animation video group, with 30 cases in each group. Sociodemographic data were collected the day before surgery. Health education was then offered in one of three ways: orally, using a recorded video, or using an animation video. (...) On days 2, 4, and 7 after surgery, the state-trait anxiety inventory and the visual analog scale were used to assess postoperative anxiety and pain levels, respectively, in the participants.ResultsAt different time points during the evaluation, total anxiety scores in the animation and recorded video groups were significantly lower than in the oral instruction group. STAI scores in the three groups were found to have significant interactions with the measurement time in the three groups.ConclusionPreoperative health education with the aid of multimedia is more effective than oral instruction in lowering patients’ postoperative anxiety and pain levels. In addition, animation videos are superior to recorded videos in mitigating postoperative anxiety. Whether the two approaches differ in reducing postoperative pain in bone fractures remains to be further tested. (shrink)

The subject of the article is the philosophical and cultural methodology of digital "virtual reality", comparing the declarations of developers with the practical possibilities and social consequences of using such technologies. The developers presented projects of online digital content services for all five senses using special equipment (glasses, headphones, interactive gloves, joysticks, costumes, printers of smells and tastes, etc.). It was assumed that virtual reality would surpass the reliability of previous multimedia content and interactive computer games, and (...) the persuasiveness and attractiveness of traditional technical means of art and the press. Failure to fulfill these promises has led to significant losses since 2022 for leading companies developing digital virtual reality technologies Meta (recognized by the court as an extremist organization on 03/21/2022, activity is limited in the territory of the Russian Federation), Microsoft HapticLinks, Cave, AlloSphere, Teslasuit, VRealizer. There was a need to assess how and to what extent the methodology used and the predicted capabilities of digital virtual reality were correct. Philosophical and cultural analysis as a research method reveals: the developers of digital virtual reality promised the methodologically impossible, reducing human perception to the "sum" of the external "five senses" out of connection with the "self", inner sensitivity, bodily self-perceptions. A person is only partially amenable to algorithmized digital interaction; a critical barrier to digital virtuality is the socio-cultural identity of society and personality. The novelty of the results of the analysis lies in the conclusion: digital virtual reality in many respects is fundamentally inferior in effectiveness to traditional technical means of sensory and emotional impact and cognition, used both for creative and destructive purposes. In terms of creative potential, digital virtual reality is inferior to the technical means of art, science, education, upbringing, etc., and in terms of destructive capabilities, it is already used in the press and other mass communications technologies for manipulating public and individual consciousness, as well as psychotropic substances that cause addiction. National regulation of the development of digital "virtual reality" is recommended, aimed at protecting and developing the socio-cultural identity of Russian citizens and society, as well as for cognitive and educational purposes. It is recommended to limit the remote use of such developments to trusted domestic Internet services. (shrink)

Socially, people find it difficult to say ‘no’ to requests or invitations. In spoken interaction, we orient to this difficulty through the design of our responses. An agreement response is characteristically said straightaway with minimal gap between request and response. A disagreement response is characteristically delayed through silence and by prefacing the disagreement turn with tokens such as ‘well’, ‘uhm’ and ‘uh’ or with accounts as to why the recipient cannot accept the request or invitation. The question for this article (...) concerns what occurs when requests or invitations are made via texting. The results from 329 texting interactions showed that if responses to a request or invitation were delayed by more than 1 minute, it was much more likely be a ‘no’ rather than a ‘yes’ response. In other words, preferred responses were sent quickly; dispreferred responses were delayed. Understanding texting as social interaction is increasingly important as the range of communicative options continues to widen, Multimedia Messaging Service, Instant Messaging, email). This study shows preference organisation similarities between spoken interaction and texting with texters orienting to social norms concerning delayed responses. Further research is needed to understand in what contexts a person might choose one communicative medium over another. (shrink)

​This contributed volume gives access to semiotic researches adopting a quantitative stance. European semiotics is traditionally based on immanent methodologies: meaning is seen as an autonomous dimension of human existence, whose laws can be investigated via purely qualitative analytical and reflexive analysis. Today, researches crossing disciplinary boundaries reveal the limitations of such an homogeneous practice. In particular, two families of quantitative research strategies can be identified. On the one hand, researchers wish to naturalize meaning, by making semiotic results interact with (...) those coming from Neurophysiological and psychological sciences. On the other hand, statistical and computational tools are adopted to work on linguistic and multimedia corpora. The book acts to put the two approaches into dialogue. (shrink)

Audioscan Milano explores the strategies and experiments in the field of sound and noise of Milan’s legendary Studio di Fonologia Musicale. A multimedia installation composed of hundreds of field recordings of the city of Milan, Audioscan Milano provides its audience with a multisensory experience of the urban soundscape and the opportunity to interact with it digitally. The manipulation of noise and its transformation into musical sound via sophisticated electronic equipment emulates the Studio’s audio techniques but also exposes the reasons (...) behind its failure to attract a wider audience. Visitors to Audioscan Milano expect to hear urban noise rather than musical sounds and, despite some enthusiasm around being able to mix sound objects on the map and move them around the room, they fail to appreciate the technical subtleties of the procedures behind the music. Ultimately, Audioscan Milano constitutes an important link to Italy’s musical heritage of the 1950s and 1960s and can learn from its limitations, particularly when it comes to engaging the audience to play a more active role in the auditory experience of the city. (shrink)

This article contemplates a reflexive approach about technological Christianity, emphasizing the technological growth in the XXI century, evangelical churches and their relationships with technology, and the problems that arise from this relationship. It is known that technology advances very quickly, invading more and more all sectors of society, and that it is indispensable in the globalized world. The computer, the TV, the cell phone, the notebook, the internet, the smartphone, the tablet, etc., are new things in constant evolution. This work (...) points to the internet as a resource that can provide content that qualifies the relationship of the individual with God, which has become an extremely useful and necessary tool for the articulation of sectors of the evangelical church, since it dynamizes time and information and, above all, updates and broadens horizons. It is concluded, therefore, that the internet, doubtless, is a field of Christian action. In the case of the digital age, it is possible to affirm that the current Christian context demands a modernity of the languages and the multimedia interactions. However, faith can be affected by the many offers of distraction from technological resources when the central content is not communicated in a proper language to time and environment. (shrink)

Learning from a text–picture multimedia document is particularly effective if learners can link information within the text and across the verbal and the pictorial representations. The ability to create a mental model successfully and include those implicit links is related to the ability to generate inferences. Text processing research has found that text cohesion facilitates the generation of inferences, and thus text comprehension for learners with poor prior knowledge or reading abilities, but is detrimental for learners with good prior (...) knowledge or reading abilities. Moreover, multimedia research has found a positive effect from adding visual representations to text information, particularly when implementing signaling, which consists of verbal or visual cues designed to guide attention to the pictorial representation of relevant information. We expected that, as with text-only documents, struggling readers would benefit from high text cohesion and that signaling would foster inference generation as well. Further, we hypothesized that better learning outcomes would be observed when text cohesion was low and signaling was present. Our first experimental study investigated the effect of those two factors on three levels of comprehension. Participants were adolescents in prevocational schools, where some of the students are struggling readers. The results showed a trend in favor of high cohesion, but with no significant effect, a significant positive effect of cross-representational signaling on comprehension from local inferences, and no interaction effect. A second experiment focused on signaling only and attention toward the picture, with collection of eye-tracking data in addition to measures of offline comprehension. As this study was conducted with university students, who are expected to have higher reading abilities and thus are less likely to benefit from high cohesion, the material was presented in its low cohesive version. The results showed no effect of conditions on comprehension performances but confirmed differences in processing behaviors. Participants allocated more attention to the pictorial representation in the CRS condition than in the no signaling condition. (shrink)

One way to increase the effectiveness of a mobile-oriented learning environment is to use augmented reality technology, which enables the integration of real and virtual learning tools using mobile Internet devices. The purpose of the article is to theoretically substantiate the use of augmented reality technology in physics classes. The article describes and substantiates the relevance of the application of augmented reality technology, considers possible uses of this technology in the educational process, in particular in terms of mobile distance learning. (...) Examples of mobile applications aimed at practice-oriented learning using augmented reality technology are described. Examples of real educational systems that allow to study the disciplines of physical orientation on the basis of this technology are considered. It was found that augmented reality technologies stimulate the educational process and provide the opportunity to implement knowledge in both humanities and natural sciences. This technology expands the educational process towards clarity and motivates the student to further study the material. Visual education is the best thing that can be offered to modern students, which will contribute to the development of scientific and technological progress. The introduction of augmented reality technology makes it possible to improve the quality of education by motivating students to self-study, increasing audience interest in educational material, developing a desire to use modern interactive technical capabilities and technologies, replacing textbooks and laboratory equipment with multimedia computer models. distance learning. (shrink)

The rise in computing and multimedia technology has spawned an increasing interest in the role of diagrams and sketches, not only for the purpose of conveying information but also for creative thinking and problem-solving. This book attempts to characterise the nature of "a science of diagrams" in a wide-ranging, multidisciplinary study that contains accounts of the most recent research results in computer science and psychology. Key topics include: cognitive aspects, formal aspects, and applications. It is a well-written and indispensable (...) survey for researchers and students in the fields of cognitive science, artificial intelligence, human-computer interaction, and graphics and visualisation. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:The Journal of Aesthetic Education 37.4 (2003) 73-84 [Access article in PDF] Music-Picture:One Form of Synthetic Art Education"Music-picture (a picture drawn through musical perception)" has been widely accepted by art educators in Japan. The purpose of this essay is to propose the making of music-pictures as art education and to put it on afirm theoretical base. I first investigate three gestalt rules: adjacency, continuance, and resemblance, all of which (...) are applicable to the senses of both seeing and hearing. Next I present research on color hearing as one version ofsynaesthesia, which is the comprehensive faculty that binds the five senses in various ways. The well-organized music-picture program by Kaoru Sasaki 1 is introduced as an example. 2 The synthetic art-educational value of music-picture will become clearer through these examinations. The Interrelations between Visual Arts and Music It is exciting that the visual arts meet music in an art class, even if these subjects are entirely different in regard to media, expressive form, the category of perception, and mastery of techniques. Put simply, Picasso's works are visible, whereas Stravinsky's pieces are invisible. Nevertheless, both powerfully convey imaginative and often narrative messages. Relying on intuition alone, I firmly believe both are interchangeable.My research on common methods of organizing both recorded music and painting was my first observation of the mutual relationship between music and visual arts. 3 But what I considered then would not be applied to art class directly because the research was based on my practical experience. It did not have any educational goals. Now I recognize that instructive approaches are necessary to lay the foundation for art classes dealing with interaction between two distinct modalities.In Japan, the Ministry of Education and Science provides the government curriculum guidelines nearly every ten years. It contains descriptions on two subjects: The visual arts and music taught in these classes are at an elementary school level and a junior high school level, both located within a compulsory education system. The new version has been in force since April 2002 (the new school term starts in April in Japan). Objectives in the two educational fields are similar and ideas of what art and music education ought to be are almost the same. The aim common to both in the government curriculum guidelines: "Through expression and appreciation, we [End Page 73] cultivate students' sentiments" invites the linking of music and the visual arts across the curriculum.Many art educators in Japan are interested in this sort of idea and have actually put it into practice. 4 They are engaged in interrelating or even unifying music and the visual arts. Additionally I know other teachers who have designed and proposed many ideas toward this crossover. Listed below are general ideas that seek to combine visual arts with music in an art class.1) Music-picture: to make a pictorial description of impressions received from music.2) Sound map: to make a map of sounds heard at a given location. Each sound is visualized by simple marks like - - -, <<<, ~~~, ooo, and xxx.3) Graphic notation: to write a score which directs the details, whole form, and progression of music by graphics instead of staff notation. Using onomatopoeias or instructions by words are common. It can be improvised, based on intuitively translating visual impacts into sounds.4) Sound toy: to make an original musical instrument of familiar easil obtained materials. For instance, a corrugated cardboard ukulele whose strings are rubber bands, a pair of maracas made of empty cans and soybeans, and so forth.5) Sound sculpture: to make sculpture producing interesting sounds (sometimes noises like creak or clatter). Extensive genres: wood sculpture, metal construction, assemblage (junk arts), kinetic arts, and so on.6) Sound installation: to make a place where participants experience sounds generated by objects or equipment.7) Multimedia: in the broad sense, to mix visuals with music; noises like jingle, tap, and bang! in daily life, or natural environmental sounds like a pit-a-pat of falling rain, a whisper of leaves, or... (shrink)

Facebook, the second largest social network on the Web with around 60 million members, is one of the fastest-growing and best-known sites on the Internet today. With the U.S. now accounting for only about a third of all Facebook users, we are starting to see a gradual shift away from its original demographic of college-age users. Very surprisingly, indeed, in the past months Facebook has been literally invaded by Italians, Which is the reason for this huge success of Facebook? One (...) of the reasons is that clearly young Italians' discontent and frustration with the current political situation and with their political representatives is finding in the Web a channel to let youth voice be heard. Facebook is also a media for channelling Italians' emotions, self representation, and symbolic environment at the same speed of their telefonino : indeed Facebook not only provides multimedia content and a high interactive environment, but it also provides personalised features. In other words, it is my personal content which is available on the web and it make me feel as if I was in the centre of a virtually worldly networked stage. We will argue Facebook is realizing what Guy Debord calls "the invasive forces of the 'spectacle' - "a social relation between people that is mediated by images": Facebook is seen as an alternative tool able to amplify an individual's alienation and narcissism, which, are a consequence of the mercantile form of social organization which has reached its climax in capitalism. Under Marxist theory, Facebook does not appear what Jaron Lanier claims to be collaborative communities. We finally argue that Facebook is not a promising example of a new shift from capitalism to a new form of economy based on openness, peering, sharing and global action -- which they called Wikinomics; but rather new disguised forms of advanced capitalism aimed at eroding space to more challenging modes of Internet collectivism. (shrink)

Much working time is spent in meetings and, as a consequence, meetings have become the subject of multidisciplinary research. Virtual Meeting Rooms (VMRs) are 3D virtual replicas of meeting rooms, where various modalities such as speech, gaze, distance, gestures and facial expressions can be controlled. This allows VMRs to be used to improve remote meeting participation, to visualize multimedia data and as an instrument for research into social interaction in meetings. This paper describes how these three uses can be (...) realized in a VMR. We describe the process from observation through annotation to simulation and a model that describes the relations between the annotated features of verbal and non-verbal conversational behavior. As an example of social perception research in the VMR, we describe an experiment to assess human observers’ accuracy for head orientation. (shrink)

This article is about an original virtual reality and multimedia system named Visorama, with dedicated hardware and software aimed at the following fields: digital art, entertainment, historical tourism and education. On the software level, the Visorama system includes the research of a new methodology to build and visualize a stereoscope panorama; a high-level language to provide a transition mechanism between panoramas (wipes, blending, etc.); and multipleresolution panoramas to assure the image's resolution level. On the hardware level, the Visorama simulates (...) an optical device that uses a binocular display to show the image generated by the panorama system. This display is attached to a support base that can rotate around vertical and horizontal axes, which have high-resolution sensors that together capture the current viewing orientation. In addition, three buttons allow the control of zoom angle and the generation of discrete events. This form of direct manipulation of the viewing parameters provides a natural interface for virtual panoramas. On the level of its applications, the system as a whole is designed to promote a more natural interaction with the real space, since its basic characteristics allow the possibility of visualization of the real through a virtual window. The viewer travels in space and time following the several link points contained in it, as various possible navigation routes. (shrink)

In 2006, young people were flocking to MySpace, discovering the joys of watching videos of cute animals on YouTube, and playing online games. Not many of them were watching network news on television; they got most of their information online. So when NBC and MIT launched iCue, an interactive learning venture that combined social networking, online video, and gaming in one multimedia educational site, it was perfectly in tune with the times. iCue was a surefire way for NBC (...) to reach younger viewers and for MIT to test innovative educational methods in the real world. But iCue was a failure: it never developed an audience and was canceled as if it were a sitcom with bad ratings. In _The More We Know_, Eric Klopfer and Jason Haas, both part of the MIT development team, describe the rise and fall of iCue and what it can teach us about new media, old media, education, and the challenges of innovating in educational media. Klopfer and Haas show that iCue was hampered by, among other things, an educational establishment focused on "teaching to the test," television producers uncomfortable with participatory media, and confusion about the market. But this is not just a cautionary tale; sometimes more can be learned from an interesting failure than a string of successes. Today's educational technology visionaries might keep this lesson in mind. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:The Journal of Aesthetic Education 37.4 (2003) 58-64 [Access article in PDF] Media Literacy Education in Art:Motion Expression and the New Vision of Art EducationThe Bauhaus, which established the foundation of modern design, has greatly influenced Japanese design and art education. It is a historical fact that the movement views "synthetic art" as an integration of the various fields and the integration of the art and machine technology experimentally. (...) However, the Bauhaus is not just of historical importance but continues to have an influence even in the integration of the art and electronic technology in today's "multimedia." In addition, it can be said that it is very much alive as "the digital Bauhaus" or "the electronic Bauhaus." 1 As we know, today's multimedia and the Internet give us a new life-environment, and expandthe possibility of expression in art. Therefore, current art education must examine how these new medias will be incorporated into the curriculum.In the cases of the photograph, video, or computer, an expression by the image media is added to the art course for the junior high school course of study. 2 Also in school art classes, image media was introduced, expanding the possibilities of self-expression through art. This result can be matched to the needs of the industrial world in Japan as well. As an educational practice, the content of this course of study is promising, even though someproblems must be solved, acquiring new equipment, re-educating the artteacher, and securing additional art school hours. The new content in art education can be summarized as follows:1. The motion picture (animation) which includes time and movement. Motion picture is asequence of continuous images, obviously different from the still images of painting. There are, of course, artworks that express motion or induce the viewer'seye movement. There are also kinetic artworks that do move, such as mobiles. Works of motion picture have, however, a fixed time shaft, and they are formed by the afterimage phenomenon. Thinking about the progress of time shaft is an indispensable element for the production. [End Page 58]2. The synchronism of image and sound. Because time is a factor in the visual expression, the works are compatible with music — the art of time. There is a synchronized relation between the motion picture and music. Image expression with multimedia became synthetic art, just as the Bauhaus looked for "architecture." Currently, this kind of expression transitions from art to entertainment, and permeates daily life.3. The method with interactive art work. Not only artworks of installation, but also TV games and web design have interactive construction as an indispensable interface. The aesthetic value of these visual works will be appreciated when the user starts the action by hitting a touchpad, pushing buttons, or clicking a mouse. To make this kind of artwork, one needs to consider the latent relationships between humans and work, and establish the input-output order for the method of construction.4. The problem of virtual reality. The term "virtual reality" is used by some art teachers as criticism against digital works such as computer graphics. These teachers insist that there is no reality there. One can, however, get an aesthetic feeling through sensory information, imagination, and sensitivity, even though what one sees is an illusion. The feeling of reality a picture of an apple gives, for example, may be equal to a computer graphic apple.Human imagination also creates "virtual reality" beyond reality in the myth, the novel, and so on. It can be said that this is the basis for human creativity.Furthermore, expression by image media raises the problem of a "reality" in which material experience is important to encounterthe world directly. Such an argument discusses multimedia as a tool of expression and a teaching material while reconsidering human reality.More recently, "media literacy" (ability to read and understand media) became an important point of discussion for Japanese educators. Usually, in this discussion, the critical ability to talk back to the television program is emphasized. However, through art... (shrink)