In this paper, we report on the development of The Sustainable Port video game, which aims to simulate the complex dynamics and decisions occurring in the present and future development of a port area considering environmental aspects (CO2 emissions) and profit. To evaluate if this game fulfills its purpose, we asked 75 students and 34 employees at the Port of Rotterdam (PoR) to play The Sustainable Port. Our results show that PoR employees score higher than students suggesting a transfer between (...) real-life experience of being an employee in the port and performance in the game. Furthermore, port participants reported that The Sustainable Port can be successfully used to start discussions about the future of the Port of Rotterdam and to raise awareness about the complexity characterizing the decision-making processes occurring in a port environment. Our results, taken together, provide evidence of the effectiveness of The Sustainable Port in simulating dynamics occurring in port development and give us optimism about future applications. (shrink)

This study aimed to identify real-life experts working for a port authority and lay people (students) who played The Sustainable Port, a serious game aiming to simulate the dynamics occurring in a port area. To achieve this goal, we analyzed eye gaze data collected noninvasively using low-grade webcams from 28 participants working for the port authority of the Port of Rotterdam and 66 students. Such data were used for a classification task implemented using a MiniRocket classifier, an algorithm used for (...) time-series classification. The classifier reached an F1 score of 0.75 (SD = 0.07), a PR AUC of 0.73 (SD = 0.14), and an ROC AUC of 0.75 (SD = 0.15) providing evidence that it is possible to identify real-life experts about maritime port management using data that can be obtained from a webcam. We speculate that the gaze direction used to train the MiniRocket may contain relevant information about the cognitive processes and decisions occurring throughout the gameplay. We suggest that the methods here presented not only can be used to detect experts playing simulations, such as serious games, but also to identify experts tackling screen-presented tasks. (shrink)

In this paper, we report on an experiment with The Walking Dead (TWD), which is a narrative-driven adventure game with morally charged decisions set in a post-apocalyptic world filled with zombies. This study aimed to identify physiological markers of moral decisions and non-moral decisions using infrared thermal imaging (ITI). ITI is a non-invasive tool used to capture thermal variations due to blood flow in specific body regions that might be caused by sympathetic activity. Results show that moral decisions seem to (...) elicit a significant decrease in temperature in the chin region 20 seconds after participants are presented with a moral decision. However, given the small sample involved, and the lack of significance in other regions, future studies might be needed to confirm the results obtained in this work. (shrink)

Serious games are an effective method of reproducing aspects of the complex interplay between environments and stakeholders in business situations. In the game we describe here, The Sustainable Port, players experience what it is like to make decisions in such a complex environment. Their aim in the game is to grow the Port of Rotterdam while keeping economic growth in balance with sustainability goals. In this study, we assessed whether experienced Port of Rotterdam employees (PoR employees) show different psychophysiological patterns, (...) and more specifically EAR-derived features, compared to students. We did this on the assumption that physiological patterns will tell us something about how people who are familiar with the environment of the Port of Rotterdam, more specifically Port of Rotterdam employees, make decisions compared to those lacking such familiarity.Our sample consisted of 28 PoR employees and 65 students, all of whom played The Sustainable Port game and had their faces recorded with a camera. The Eye Aspect Ratio was extracted from these recordings and then from those we extracted EAR-derived features. Our results show that Port of Rotterdam employees perform better than students and that the two groups are characterized by different physiological variations in their EAR-derived features. A logistic regression model used to identify PoR employees and students obtained an F1 score of 0.62, a PR AUC score of 0.64, and a ROC AUC score of 0.70. performing significantly above baseline suggesting the effectiveness of using EAR-derived features for this task. Our interpretation was further confirmed by a pseudo-R2 score used to evaluate the goodness of fit of a logistic regression model on the entire dataset. We found that Port of Rotterdam employees had a lower variation in blink rate per minute (blinks/m) and higher variation in the root mean square difference of successive difference in blinks (RMSSD), the consecutive difference between two continuous blinks. Moreover, this study shows that our methods were robust enough to negate the effects of confounders, such as biological sex and age that affect some other studies that analyze blinks. (shrink)

This study aimed to evaluate if eye blinks can be used to discriminate players with different performance in a session of Nintendo Entertainment System (NES) Tetris. To that end, we developed a state-of-the-art method for blink extraction from EAR measures, which is robust enough to be used with data collected by a low-grade webcam such as the ones widely available on laptop computers. Our results show a significant decrease in blink rate per minute (blinks/m) during the first minute of playing (...) Tetris. After having defined 3 groups of proficiency based on in-game performance (Novices, Intermediates, and Experts) we found out that expert players display a significantly lower decrease in blinks/m compared to novices during the first minute of gameplay, which shows that Tetris players' proficiency can be detected by looking at eye blinks/m variations during the early phase of a game session. This difference in blinks/m is observed throughout the entire game session, which supports the general conclusion that proficient Tetris players have a lower decrease in blinks/m, even when playing more difficult levels. Finally, we offer some interpretations of this effect and the relationship that our results may have with the visual cognitive workload experienced during the gameplay. (shrink)

In this study, we predict the different levels of performance in a Nintendo Entertainment System (NES) Tetris session based on the score and the number of matches played by the players. Using the first 45 seconds of gameplay, a Random Forest Classifier was trained on the five keys used in the game obtaining a ROC_AUC score of 0.80. Further analysis revealed that the number of down keys (forced drop) and the number of left keys (left translation) are the most relevant (...) keys in this task, showing that by merely including the data from these two keys our Random Forest Classifier reached a ROC_AUC score of 0.83.We conclude that the keylogger data during the early phases of a game session can be successfully used to predict performance in longer sessions of Tetris. (shrink)

In this paper, we report on an experiment with The Walking Dead (TWD), which is a narrative-driven adventure game where players have to survive in a post-apocalyptic world filled with zombies. We used OpenFace software to extract action unit (AU) intensities of facial expressions characteristic of decision-making processes and then we implemented a simple convolution neural network (CNN) to see which AUs are predictive of decision-making. Our results provide evidence that the pre-decision variations in action units 17 (chin raiser), 23 (...) (lip tightener), and 25 (parting of lips) are predictive of decision-making processes. Furthermore, when combined, their predictive power increased up to 0.81 accuracy on the test set; we offer speculations about why it is that these particular three AUs were found to be connected to decision-making. Our results also suggest that machine learning methods in combination with video games may be used to accurately and automatically identify complex decision-making processes using AU intensity alone. Finally, our study offers a new method to test specific hypotheses about the relationships between higher-order cognitive processes and behavior, which relies on both narrative video games and easily accessible software, like OpenFace. (shrink)

The aim of this study was to test whether an online video game can be used to investigate planning ability and whether fluid intelligence, objective numeracy, and subjective numeracy are predictive of game performance. Our results demonstrate that fluid intelligence is particularly important, which is in line with previous non-game-based studies that show a relationship between classical planning tests and fluid intelligence. Video games have been previously used for research into cognitive processes and taking them online facilitates data collection on (...) a larger scale. Online video games also afford data collection without the expense and stress of a laboratory environment. For these reasons, using online video games to investigate human cognition is a promising alternative to the classic cognitive paradigms used in laboratories. (shrink)