This study explored calibrating a large item bank for use in multidimensional health measurement with computerized adaptive testing, using both item responses and response time (RT) information. The Activity Measure for Post-Acute Care is a patient-reported outcomes measure comprised of three correlated scales (Applied Cognition, Daily Activities, and Mobility). All items from each scale are Likert type, so that a respondent chooses a response from an ordered set of four response options. The most appropriate item response (...) theory model for analyzing and scoring these items is the multidimensional graded response model (MGRM). During the field testing of the items, an interviewer read each item to a patient and recorded, on a tablet computer, the patient’s responses and the software recorded RTs. Due to the large item bank with over 300 items, data collection was conducted in four batches with a common set of anchor items to link the scale. Van der Linden’s (2007) hierarchical modeling framework was adopted. Several models, with or without interviewer as a covariate and with or without interaction between interviewer and items, were compared for each batch of data. It was found that the model with the interaction between interviewer and item, when the interaction effect was constrained to be proportional, fit the data best. Therefore, the final hierarchical model with lognormal model for RT and the MGRM for response data was fitted to all batches of data via a concurrent calibration. Evaluation of parameter estimates revealed that (1) adding response time information did not affect the item parameter estimates and their standard errors significantly; (2) adding response time information helped reduce the standard error of patients’ multidimensional latent trait estimates, but adding interviewer as a covariate did not result in further improvement. Implications of the findings for follow up adaptive test delivery design are discussed. (shrink)

Students can use an educational system’s help in unexpected ways. For example, they may bypass abstract hints in search of a concrete solution. This behavior has traditionally been labeled as a form of gaming or help abuse. We propose that some examples of this behavior are not abusive and that bottom-out hints can act as worked examples. We create a model for distinguishing good student use of bottom-out hints from bad student use of bottom-out hints by means of logged (...) class='Hi'>response times. We show that this model not only predicts learning, but captures behaviors related to self-explanation. (shrink)

Peer review poses many challenges for journals. A downside of high rejection rates and sometimes delayed responses in publication decision by journals is a long time period between original submission of a manuscript and its ultimate acceptance and publication. One way of accelerating the process which might be worth considering is multiple submission. This commentary addresses that issue.

We report on five experiments investigating response choices and response times to simple science questions that evoke student “misconceptions,” and we construct a simple model to explain the patterns of response choices. Physics students were asked to compare a physical quantity represented by the slope, such as speed, on simple physics graphs. We found that response times of incorrect answers, resulting from comparing heights, were faster than response times of correct answers comparing (...) slopes. This result alone might be explained by the fact that height was typically processed faster than slope for this kind of task, which we confirmed in a separate experiment. However, we hypothesize that the difference in response time is an indicator of the cause of the response choice. To support this, we found that imposing a 3-s delay in responding increased the number of students comparing slopes on the task. Additionally a significant proportion of students recognized the correct written rule , but on the graph task they incorrectly compared heights. Finally, training either with repetitive examples or providing a general rule both improved scores, but only repetitive examples had a large effect on response times, thus providing evidence of dual paths or processes to a solution. Considering models of heuristics, information accumulation models, and models relevant to the Stroop effect, we construct a simple relative processing time model that could be viewed as a kind of fluency heuristic. The results suggest that misconception-like patterns of answers to some science questions commonly found on tests may be explained in part by automatic processes that involve the relative processing time of considered dimensions and a priority to answer quickly. (shrink)

In this paper I argue that new attempts to undermine the principle of alternative possibilities via appeal to time travel fail. My argument targets a version of a Frankfurt-style counterexample to the principle recently developed by Spencer. I argue that in avoiding one prominent objection to standard Frankfurt-style counterexamples Spencer’s time travel case runs afoul of another. Furthermore, the very feature of the case which makes it initially appealing also makes it impossible to revise the case such that it can (...) avoid this further objection. Thus Spencer’s time travel case and cases like it provide no dialectical advantages over other Frankfurt-style cases. I conclude that this strategy for refining such cases should be abandoned. (shrink)

A two-systems model of moral judgment proposed by Joshua Greene holds that deontological moral judgments (those based on simple rules concerning action) are often primary and intuitive, and these intuitive judgments must be overridden by reflection in order to yield utilitarian (consequence-based) responses. For example, one dilemma asks whether it is right to push a man onto a track in order to stop a trolley that is heading for five others. Those who favor pushing, the utilitarian response, usually take (...) longer to respond than those who oppose pushing. Greene's model assumes an asymmetry between the processes leading to different responses. We consider an alternative model based on the assumption of symmetric conflict between two response tendencies. By this model, moral dilemmas differ in the "difficulty" of giving a utilitarian response and subjects differ in the "ability" (tendency) to give such responses. (We could just as easily define ability in terms of deontological responses, as the model treats the responses symmetrically.) We thus make an analogy between moral dilemmas and tests of cognitive ability, and we apply the Rasch model, developed for the latter, to estimate the ability-difficulty difference for each dilemma for each subject. We apply this approach to five data sets collected for other purposes by three of the co-authors. Response time (RT), including yes and no responses, is longest when difficulty and ability match, because the subject is indifferent between the two responses, which also have the same RT at this point. When we consider yes/no responses, RT is longest when the model predicts that the response is improbable. Subjects with low ability take longer on the "easier" dilemmas, and vice versa. (shrink)

(2013). Matching bias in syllogistic reasoning: Evidence for a dual-process account from response times and confidence ratings. Thinking & Reasoning: Vol. 19, No. 1, pp. 54-77. doi: 10.1080/13546783.2012.735622.

Following a hypnotic amnesia suggestion, highly hypnotically suggestible subjects may experience amnesia for events. Is there a failure to retrieve the material concerned from autobiographical memory, or is it retrieved but blocked from consciousness? Highly hypnotically suggestible subjects produced free-associates to a list of concrete nouns. They were then given an amnesia suggestion for that episode followed by another free association list, which included 15 critical words that had been previously presented. If episodic retrieval for the first trial had been (...) blocked, the responses on the second trial should still have been at least as fast as for the first trial. With semantic priming, they should be faster. In fact, they were on average half a second slower. This suggests that the material had been retrieved but blocked from consciousness. A goal-oriented information processing framework is outlined to interpret these and related data. (shrink)

The investigation of how humans perceive and respond to emotional signals conveyed by the human body has been for a long time secondary compared with the investigation of facial expressions and emotional scenes recognition. The aims of this behavioral study were to assess the ability to process emotional body postures and to test whether motor response is mainly driven by the emotional content of the picture or if it is influenced by motor resonance. Emotional body postures and scenes (IAPS) (...) divided into three clusters (fear, happiness, and neutral) were shown to 25 healthy subjects (13 males, mean age ± SD: 22.3 ± 1.8 years) in a three-alternative forced choice task. Subjects were asked to recognize the emotional content of the pictures by pressing one of three keys as fast as possible in order to estimate response times (RTs). The rating of valence and arousal was also performed. We found shorter RTs for fearful body postures as compared with happy and neutral postures. In contrast, no differences across emotional categories were found for the IAPS stimuli. Analysis on valence and arousal and the subsequent item analysis showed an excellent reliability of the two sets of images used in the experiment. Our results show that fearful body postures are rapidly recognized and processed, probably thanks to the automatic activation of a series of central nervous system structures orchestrating the defensive threat reactions, strengthening and supporting previous neurophysiological and behavioral findings in body language processing. (shrink)

Determining the nature of binding in grapheme-color synaesthesia has consequences for understanding the neural basis of synaesthesia and visual awareness in general. We evaluated type- and token-based letter-color binding using a synaesthetic version of the object-reviewing paradigm. Although mean response times failed to reveal any significant differences between synaesthetes and control participants, RT analyses with ex-Gaussian distributions revealed that the response facilitation in the synaesthesia group reflected type representations exclusively, while response facilitation in the control group, (...) who learned letter-color associations, was dominated by token representations. Thus, letter-color associations in associator synaesthetes are type-based, and do not involve binding to object tokens, consistent with their subjective reports. Contrary to recent studies that failed to find differences between synaesthetes and non-synaesthetes with behavioral measures, response time distribution analyses indicate that color sensations in synaesthetes are not simply the extreme form of normal letter-color associations, and cannot be attributed to demand characteristics. (shrink)

Researchers have begun to use response times to emotion items as an indirect measure of emotional clarity. Our first aim was to scrutinise the properties of this RT measure in more detail than previously. To be able to provide recommendations as to whether emotional intensity – as a possible confound – should be controlled for, we investigated the specific form of the relation between emotional intensity and RTs to emotion items. In particular, we assumed an inverted U-shaped relation (...) at the item level. Moreover, we analysed the RT measure’s convergent validity with respect to individuals’ confidence in their emotion ratings. As a second aim, we compared the predictive validity of emotional clarity measures with respect to daily emotion regulation. The results of three experience sampling studies showed that the association between emotional intensity and RT followed an inverted U shape. RT was in part related to confidence. Emotional clarity measures were unrelated to reappraisal. There was some evidence that lower emotional clarity was related to a greater use of suppression. The findings highlight that emotional intensity and squared emotional intensity should be controlled for when using the RT measure of emotional clarity in future research. (shrink)

Diffusion models are widely-used and successful accounts of the time course of two-choice decision making. Most diffusion models assume constant boundaries, which are the threshold levels of evidence that must be sampled from a stimulus to reach a decision. We summarize theoretical results from statistics that relate distributions of decisions and response times to diffusion models with time-varying boundaries. We then develop a computational method for finding time-varying boundaries from empirical data, and apply our new method to two (...) problems. The first problem involves finding the time-varying boundaries that make diffusion models equivalent to the alternative sequential sampling class of accumulator models. The second problem involves finding the time-varying boundaries, at the individual level, that best fit empirical data for perceptual stimuli that provide equal evidence for both decision alternatives. We discuss the theoretical and modeling implications of using time-varying boundaries in diffusion models, as well as the limitations and potential of our approach to their inference. (shrink)

In this article, a highly effective Bayesian sampling algorithm based on auxiliary variables is proposed to analyze aberrant response and response time data. The new algorithm not only avoids the calculation of multidimensional integrals by the marginal maximum likelihood method but also overcomes the dependence of the traditional Metropolis–Hastings algorithm on the tuning parameter in terms of acceptance probability. A simulation study shows that the new algorithm is accurate for parameter estimation under simulation conditions with different numbers of (...) examinees, items, and speededness levels. Based on the sampling results, the powers of the two proposed Bayesian assessment criteria are tested in the simulation study. Finally, a detailed analysis of a high-state and large-scale computerized adaptive test dataset is carried out to illustrate the proposed methodology. (shrink)

Working speed as a latent variable reflects a respondent’s efficiency to apply a specific skill, or a piece of knowledge to solve a problem. In this study, the common assumption of many response time models is relaxed in which respondents work with a constant speed across all test items. It is more likely that respondents work with different speed levels across items, in specific when these items measure different dimensions of ability in a multidimensional test. Multiple speed factors are (...) used to model the speed process by allowing speed to vary across different domains of ability. A joint model for multidimensional abilities and multifactor speed is proposed. Real response time data are analyzed with an exploratory factor analysis as an example to uncover the complex structure of working speed. The feasibility of the proposed model is examined using simulation data. An empirical example with responses and response times is presented to illustrate the proposed model’s applicability and rationality. (shrink)

In this article we use proportional hazards models to examine how low-level processes affect the probability of making a saccade over time, through the period of fixation, during reading. We apply the Cox proportional hazards model to investigate how launch distance (relative to word beginning), fixation location (relative to word center), and word frequency affect the hazard of a saccadic response. This model requires that covariates have a constant impact on the hazard over time, the assumption of proportional hazards. (...) We show that this assumption is not supported. The impact of the covariates changes with the time passed since fixation onset. To account for the non-proportional hazards we fit step functions of time, resulting in a model with time-varying effects on the hazard. We evaluate the ability to predict the timing of saccades on held-out fixation data. The model with time-varying effects performs better in predicting the timing of saccades for fixations as short as 100 ms and as long as 500 ms, when compared both to a baseline model without covariates and a model which assumes constant covariate effects. This result suggests that the time-varying effects model better recovers the time course of low-level processes that influence the decision to move the eyes. (shrink)

Most models of response time (RT) in elementary cognitive tasks implicitly assume that the speed-accuracy trade-off is continuous: When payoffs or instructions gradually increase the level of speed stress, people are assumed to gradually sacrifice response accuracy in exchange for gradual increases in response speed. This trade-off presumably operates over the entire range from accurate but slow responding to fast but chance-level responding (i.e., guessing). In this article, we challenge the assumption of continuity and propose a phase (...) transition model for RTs and accuracy. Analogous to the fast guess model (Ollman, 1966), our model postulates two modes of processing: a guess mode and a stimulus-controlled mode. From catastrophe theory, we derive two important predictions that allow us to test our model against the fast guess model and against the popular class of sequential sampling models. The first prediction—hysteresis in the transitions between guessing and stimulus-controlled behavior—was confirmed in an experiment that gradually changed the reward for speed versus accuracy. The second prediction—bimodal RT distributions—was confirmed in an experiment that required participants to respond in a way that is intermediate between guessing and accurate responding. (shrink)

The goal of the present study was to evaluate the roles of response times in the achievement of students in the following latent ability domains: verbal, math and spatial reasoning, mental flexibility, and scientific and mechanical reasoning. Participants were 869 students who took on the Multiple Mental Aptitude Scale. A mixture item response model was implemented to evaluate the roles of response times in performance by modeling ability and non-ability classes. Results after applying this model (...) to the data across domains indicated the presence of several behaviors related to rapid responding which were covaried with low achievement likely representing unsuccessful guessing attempts. (shrink)

In his comments, Daniel Nicholls succeeds in saying more than a few things that I had scarcely realized about the ways in which I write and, therefore, of what I tend to take for granted. He sees in what I write a capacity ‘to utilize the “obvious” whilst at the same time saying something about it.’ Not every philosopher would take that as a compliment. Many philosophers and philosophies have quite other pretensions – to transcend the illusions of common thought (...) and perception towards a higher plane of metaphysical philosophy – or of physics and mathematics. I find that Nicholls’s remark both compliments and complements my work, however. The use of everyday language and example to disturb that everyday world to ‘bring it into high relief’ as Nicholls puts it – is a significant part of philosophical method. To juxtapose the esoteric language of metaphysics (being-in-itself, being-for-itself, being-for-others) with the everyday (what there is, living for oneself, living for others) is to haunt the everyday with a metaphysical imagination even as it reveals what metaphysics had erased from the coinage of common words. (I am thinking, of course, of Derrida’s remarks about Anatole France’s satirical view of philosophical language as coinage from which all marking has been erased). (shrink)

Intra-individual variability (IIV) refers to within-person variability in behavioural task responses. Several factors can influence IIV, including aging and cognitive demands. The present study investigated effects of aging on IIV of response times during executive functioning tasks. Known age-related differences in cognitive control and emotion processing motivated evaluating how varying the design of emotional response inhibition tasks would influence IIV in older and younger adults. We also tested whether IIV predicted inhibitory control across task designs and age (...) groups. Older and younger adults (N = 237) completed one of three versions of a stop-signal task, which all displayed happy, fearful, or neutral faces in Stop trials. An independent group of older and younger adults (N = 80) completed a go/no-go task also employing happy, fearful and neutral faces. Results showed older adults had more consistent responses (lower IIV) than younger adults in the stop-signal task, but not the go/no-go task. Lower IIV predicted more efficient emotional response inhibition for fear faces in the stop-signal task, but only when attention to emotion was task-relevant. Collectively, this study clarifies effects of aging and task design on IIV and illustrates how task design impacts the relationship between IIV and emotional response inhibition in younger and older adults. (shrink)