In people with chronic low back pain, maladaptive structural and functional changes on a cortical level have been identified. On a functional level, somatosensory cortical excitability has been shown to be reduced in chronic pain conditions, resulting in cortical disinhibition. The occurrence of structural and/or functional maladaptive cortical changes in people with CLBP could play a role in maintaining the pain. There is currently no measurement protocol for cortical excitability that employs stimulation directly to the lower back. We developed a (...) protocol for the measurement of single pulse somatosensory evoked potential waveforms and paired-pulse behavior generated from sensory nerves of the lower back and quantified its test–retest reliability in a sample of 30 healthy individuals to gain insights into the normal variability of cortical responses, which could then be compared to results from people with CLBP. We investigated cortical excitability by measuring SEPs and PPB. PPB was defined as the ratio of the amplitude of the second cortical response divided by the first cortical response. A2s was determined by subtracting the response to single-pulse stimuli from the paired pulse stimuli response to account for linear superposition effects. The test–retest reliability of the protocol was very poor with no evidence of systematic bias but a high amount of random variability between sessions. There was no significant difference in the right side PPB for session 1 and session 2 ; mean session difference [ = −0.44 ; t = −1.17, p = 0.26]. The ICC3.1 for the outlier-removed right side PPB were 0.19 and 0.43 for left side PPB. This finding potentially has wider implications for PPB protocols. If these findings were replicated in other groups and other nerves, it would question the validity of this measure more generally. However, these findings are restricted to healthy people and sensory nerves of the lower back and may not be generalizable. (shrink)

BackgroundThe triangle completion test has been used to assess egocentric wayfinding for decades, yet there is little information on its reliability. We developed a virtual reality based test and investigated whether either test of spatial navigation was reliable.ObjectiveTo examine test-retest reliability of the real-world and VR triangle completion tests. A secondary objective was to examine the usability of the VR based test.Materials and methodsThirty healthy adults aged 18–45 years were recruited to this block randomized study. Participants completed two (...) sessions of triangle completion tests in the real-world and VR on the same day with a break between sessions.ResultsIn both test versions distance from the endpoint and angle of deviation showed poor test-retest reliability. Distance traveled had moderate reliability in both the real-world and VR tests. The VR triangle test showed poor correlation with the real-world test.ConclusionThe triangle completion test has poor test-retest reliability and demonstrates poor concurrent validity between the real-world and VR. Nevertheless, it was feasible to translate a real-world test of spatial navigation into VR. VR provides opportunities for development of clinically relevant spatial navigation tests in the future. (shrink)

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was (...) assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a)Intention to use; (b)perceived barriers; and (c)well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale= 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (rangeHscale= 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N= 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N= 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs. (shrink)

Background: The Bene-Anthony Family Relations Test is one of the most widely used measures of family dynamics seen from a child’s perspective. However, the most common issue surrounding this test is the lack of accurate normative scores for use with non-white ethnic groups. The purpose of this study was to examine the BAFRT’s reliability and validity for use with Arab children, as well as to provide normative data for this group. Methods: The BAFRT was translated into Arabic and back-translated (...) to ensure accuracy. The test was administered to a cohort of 394 Arab children, consisting of both cognitively normal children and children diagnosed with a psychological disorder, all aged 5–8 years old. Test-retest reliability was assessed using a sub-set of children and validity was tested against clinical status as well as CBCL and SDQ measures. Normative measures were calculated after examining the impact of influencing variables such as age and gender. Results: Statistical analyses showed that in our cohort of Arab children the BAFRT has good test-retest reliability, correlates well with measures of emotional and behavioral adjustment, and discriminates accurately between clinical and non-clinical children. Age, gender, and clinical status all significantly impacted upon BAFRT scores and therefore normative values are presented from our cohort when considering these variables. Conclusion: The normative scores we present will provide researchers and clinicians an appropriate reference point for the comparison of scores from Arab children and a starting point for future research into this area. (shrink)

Despite growing interest in emotion regulation, the degree to which psychophysiological measures of emotion regulation are stable over time remains unknown. We examined four-week test-retest reliability of corrugator electromyographic and eyeblink startle measures of negative emotion and its regulation. Both measures demonstrated similar sensitivity to the emotion manipulation, but only individual differences in corrugator modulation and regulation showed adequate reliability. Startle demonstrated diminished sensitivity to the regulation instructions across assessments and poor reliability. This suggests that corrugator represents (...) a trait-like measure of voluntary emotion regulation, whereas startle should be used with caution for assessing individual differences. The data also suggest that corrugator and startle might index partially dissociable constructs and underscore the need to collect multiple measures of emotion. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A and the comparison test. (...) Factor analysis showed that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

Objective The establishment of patient-centered measures capable of empirically determining meaningful cognitive change after surgery can significantly improve the medical care of epilepsy patients. Thus, this study aimed to develop reliable change indices (RCIs) and standardized regression-based (SRB) change norms for a comprehensive neuropsychological test battery in the German language. Methods Forty-seven consecutive patients with temporal lobe epilepsy underwent neuropsychological assessments, both before and 12 months after surgery. Practice-effect-adjusted RCIs and SRB change norms for each test score were computed. To (...) assess their usefulness, the presented methods were applied to a clinical sample, and binary logistic regression analyses were conducted to model the odds of achieving improvement in quality of life (QOL) after surgery. Results The determined RCIs at 90% confidence intervals and the SRB equations for each test score included in the test battery are provided. Cohen’s kappa analyses revealed a moderate mean agreement between the two measures, varying from slight to almost perfect agreement across test scores. Using these measures, a negative association between improvement in QOL and decline in verbal memory functions after surgery was detected (adjusted odds ratio = 0.09, p = 0.006). Significance To the best of our knowledge, this study is the first to develop RCIs and SRB change norms necessary for the objective determination of neuropsychological change in a comprehensive test battery in the German language, facilitating the individual monitoring of improvement and decline in each patients’ cognitive functioning and psychosocial situations after epilepsy surgery. The application of the described measures revealed a strong negative association between improvement in QOL and decline in verbal memory functions after surgery. (shrink)

To avoid post-neurosurgical language deficits, intraoperative mapping of the language function in the brain can be complemented with preoperative mapping with functional magnetic resonance imaging. The validity of an fMRI “language localizer” paradigm crucially depends on the choice of an optimal language task and baseline condition. This study presents a new fMRI “language localizer” in Russian using overt sentence completion, a task that comprehensively engages the language function by involving both production and comprehension at the word and sentence level. The (...) paradigm was validated in 18 neurologically healthy volunteers who participated in two scanning sessions, for estimating test–retest reliability. For the first time, two baseline conditions for the sentence completion task were compared. At the group level, the paradigm significantly activated both anterior and posterior language-related regions. Individual-level analysis showed that activation was elicited most consistently in the inferior frontal regions, followed by posterior temporal regions and the angular gyrus. Test–retest reliability of activation location, as measured by Dice coefficients, was moderate and thus comparable to previous studies. Test–retest reliability was higher in the frontal than temporo-parietal region and with the most liberal statistical thresholding compared to two more conservative thresholding methods. Lateralization indices were expectedly left-hemispheric, with greater lateralization in the frontal than temporo-parietal region, and showed moderate test-retest reliability. Finally, the pseudoword baseline elicited more extensive and more reliable activation, although the syllable baseline appears more feasible for future clinical use. Overall, the study demonstrated the validity and reliability of the sentence completion task for mapping the language function in the brain. The paradigm needs further validation in a clinical sample of neurosurgical patients. Additionally, the study contributes to general evidence on test–retest reliability of fMRI. (shrink)

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioral DIT (bDIT), measuring the development of moral reasoning. 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability of (...) the bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed. (shrink)

This essay focuses on the ethical considerations and implications of providing a universal multi-cancer screening test as the best approach to reduce societal cancer burden in a society with limited funds, resources, and infrastructure. With 1.9 million cancer diagnoses each year in the United States, with 86% of all cancers diagnosed in individuals over the age of 50, and with screening tools approved for only four cancer types (breast, cervical, colorectal, and lung cancer), it seems that a multi-cancer screening test (...) to detect most cancer early that is easy to administer, and is accurate and cost-effective, would be worth considering. Whole-body magnetic resonance imaging and a multi-marker blood test are the two main technologies that we will discuss as a universal screening test. However, to understand and appreciate the societal and clinical breakthrough of such a screening test, we must first consider the accessibility and efficacy of current screening methods. We conclude with a closer examination of the ethical implications of implementing the Galleri test as a multi-cancer detection screening tool as adamantly advocated by the company that developed this blood-based test. (shrink)

Computer multistage adaptive test combines the advantages of paper and pencil-based test and computer-adaptive test. As CAT, MST is adaptive based on modules; as P&P, MST can meet the need of test developers to manage test forms and keep test forms parallel. Cognitive diagnosis can accurately measure students’ knowledge states and provide diagnostic information, which is conducive to student’s self-learning and teacher’s targeted teaching. Although MST and CD have a lot of advantages, many factors prevent MST from applying to CD. (...) In this study, we first attempt to employ automated test assembly to achieve the objectives of MST in the application of CD via heuristic algorithms. The mean correct response probability of all KSs for each item is used to describe the item difficulty of CD. The attribute reliability in CD is defined as the test quantitative target. A simulation study with the G-DINA model was carried out to investigate the proposed CD-MST, and the results showed that the assembled panels of CD-MST satisfied the statistical and the non-statistical constraints. (shrink)

Moral identity is crucial in offenders’ moral rehabilitation, yet no validated measure exists for Chinese male offenders. The present study translated the Moral Identity Scale (MIS) and examined its construct validity and reliability in Chinese male offenders (n = 542). A confirmatory factor analysis showed an acceptable fit for the data. The convergent validity was demonstrated by its significant positive correlations with the Moral-self subscale of the Moral Identity Questionnaire. Furthermore, MIS displayed negative correlations with Amorality and Moral Disengagement, (...) and positive correlations with Moral Attitude, Empathic Concern, and Moral Responsibility, indicating a good nomological validity. Regarding discriminant validity, the revised MIS exhibited nonsignificant or weak correlations with Social Desirability and Retributive Justice Expectations, while the two subscales exhibited distinct correlations with Imagination with Sympathy and Perceived Social Injustice. The test-retest reliability over 4 weeks was.68 (n=113). These findings underscore the reliability and validity of the revised MIS. (shrink)

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and aesthetic world. Verdicts on the latter often have holistic features, and there are dangers that such verdicts involve attempts to compare what cannot be compared. (...) Judgments about the normative and the social often feature a legitimate lack of consistency. (shrink)

Genetic cancer predisposition testing in the paediatric population poses unique ethical dilemmas. Using the hypothetical example of a teenager with cancer with a high probability of having an underlying cancer predisposition syndrome, we discuss the ethical considerations that affect the decision-making process. Because legally these decisions are made by parents, genetic testing in paediatrics can remove a child’s autonomy to preserve his or her own ‘open future’. However, knowledge of results confirming a predisposition syndrome can potentially be beneficial in modifying (...) treatment and surveillance plans and enabling at-risk family members to obtain cascade testing for themselves. Considering virtue ethics to envision the best characters of the patient, parents and healthcare providers can guide them to the better choice to test or not to test, with the ultimate goal of achieving the best outcome for survival andeudaimonia, human flourishing reliably sought out. (shrink)

Scribal copying is investigated as a test case for the memetic and epidemiological models for explaining the distribution of cultural items. We may hypothesize that the incidence of errors could be low enough to allow two conditions for neo-Darwinian explanation to be fulfilled: first, that there be a rather reliable mechanism for heredity, and second that occasional mutations might produce a version more likely to survive and be propagated than the exemplar. Scriptorial conventions are reviewed. Textual criticism is investigated. Finally, (...) some attention is given to the psychology of language perception and production. In conclusion, it is argued that the memetic model for cultural transmission is not generally fecund while the epidemiological model is. (shrink)

Impaired hand proprioception can lead to difficulties in performing fine motor tasks, thereby affecting activities of daily living. The majority of children with unilateral cerebral palsy experience proprioceptive deficits, but accurately quantifying these deficits is challenging due to the lack of sensitive measurement methods. Robot-assisted assessments provide a promising alternative, however, there is a need for solutions that specifically target children and their needs. We propose two novel robotics-based assessments to sensitively evaluate active and passive position sense of the index (...) finger metacarpophalangeal joint in children. We then investigate test-retest reliability and discriminant validity of these assessments in uCP and typically developing children, and further use the robotic platform to gain first insights into fundamentals of hand proprioception. Both robotic assessments were performed in two sessions with 1-h break in between. In the passive position sense assessment, participant's finger is passively moved by the robot to a randomly selected position, and she/he needs to indicate the perceived finger position on a tablet screen located directly above the hand, so that the vision of the hand is blocked. Active position sense is assessed by asking participants to accurately move their finger to a target position shown on the tablet screen, without visual feedback of the finger position. Ten children with uCP and 10 age-matched TDC were recruited in this study. Test-retest reliability in both populations was good >0.79). Proprioceptive error was larger for children with uCP than TDC, indicating discriminant validity. The active position sense was more accurate than passive, and the scores were not correlated, underlining the need for targeted assessments to comprehensively evaluate proprioception. There was a significant effect of age on passive position sense in TDC but not uCP, possibly linked to disturbed development of proprioceptive acuity in uCP. Overall, the proposed robot-assisted assessments are reliable, valid and a promising alternative to commonly used clinical methods, which could help gain a better understanding of proprioceptive impairments in uCP, facilitating the design of novel therapies. (shrink)

The Cognitive Reflection Test (CRT; Frederick, 2005) is designed to measure the tendency to override a prepotent response alternative that is incorrect and to engage in further reflection that leads to the correct response. It is a prime measure of the miserly information processing posited by most dual process theories. The original three-item test may be becoming known to potential participants, however. We examined a four-item version that could serve as a substitute for the original. Our data show that it (...) displays a.58 correlation with the original version and that it has very similar relationships with cognitive ability, various thinking dispositions, and with several other rational thinking tasks. Combining the two versions into a seven-item test resulted in a measure of miserly processing with substantial reliability (.72). The seven-item version was a strong independent predictor of performance on rational thinking tasks after the variance accounted for by cognitive ability and thinking dispositions had been partialled out. (shrink)

This paper argues against the moral Turing test as a framework for evaluating the moral performance of autonomous systems. Though the term has been carefully introduced, considered, and cautioned about in previous discussions :251–261, 2000; Allen and Wallach 2009), it has lingered on as a touchstone for developing computational approaches to moral reasoning :98–109, 2015). While these efforts have not led to the detailed development of an MTT, they nonetheless retain the idea to discuss what kinds of action and reasoning (...) should be demanded of autonomous systems. We explore the flawed basis of an MTT in imitation, even one based on scenarios of morally accountable actions. MTT-based evaluations are vulnerable to deception, inadequate reasoning, and inferior moral performance vis a vis a system’s capabilities. We propose verification—which demands the design of transparent, accountable processes of reasoning that reliably prefigure the performance of autonomous systems—serves as a superior framework for both designer and system alike. As autonomous social robots in particular take on an increasing range of critical roles within society, we conclude that verification offers an essential, albeit challenging, moral measure of their design and performance. (shrink)

Many people follow Grice in thinking that all conversational implicatures are cancellable. And often enough, they use this insight as a test for conversational implicatures. If you want to find out whether something is a conversational implicature, the test has it, you should ask yourself whether the thing in question is cancellable; if you find that it is not cancellable, you can infer that it is not a conversational implicature. If you find that it is cancellable, you can infer that (...) it might well be a conversational implicature and that you should now do further testing. Various philosophers and linguists have questioned the test however. Some have held that Grice's cancellability claim is subject to counterexamples and that the test is not reliable. Others have argued that even though Grice's claim can be defended against the examples in question, the test is not as informative as people have hoped. This article provides an overview of the recent discussion on the cancellability test and suggests a way forward. (shrink)

BackgroundA brief measure of dispositional mindfulness is important for applied research on mindfulness. Although short forms of the Five Facet Mindfulness Questionnaire, which measures the five aspects of mindfulness, have been developed worldwide, the validity and reliability of the Japanese version has not been examined. This study aims to examine the validity and reliability of the 24-item and 15-item versions of the FFMQ in Japan, which are the most widely used versions worldwide.MethodsOnline surveys were conducted for 889 adults (...) in Japan through an online survey company using self-reported questionnaires including the FFMQ to confirm the factor structure and validity. To examine construct validity, we examined the relationship between the short form of FFMQ and mind wandering, interoceptive awareness, experiential avoidance, cognitive fusion, openness, neuroticism, self-compassion, depression, and anxiety, which have been theoretically or empirically shown to be related to mindfulness. In addition, 137 adults responded to the FFMQ again, after four weeks, for the test-retest reliability.ResultsThe correlated five-factor and four-factor models and the higher-order factor hierarchical model did not show sufficient goodness of fit, while the 24-item version showed acceptable fit when uncorrelated method factors loaded on by the positive and negative items were added. However, the 15-item version did not show acceptable fits for any of the models. Regarding reliability, the 24-item version showed acceptable values. In terms of the relationship between the original and the shortened version of the FFMQ, the 24-item version shared approximately 80% of the variance with the original one. In addition, although the wording effects of positive and negative items seemed to affect the correlations between the FFMQ and the other scales, the associations with related concepts were as predicted generally, supporting the construct validity of the short form of the FFMQ.ConclusionIn Japan, the 24-item version of FFMQ showed acceptable validity and reliability similar to the original version, and we recommend that the 24-item version be used. (shrink)

Aims : The Modified Reasons for Smoking Scale (MRSS) is a widely accepted scale that measures psychological functions of smoking. The scale has been translated in Dutch and has been validated, in order to be used in clinical smoking cessation practice in the Dutch-speaking part of Belgium. This study examined the factorial structure, reliability and validity of the scale in a sample of smokers, who are characterized by a high level of dependence and an explicit motivation to stop smoking. (...) Method : The participants were 383 smokers, who volunteered at the stop-smoking clinic of a Belgian university hospital, and completed the translated scale. They were administered the translated MRSS, the Fagerstrom Test for Nicotine Dependence (FTND). Through a clinical interview, smoking behaviour and smoking history was assessed (daily smoking consumption, years smoking, number of quit attempts, weeks stopped, alcohol and coffee consumption, CO level). Exploratory factor analysis was performed. Internal consistency was studied in order to examine the reliability. The concurrent validity was assessed by means of manova, anova and correlation analysis. Results : Factor analysis identified four factors, named stimulation, pleasure of smoking, social smoking and automatism of smoking. Cronbach's alpha ranged from 0.65 (automatism) to 0.72 (stimulation). manova indicated the influence of the variables age, sex, daily consumption and the FTND (the latter two variables showed a dose-dependent association with each subscale). Regression analysis revealed a relationship with dependence indicators, namely: the daily consumption, the number and duration of previous quit attempts, FTND, CO level and daily coffee intake. Conclusions : The Dutch translation of the MRSS identified four factors and revealed acceptable validity and reliability. The adapted version of the translated scale as a component of the psychological assessment procedure in a smoking cessation treatment in Dutch-speaking areas should be implemented. (shrink)

Statistical evidence is pervasive in medicine. In this chapter we will focus on the reliability of randomized clinical trials (RCTs) conducted to test the safety and efficacy of medical treatments. RCTs are scientific experiments and, as such, we expect them to be replicable: if we repeat the same experiment time and again, we should obtain the same outcome (Norton 2015). The statistical design of the test should guarantee that the observed outcome is not a random event, but rather a (...) real effect of the treatments administered. However, for more than a decade now, we have been discussing a replicability crisis across different experimental disciplines including medicine: the outcomes of trials published in very prestigious journals often disappear when the experiment is repeated (see, e.g., Lehrer 2010, Begley and Ellis 2012, Horton 2015). -/- There are different accounts of the reason for this replicability crisis, ranging from scientific fraud to lack of institutional incentives to double-check someone else’s results. In this chapter we will use the replicability crisis as a thread to introduce some central issues in the design of scientific experiments in medicine. First, in section 1, we will see how replicability and statistical significance are connected: we can only make sense of the p-value of a trial outcome within a series of replications of the test. But in order to conduct these replications properly, we need to agree on the proper design of the experiment we are going to repeat. In particular, we need to prevent the preferences of the experimenters from biasing the outcome of the experiment. If there is such a bias, when the experiment is replicated by a third party, the observed outcome will vanish. In section 2, we will argue that trialists need to agree on the debiasing procedures and the statistical quality controls that feature in the trial protocol, if they want the outcome to be replicable. In section 3, we will make two complementary points. On the one hand, replicability per se is not everything: we need trial outcomes that are not only statistically significant but also clinically relevant. On the other hand, trials are not everything: the experts analyzing the evidence can improve the reliability of statistical evidence, although they sometimes fail; we need to further study how they make their decisions. In section 4, we will use a controversy about the overprescription of statins to show how non-replicable effects are obtained in trials and how experts may fail at detecting such flaws, if the commercial interests are big enough. (shrink)

Background: Screen time among adults represents a continuing and growing problem in relation to health behaviors and health outcomes. However, no instrument currently exists in the literature that quantifies the use of modern screen-based devices. The primary purpose of this study was to develop and assess the reliability of a new screen time questionnaire, an instrument designed to quantify use of multiple popular screen-based devices among the US population. -/- Methods: An 18-item screen-time questionnaire was created to quantify use (...) of commonly used screen devices (e.g. television, smartphone, tablet) across different time points during the week (e.g. weekday, weeknight, weekend). Test-retest reliability was assessed through intra-class correlation coefficients (ICCs) and standard error of measurement (SEM). The questionnaire was delivered online using Qualtrics and administered through Amazon Mechanical Turk (MTurk). -/- Results: Eighty MTurk workers completed full study participation and were included in the final analyses. All items in the screen time questionnaire showed fair to excellent relative reliability (ICCs = 0.50–0.90; all < 0.000), except for the item inquiring about the use of smartphone during an average weekend day (ICC = 0.16, p = 0.069). The SEM values were large for all screen types across the different periods under study. -/- Conclusions: Results from this study suggest this self-administered questionnaire may be used to successfully classify individuals into different categories of screen time use (e.g. high vs. low); however, it is likely that objective measures are needed to increase precision of screen time assessment. (shrink)

This paper considers four lines of objection to the efficacy or worth of Grice's cancellability test for conversational implicatures – the coherence objection, the entailment objection, the sarcasm objection, and the ambiguity objection. I argue that the test survives these objections relatively unscathed; and hence conclude that the cancellability test is still a significant, useful, reliable indicator at the semantics/pragmatics interface.

The concept of transliminality (''a hypothesized tendency for psychological material to cross thresholds into or out of consciousness'') was anticipated by William James (1902/1982), but it was only recently given an empirical definition by Thalbourne in terms of a 29-item Transliminality Scale. This article presents the 17-item Revised Transliminality Scale (or RTS) that corrects age and gender biases, is unidimensional by a Rasch criterion, and has a reliability of .82. The scale defines a probabilistic hierarchy of items that address (...) magical ideation, mystical experience, absorption, hyperaesthesia, manic experience, dream interpretation, and fantasy proneness. These findings validate the suggestions by James and Thalbourne that some mental phenomena share a common underlying dimension with selected sensory experiences (such being overwhelmed by smells, bright lights, sights, and sounds). Low scores on transliminality remain correlated with ''tough mindedness'' in on Cattell 16PF test, as well as ''self-control'' and ''rule consciousness,'' whereas high scores are associated with ''abstractedness'' and an ''openness to change'' on that test. An independent validation study confirmed the predictions implied by our definition of transliminality. Implications for test construction are discussed. (shrink)

The Collegiate Learning Assessment Test has become popular and highly recommended, praised for its reliability and validity. I argue that while the CLA may be a commendable test for measuring critical-thinking, problem-solving, and logical-reasoning skills, those who are scoring students’ answers to the test’s questions are rendering the CLA invalid.

Social attachment can explain well the bond between users and social media, but existing research lacks measures of social attachment scales. To this end, this study takes attachment theory as the basis for scale development. On the basis of the development of multidimensional scales for adult, brand, and local attachment, it combines existing relevant studies on social attachment, selects three representative social media such as TikTok, WeChat, and MicroBlog as theoretical samples, explores the concept and structure of social attachment, and (...) develops a social attachment scale through qualitative interviews and open-ended questionnaires. This study applied SPSS 24.0 and Mplus 7.0 to test the social attachment scale. The findings reveal that social attachment consists of three constructs: social connection, social dependence and social identity, and the scale possesses high reliability and validity. This study has developed and validated a social attachment scale in the context of social software use, realizing a quantitative study of social attachment and providing a basis for future empirical research related to social attachment. (shrink)

Background: An association between gaming disorder and the symptoms of common mental disorders is unraveled yet. In this preregistered study, we quantitatively synthesized reliability, convergent and discriminant validity of GD scales to examine association between GD and other constructs.Methods: Five representative GD instruments were chosen based on recommendations by the previous systematic review study to conduct correlation meta-analyses and reliability generalization. A systematic literature search was conducted through Pubmed, Proquest, Embase, and Google Scholar to identify studies that reported (...) information on either reliability or correlation with related variables. 2,124 studies were full-text assessed as of October 2020, and 184 were quantitatively synthesized. Conventional Hedges two-level meta-analytic method was utilized.Results: The result of reliability generalization reported a mean coefficient alpha of 0.86 and a mean test-retest estimate of 0.86. Estimated effect sizes of correlation between GD and the variables were as follows: 0.33 with depression, 0.29 with anxiety, 0.30 with aggression, –0.22 with quality of life, 0.29 with loneliness, 0.56 with internet addiction, and 0.40 with game playtime, respectively. The result of moderator analyses, funnel and forest plots, and publication bias analyses were also presented.Discussion and Conclusion: All five GD instruments have good internal consistency and test-retest reliability. Relatively few studies reported the test-retest reliability. The result of correlation meta-analysis revealed that GD scores were only moderately associated with game playtime. Common psychological problems such as depression and anxiety were found to have a slightly smaller association with GD than the gaming behavior. GD scores were strongly correlated with internet addiction. Further studies should adopt a rigorous methodological procedure to unravel the bidirectional relationship between GD and other psychopathologies.Limitations: The current study did not include gray literature. The representativeness of the five tools included in the current study could be questioned. High heterogeneity is another limitation of the study.Systematic Review Registration: [https://www.crd.york.ac.uk/PROSPERO/], identifier [CRD42020219781]. (shrink)