This study explored calibrating a large item bank for use in multidimensional health measurement with computerized adaptive testing, using both item responses and response time (RT) information. The Activity Measure for Post-Acute Care is a patient-reported outcomes measure comprised of three correlated scales (Applied Cognition, Daily Activities, and Mobility). All items from each scale are Likert type, so that a respondent chooses a response from an ordered set of four response options. The most appropriate (...) item response theory model for analyzing and scoring these items is the multidimensional graded response model (MGRM). During the field testing of the items, an interviewer read each item to a patient and recorded, on a tablet computer, the patient’s responses and the software recorded RTs. Due to the large item bank with over 300 items, data collection was conducted in four batches with a common set of anchor items to link the scale. Van der Linden’s (2007) hierarchical modeling framework was adopted. Several models, with or without interviewer as a covariate and with or without interaction between interviewer and items, were compared for each batch of data. It was found that the model with the interaction between interviewer and item, when the interaction effect was constrained to be proportional, fit the data best. Therefore, the final hierarchical model with lognormal model for RT and the MGRM for response data was fitted to all batches of data via a concurrent calibration. Evaluation of parameter estimates revealed that (1) adding response time information did not affect the item parameter estimates and their standard errors significantly; (2) adding response time information helped reduce the standard error of patients’ multidimensional latent trait estimates, but adding interviewer as a covariate did not result in further improvement. Implications of the findings for follow up adaptive test delivery design are discussed. (shrink)

As a branch of statistical latent variable modeling, multidimensional item response theory plays an important role in psychometrics. Multidimensional graded response model is a key model for the development of multidimensional computerized adaptive testing with graded-response data and multiple traits. This paper explores how to automatically identify the item-trait patterns of replenished items based on the MGRM in MCAT. The problem is solved by developing an exploratory pattern recognition method for graded- (...) class='Hi'>response items based on the least absolute shrinkage and selection operator, which is named LPRM-GR and facilitates the subsequent parameter estimation of replenished items and helps maintaining the effectiveness of item replenishment in MCAT. In conjunction with the proposed approach, the regular BIC and weighted BIC are applied, respectively, to select the optimal item-trait patterns. Simulation for evaluating the LPRM-GR in pattern recognition accuracy of replenished items and the corresponding item estimation accuracy is conducted under multiple conditions across different numbers with respect to dimensionality, response-category numbers, latent trait correlation, stopping rules, and item selection criteria. Results show that the proposed method with the two types of BIC both have good performance in pattern recognition for item replenishment in the two- to four-dimensional MCAT with the MGRM, for which the weighted BIC is generally superior to the regular BIC. The proposed method has relatively high accuracy and efficiency in identifying the patterns of graded-response items, and has the advantages of easy implementation and practical feasibility. (shrink)

Item context effects refer to the impact of features of a test on an examinee’s item responses. These effects cannot be explained by the abilities measured by the test. Investigations typically focus on only a single type of item context effects, such as item position effects, or mode effects, thereby ignoring the fact that different item context effects might operate simultaneously. In this study, two different types of context effects were modeled simultaneously drawing on data (...) from an item calibration study of a multidimensional computerized test (N = 1,632) assessing student competencies in mathematics, science, and reading. We present a generalized linear mixed model (GLMM) parameterization of the multidimensional Rasch model including item position effects (distinguishing between within-block position effects and block position effects), domain order effects, and the interactions between them. Results show that both types of context effects played a role, and that the moderating effect of domain orders was very strong. The findings have direct consequences for planning and applying mixed domain assessment designs. (shrink)

The factor structure of the Multidimensional Ethics Scale (MES; Reidenbach and Robin: 1988, Journal of Business Ethics 7, 871–879; 1990, Journal of Business Ethics 9, 639–653) was examined for the 8-item short form (N = 328) and the original 30-item pool (N = 260). The objectives of the study were: to verify the dimensionality of the MES; to increase the amount of true cross-scenario variance through the use of 18 scenarios varying in moral intensity (Jones: 1991, Academy (...) of Management Review 16, 366–395); and, to examine the items for measurement precision using item-response theory (IRT) methods. Results of confirmatory and exploratory factor analysis failed to conclusively support the hypothesized 3- (short form) or 5-factor (long form) structure; both instruments were instead dominated by a general factor. Item response theory analyses using Samejima’s (1969, Psychometrika Monograph Supplement 34, (4, Pt. 2)) graded response model revealed that many items in the 30-item pool performed very well, and suggested that a different collection of items be used to form a short-form version of the MES. Our proposed 10-item instrument includes more discriminating items than the 8-item version, and has the added advantage of including two items from each of the five ethical philosophies represented in the original 30-item pool. (shrink)

Using an Item response theory (IRT) analysis, this study examined ethnic and gender groups differences in exposure to content material (i.e. access to curriculum) assessed on the 12th grade NAEP US History 2010 exam. Employing multi-step data analysis procedures, authors examined race and gender using the NAEP Item Mapping Tool available through NCES. Results revealed item-level patterns, which suggest that females and Black students are more likely to answer questions, related to social history, particularly the (...) Civil Rights, when accounting for student achievement. While instructional exposure matters, how students of similar performance differentiate themselves on item response is related to demographics. These findings have substantial implications for social studies, which include the need to develop a more democratic curriculum that reflects the cultural identities of students in order to make history and history knowledge meaningful. Additionally, results have implications for tests. Assessments should be mindful of cultural validity of items and become more inclusive; perhaps aligning with a more culturally relevant curriculum. (shrink)

Multilevel item response theory models are used widely in educational and psychological research. This type of modeling has two or more levels, including an item response theory model as the measurement part and a linear-regression model as the structural part, the aim being to investigate the relation between explanatory variables and latent variables. However, the linear-regression structural model focuses on the relation between explanatory variables and latent variables, which is only from the perspective of (...) the average tendency. When we need to explore the relationship between variables at various locations along the response distribution, quantile regression is more appropriate. To this end, a quantile-regression-type structural model named as the quantile MLIRT model is introduced under the MLIRT framework. The parameters of the proposed model are estimated using the Gibbs sampling algorithm, and comparison with the original MLIRT model is conducted via a simulation study. The results show that the parameters of the Q-MLIRT model could be recovered well under different quantiles. Finally, a subset of data from PISA 2018 is analyzed to illustrate the application of the proposed model. (shrink)

Research on spatial thinking requires reliable and valid measures of individual differences in various component skills. Spatial perspective taking (PT)—the ability to represent viewpoints different from one's own—is one kind of spatial skill that is especially relevant to navigation. This study had two goals. First, the psychometric properties of four PT tests were examined: Four Mountains Task (FMT), Spatial Orientation Task (SOT), Perspective-Taking Task for Adults (PTT-A), and Photographic Perspective-Taking Task (PPTT). Using item response theory (IRT), (...) class='Hi'>item difficulty, discriminability, and efficiency of item information functions were evaluated. Second, the relation of PT scores to general intelligence, working memory, and mental rotation (MR) was assessed. All tasks showed good construct validity except for FMT. PPTT tapped a wide range of PT ability, with maximum measurement precision at average ability. PTT-A captured a lower range of ability. Although SOT contributed less measurement information than other tasks, it did well across a wide range of PT ability. After controlling for general intelligence and working memory, original and IRT-refined versions of PT tasks were each related to MR. PTT-A and PPTT showed relatively more divergent validity from MR than SOT. Tests of dimensionality indicated that PT tasks share one common PT dimension, with secondary task-specific factors also impacting the measurement of individual differences in performance. Advantages and disadvantages of a hybrid PT test that includes a combination of items across tasks are discussed. (shrink)

Insight is a construct carried out into different theoretical orientations with increasing application out of the boundaries of clinical psychology. Recent studies have investigated insight also as a promising variable for organizational outcomes. Given the relevance of Insight in promoting change, this paper aimed at describing the psychometric analysis of one of the shortest, most agile, and most versatile tool for measuring some of the characteristics of insight, the Insight Orientation Scale, using Item Response Theory. To achieve (...) this goal, we applied a Mixed Rash Model to the IOS. Data from 1,445 individuals were analyzed by the means of WIN-MIRA and Multilog. Based on the likelihood statistics we assumed a three-class solution for the IOS. Results also indicated that the greater part of items had good discrimination and threshold parameters. These findings confirmed psychometric stability of the IOS highlighting its measurement precision, supporting its utility in both research and practice. (shrink)

To measure non-cognitive facets of competence, we developed and tested a new method that we refer to as Embedded Experience Sampling (EES). Domain-specific problem-solving competence is a multi-faceted construct that is not limited to cognitive facets such as domain knowledge or problem-solving strategies but also comprises non-cognitive facets in the sense of domain-specific emotional and motivational dispositions such as interest and self-concept. However, in empirical studies non-cognitive facets are usually either neglected or measured by generalized self-report questionnaires that are detached (...) from the performance assessment. To enable an integrated measurement, we developed the EES method to collect data on non-cognitive facets during scenario-based low-stakes assessments. Test-takers are requested to stop at certain times and spontaneously answer short items (EES items) regarding their actual experience of the problem situation. These EES items are embedded in an EES event that resembles typical social interactions with non-player characters. To evaluate the feasibility and validity of the method, we implemented EES in a series of three studies in the context of commercial vocational education and training (VET): A feasibility study with 77 trainees, a pilot study with 20 trainees, and the main study with 780 trainees who worked on three complex problem scenarios in a computer-based office simulation. In the present paper, we investigate how test-takers perceived the EES events, and whether social desirability biased their answers, and investigate the internal structure of the data and the relationship between EES data and data from several other sources. Interview data and survey data indicated no biases due to social desirability and no additional burden for the test-takers due to the EES events. A correlation analysis following the multitrait-multimethod approach as well as the calibration of a multidimensional model based on Item Response Theory (IRT) also supported the construct validity. Furthermore, EES data shows substantial correlations with test motivation but almost zero correlations with data from generalized retrospective self-report questionnaires on non-cognitive facets. Altogether, EES offers an alternative approach to measuring non-cognitive facets of competence under certain conditions. For instance, EES is also based on self-reporting and thus might not be suitable for high-stakes testing. (shrink)

This study develops a short Creative Expression Interest Scale among Chinese freshmen based on the perspective of item response theory. Nine hundred fifty-nine valid Chinese freshmen participated in the Creative Expression Interest survey. Researchers applied the initial data for unidimensionality, item fit, discrimination parameter, and differential item functioning to obtain a short CEIS. The results show that the Short CEIS meets the psychometric requirements of the IRT. Pearson correlation coefficient of theta between the short and (...) long CEIS is 0.922. The marginal reliability of the short CEIS is 0.799. These indicate that the short CEIS developed in this study among Chinese freshmen, meets the psychometric requirements. Although the Short CEIS can eliminate redundant, uninformative items, save time, and improve the quality of data collection. However, the validity of this short scale needs further validation. (shrink)

Applying the graded response model within the item response theory framework, the present study analyzes the psychometric properties of Karwowski’s creative self-efficacy scale. With an ethnically diverse sample of US college students, the results suggested that the six items of the CSE scale were well fitted to a latent unidimensional structure. The scale also had adequate measurement precision or reliability, high levels of item discrimination, and an appropriate range of item difficulty. Gender-based differential (...) class='Hi'>item functioning analyses confirmed that there were no differences in the measurement results of the scale concerning gender. Additionally, openness to experience was found to be positively related to the CSE scale scores, providing some support for the scale’s convergent validity. Collectively, these results confirmed the psychometric soundness of the CSE scale for measuring CSE and also identified avenues for future research. (shrink)

In this volume, a diverse group of world experts in personality assessment showcase a range of different viewpoints on response distortion. Contributors consider what it means to "fake" a personality assessment, why and how people try to obtain particular scores on personality tests, and what types of tests people can successfully manipulate. The authors present and discuss the usefulness of a range of traditional and cutting-edge methods for detecting and controlling the practice of faking. These methods include social desirability (...) scales, warnings, affective neutralization, unidimensional and multidimensional pairwise preferences, decision trees, linguistic analysis, situational measures, and methods based on item response theory. The wide range of viewpoints presented in this book are then summarized, synthesized, and evaluated. The authors make practical recommendations and suggest areas for future research. Anyone who wonders whether people exaggerate or lie outright on personality tests -- or questions what psychologists can and should do about it -- will find in this book stimulating questions and useful answers. (shrink)

Many clinical and psychological constructs are conceptualized to have multivariate higher-order constructs that give rise to multidimensional lower-order traits. Although recent measurement models and computing algorithms can accommodate item response data with a higher-order structure, there are few measurement models and computing techniques that can be employed in the context of complex research synthesis, such as meta-analysis of individual participant data or integrative data analysis. The current study was aimed at modeling complex item responses that can (...) arise when underlying domain-specific, lower-order traits are hierarchically related to multiple higher-order traits for individual participant data from multiple studies. We formulated a multi-group, multivariate higher-order item response theory (HO-IRT) model from a Bayesian perspective and developed a new Markov chain Monte Carlo (MCMC) algorithm to simultaneously estimate the (a) structural parameters of the first- and second-order latent traits across multiple groups and (b) item parameters of the model. Results from a simulation study support the feasibility of the MCMC algorithm. From the analysis of real data, we found that a bivariate HO-IRT model with different correlation/covariance structures for different studies fit the data best, compared to a univariate HO-IRT model or other alternate models with unreasonable assumptions (i.e., the same means and covariances across studies). Although more work is needed to further develop the method and to disseminate it, the multi-group multivariate HO-IRT model holds promise to derive a common metric for individual participant data from multiple studies in research synthesis studies for robust inference and for new discoveries. (shrink)

Educational assessments tests are often constructed using testlets because of the flexibility to test various aspects of the cognitive activities and broad content sampling. However, the violation of the local item independence assumption is inevitable when tests are built using testlet items. In this study, simulations are conducted to evaluate the performance of item response theory models and testlet response theory models for both the dichotomous and polytomous items in the context of equating tests (...) composed of testlets. We also examine the impact of testlet effect, length of testlet items, and sample size on estimating item and person parameters. The results show that more accurate performance of testlet response theory models over item response theory models was consistently observed across the studies, which supports the benefits of using the testlet response theory models in equating for tests composed of testlets. Further, results of the study indicate that when sample size is large, item response theory models performed similarly to testlet response theory models across all studies. (shrink)

With the popularity of computer-based testing, it is easier to collect item response times in psychological and educational assessments. RTs can provide an important source of information for respondents and tests. To make full use of RTs, the researchers have invested substantial effort in developing statistical models of RTs. Most of the proposed models posit a unidimensional latent speed to account for RTs in tests. In psychological and educational tests, many tests are multidimensional, either deliberately or inadvertently. (...) There may be general effects in between-item multidimensional tests. However, currently there exists no RT model that considers the general effects to analyze between-item multidimensional test RT data. Also, there is no joint hierarchical model that integrates RT and response accuracy for evaluating the general effects of between-item multidimensional tests. Therefore, a bi-factor joint hierarchical model using between-item multidimensional test is proposed in this study. The simulation indicated that the Hamiltonian Monte Carlo algorithm works well in parameter recovery. Meanwhile, the information criteria showed that the bi-factor hierarchical model is the best fit model. This means that it is necessary to take into consideration the general effects and the multidimensionality of the RT in between-item multidimensional tests. (shrink)

This article introduces a new hybrid intake procedure developed for posttraumatic stress disorder (PTSD) screening, which combines an automated textual assessment of respondents’ self-narratives and item-based measures that are administered consequently. Text mining technique and item response modeling were used to analyze long constructed response (i.e., self-narratives) and responses to standardized questionnaires (i.e., multiple choices), respectively. The whole procedure is combined in a Bayesian framework where the textual assessment functions as prior information for the estimation of (...) the PTSD latent trait. The purpose of this study is twofold: first, to investigate whether the combination model of textual analysis and item-based scaling could enhance the classification accuracy of PTSD, and second, to examine whether the standard error of estimates could be reduced through the use of the narrative as a sort of routing test. With the sample at hand, the combination model resulted in a reduction in the misclassification rate, as well as a decrease of standard error of latent trait estimation. These findings highlight the benefits of combining textual assessment and item-based measures in a psychiatric screening process. We conclude that the hybrid test design is a promising approach to increase test efficiency and is expected to be applicable in a broader scope of educational and psychological measurement in the future. (shrink)

Item response theory (IRT) is a modern psychometric framework for estimating respondents’ latent traits (e.g., ability, attitude, and personality) based on their responses to a set of questions in psychological tests. The current study adopted an item response tree (IRTree) method, which combines the tree model with IRT models for handling the sequential process of responding to a test item, to score individual moral inclination for the CNI test—a broadly adopted model for examining humans’ (...) moral decision-making with three parameters generated: sensitivity to moral norms, sensitivity to consequences, and inaction preference. Compared to previous models for the CNI test, the resulting EIRTree-CNI Model is able to generate individual scores without increasing the number of items (thus, less subject fatigue or compromised response quality) or employing a post hoc approach that is deemed statistically suboptimal. The model fits the data well, and the subsequent test also supported the concurrent validity and the predictive validity of the model. Limitations are discussed further. (shrink)

The aims of this paper are to: (1) identify the best framework for comprehending multidimensional impact of deep brain stimulation on the self; (2) identify weaknesses of this framework; (3) propose refinements to it; (4) in pursuing (3), show why and how this framework should be extended with additional moral aspects and demonstrate their interrelations; (5) define how moral aspects relate to the framework; (6) show the potential consequences of including moral aspects on evaluating DBS’s impact on patients’ selves. (...) Regarding (1), I argue that the pattern theory of self can be regarded as such a framework. In realizing (2) and (3), I indicate that most relevant issues concerning PTS that require resolutions are ontological issues, including the persistence question, the “specificity problem”, and finding lacking relevant aspects of the self. In realizing (4), I identify aspects of the self not included in PTS which are desperately needed to investigate the full range of potentially relevant DBS-induced changes—authenticity, autonomy, and responsibility, and conclude that how we define authenticity will have implications for our concept of autonomy, which in turn will determine how we think about responsibility. Concerning (5), I discuss a complex relation between moral aspects and PTS—on one hand, they serve as the lens through which a particular self-pattern can be evaluated; on the other, they are, themselves, products of dynamical interactions of various self-aspects. Finally, I discuss (6), demonstrating novel way of understanding the effects of DBS on patients’ selves. (shrink)

In the context of item response theory, linking the scales of two measurement points is a prerequisite to examine a change in competence over time. In educational large-scale assessments, non-identical test forms sharing a number of anchor-items are frequently scaled and linked using two− or three-parametric item response models. However, if item pools are limited and/or sample sizes are small to medium, the sparser Rasch model is a suitable alternative regarding the precision of parameter (...) estimation. As the Rasch model implies stricter assumptions about the response process, a violation of these assumptions may manifest as model misfit in form of item discrimination parameters empirically deviating from their fixed value of one. The present simulation study investigated the performance of four IRT linking methods—fixed parameter calibration, mean/mean linking, weighted mean/mean linking, and concurrent calibration—applied to Rasch-scaled data with a small item pool. Moreover, the number of anchor items required in the absence/presence of moderate model misfit was investigated in small to medium sample sizes. Effects on the link outcome were operationalized as bias, relative bias, and root mean square error of the estimated sample mean and variance of the latent variable. In the light of this limited context, concurrent calibration had substantial convergence issues, while the other methods resulted in an overall satisfying and similar parameter recovery—even in the presence of moderate model misfit. Our findings suggest that in case of model misfit, the share of anchor items should exceed 20% as is currently proposed in the literature. Future studies should further investigate the effects of anchor item composition regarding unbalanced model misfit. (shrink)

The goal of this study was to assess the relationships between computational approaches to analyzing constructed responses made during reading and individual differences in the foundational skills of reading in college readers. We also explored if these relationships were consistent across texts and samples collected at different institutions and texts. The study made use of archival data that involved college participants who produced typed constructed responses under thinking aloud instructions reading history and science texts. They also took assessments of vocabulary (...) knowledge and proficiency in comprehension. The protocols were analyzed to assess two different ways to determine their cohesion. One approach involved assessing how readers established connections with themselves. The other approach involved assessing connections between the constructed responses and the texts that were read. Additionally, the comparisons were made by assessing both lexical and semantic comparisons. The result showed that both approaches for analyzing cohesion and making the comparisons were correlated with vocabulary knowledge and comprehension proficiency. The implications of the results for theory and practice are discussed. (shrink)

The increasing digitalization in the field of psychological and educational testing opens up new opportunities to innovate assessments in many respects (e.g., new item formats, flexible test assembly, efficient data handling). In particular, computerized adaptive testing provides the opportunity to make tests more individualized and more efficient. The newly developed continuous calibration strategy (CCS) from Fink, Born, Spoden, and Frey (2018) makes it possible to construct computerized adaptive tests in application areas where separate calibration studies are not feasible. Due (...) to the goal of reporting on a common metric across test cycles, the equating is crucial for the CCS. The quality of the equating depends on the common items selected and the scale transformation method applied. Given the novelty of the CCS, the aim of the study was to evaluate different equating setups in the CCS and to derive practical recommendations. The impact of different equating setups on the precision of item parameter estimates and on the quality of the equating was examined in a Monte Carlo simulation, based on a fully crossed design with the factors common item difficulty distribution (bimodal, normal, uniform), scale transformation method (mean/mean, mean/sigma, Haebara, Stocking-Lord), and sample size per test cycle (50, 100, 300). The quality of the equating was operationalized by three criteria (proportion of feasible equatings, proportion of drifted items, and error of transformation constants). The precision of the item parameter estimates increased with increasing sample size per test cycle, but no substantial difference was found with respect to the common item difficulty distribution and the scale transformation method. With regard to the feasibility of the equatings, no differences were found for the different scale transformation methods. However, when using the moment methods (mean/mean, mean/sigma), quite extrem levels of error for the transformation constants A and B occurred. Among the characteristic curve method the performance of the Stocking-Lord method was slightly better than for the Haebara method. Thus, while no clear recommendation can be made with regard to the common item difficulty distribution, the characteristic curve methods turned out to be the most favorable scale transformation methods within the CCS. (shrink)

Although construct measurement is critical to explanatory research and intervention efforts, rigorous measure development remains a notable challenge. For example, though the primary theoretical model for understanding health disparities among sexual minority (e.g., lesbian, gay, bisexual) adolescents is minority stress theory, nearly all published studies of this population rely on minority stress measures with poor psychometric properties and development procedures. In response, we developed the Sexual Minority Adolescent Stress Inventory (SMASI) with N = 346 diverse adolescents ages 14–17, (...) using a comprehensive approach to de novo measure development designed to produce a measure with desirable psychometric properties. After exploratory factor analysis on 102 candidate items informed by a modified Delphi process, we applied item response theory techniques to the remaining 72 items. Discrimination and difficulty parameters and item characteristic curves were estimated overall, within each of 12 initially derived factors, and across demographic subgroups. Two items were removed for excessive discrimination and three were removed following reliability analysis. The measure demonstrated configural and scalar invariance for gender and age; a three-item factor was excluded for demonstrating substantial differences by sexual identity and race/ethnicity. The final 64-item measure comprised 11 subscales and demonstrated excellent overall (α = 0.98), subscale (α range 0.75–0.96), and test–retest (scale r > 0.99; subscale r range 0.89–0.99) reliabilities. Subscales represented a mix of proximal and distal stressors, including domains of internalized homonegativity, identity management, intersectionality, and negative expectancies (proximal) and social marginalization, family rejection, homonegative climate, homonegative communication, negative disclosure experiences, religion, and work domains (distal). Thus, the SMASI development process illustrates a method to incorporate information from multiple sources, including item response theory models, to guide item selection in building a psychometrically sound measure. We posit that similar methods can be used to improve construct measurement across all areas of psychological research, particularly in areas where a strong theoretical framework exists but existing measures are limited. (shrink)

Perhaps the most impressive environmental ethic developed to date in any detail is Robin Attfield's biocentric consequentialism. Indeed, on first study, it appears sufficiently impressive that, before presenting any alternative theoretical approach, one would first need to establish why one should not simply embrace Attfield's. After outlining a seemingly decisive flaw in his theory, and then criticizing his response to it, this article adumbrates a very different theoretical basis for an environmental ethic: namely, a value-pluralist one. In so (...) doing, it seeks to give due weight to anthropocentric, zoocentric, biocentric and ecocentric considerations, and argues that the various values involved require trading off. This can be accomplished by employing multidimensional indifference curves. Moreover, after considering a three-dimensional indifference plane superimposed upon a three-dimensional possibility frontier, it becomes apparent that a moral-pluralist environmental ethic is, contrary to widespread assumptions, capable, in principle at least, of providing determinate answers to moral questions. (shrink)

Colonius suggests that, in using standard set theory as the language in which to express our computational-level theory of human memory, we would need to violate the axiom of foundation in order to express meaningful memory bindings in which a context is identical to an item in the list. We circumvent Colonius's objection by allowing that a list item may serve as a label for a context without being identical to that context. This debate serves to (...) highlight the value of specifying memory operations in set theoretic notation, as it would have been difficult if not impossible to formulate such an objection at the algorithmic level. (shrink)

There are a number of key data-centric questions that must be answered when developing classifiers for operator functional states. “Should a supervised or unsupervised learning approach be used? What degree of labeling and transformation must be performed on the data? What are the trade-offs between algorithm flexibility and model interpretability, as generally these features are at odds?” Here, we focus exclusively on the labeling of cognitive load data for supervised learning. We explored three methods of labeling cognitive states for three-state (...) classification. The first method labels states derived from a tertiary split of trial difficulty during a spatial memory task. The second method was more adaptive; it employed a mixed-effects stress–strain curve and estimated an individual’s performance asymptotes with respect to the same spatial memory task. The final method was similar to the second approach; however, it employed a mixed-effects Rasch model to estimate individual capacity limits within the context of item response theory for the spatial memory task. To assess the strength of each of these labeling approaches, we compared the area under the curve (AUC) for receiver operating curves (ROCs) from elastic net and random forest classifiers. We chose these classifiers based on a combination of interpretability, flexibility, and past modeling success. We tested these techniques across two groups of individuals and two tasks to test the effects of different labeling techniques on cross-person and cross-task transfer. Overall, we observed that the Rasch model labeling paired with a random forest classifier led to the best model fits and showed evidence of both cross-person and cross-task transfer. (shrink)

An extension to a rating system for tracking the evolution of parameters over time using continuous variables is introduced. The proposed rating system assumes a distribution for the continuous responses, which is agnostic to the origin of the continuous scores and thus can be used for applications as varied as continuous scores obtained from language testing to scores derived from accuracy and response time from elementary arithmetic learning systems. Large-scale, high-stakes, online, anywhere anytime learning and testing inherently comes with (...) a number of unique problems that require new psychometric solutions. These include (1) the cold start problem, (2) problem of change, and (3) the problem of personalization and adaptation. We outline how our proposed method addresses each of these problems. Three simulations are carried out to demonstrate the utility of the proposed rating system. (shrink)

Introduction: Responsibility and choice -- The idea of moral responsibility -- Complex choice situations -- Differing types of responsibility -- Hans Jonas' idea of "caring for beings" -- The moral experience of women -- Criticizing rational choice -- The rational choice model 5 -- Bounded rationality -- Myopic and deficient choices -- Violations of the axioms -- Rational fools -- The strategic role of emotions -- Social norms -- The communitarian challenge -- Duty, self-interest, and love -- Responsible decision making (...) -- Norms, goals, and stakeholders -- Choice as problem solving -- Ethical norms -- Who are the stakeholders? -- Co-evolving goals and alternatives -- Responsibility and the diversity of choices -- Rationality and respect -- Deontology -- Choices people can make -- The psychology of choice -- Prospect theory -- The "matching law" -- Incommensurability -- Modeling responsible decision making -- What is a responsible decision? -- Deontological payoffs -- Goal-achievement values -- Payoffs for the stakeholders -- Evaluation from multiple perspectives -- The maximin rule -- A geometric representation -- The procedural model -- Real world cases -- Donna's case -- The Ford Pinto case -- The World Bank environmental policy -- Applications in economics and public policy -- Responsibility and social justice -- The paradox of a paretian liberal -- Res ponsible agency in prisoner's dilemma situations -- Multidimensional cost-benefit analysis -- Ethical and social performance of business -- Nature, society, and future generations -- Epilogue: The responsible person. (shrink)

Mixture item response theory models include a mixture of latent subpopulations such that there are qualitative differences between subgroups but within each subpopulation the measure model based on a continuous latent variable holds. Under this modeling framework, students can be characterized by both their location on a continuous latent variable and by their latent class membership according to Students’ responses. It is important to identify anchor items for constructing a common scale between latent classes beforehand under the (...) mixture IRT framework. Then, all model parameters across latent classes can be estimated on the common scale. In the study, we proposed Q-matrix anchored mixture Rasch model, including a Q-matrix and the traditional mixture Rasch model. The Q-matrix in QAMRM can use class invariant items to place all model parameter estimates from different latent classes on a common scale regardless of the ability distribution. A simulation study was conducted, and it was found that the estimated parameters of the QAMRM recovered fairly well. A real dataset from the Certificate of Proficiency in English was analyzed with the QAMRM, LCDM. It was found the QAMRM outperformed the LCDM in terms of model fit indices. (shrink)

Law No. 11,340/2006, also known as the "Maria da Penha" Law, was created after the condemnation to exclusively protect women victims of violence. In Article 9, § 2, item II, there is a specific rule on the employment contract, which allows the judge to ensure that women in situations of domestic and family violence maintain the employment relationship for up to six months. During this period, women have the right to be absent from work, thus contributing to the preservation (...) of their physical and psychological integrity. The objective of this paper is to better analyze how the international system may further contribute to increasing the labor legal protection of women victims of domestic violence. A prospective-documentary technique was employed to analyze the Brazilian domestic legislation and the international system, including norms of the International Labor Organization (ILO) and the jurisprudence of the Inter-American Commission on Human Rights of the Organization of American States (OAS). These analyses reveal that despite the separation of social phenomena – domestic violence occurring in the private sphere, and work belonging to the public sphere of the victim's life – international principles, so-called soft law rules, can be used to further enhance the protection of women victims of domestic violence in Brazil. These women require a whole set of mechanisms that protect their physical, psychological, and emotional integrity, but also guarantee financial and professional support. This multidimensional response to domestic violence is central to a country that ranks 5th in the world for femicide. (shrink)

Design is concerned with the ways in which we deliberately seek to arrange, organize, or structure things. From a philosophy of design perspective, the practice of design raises fundamental questions about the basic ways in which things can and should be organized. I advance a tripartite schema of the basic ways in which things (anything at all) can be organized and offer a triangular model of the “organization space” or “design space” they define. I refer to these three basic forms (...) of organization as “responsive cohesion,” “fixed cohesion,” and “discohesion,” and offer three reasons why responsively cohesive forms of organization are more valuable than the other two; indeed, the other two forms of organization are typically disvaluable. Beyond focusing on the value of individual instances of responsive cohesion, I further consider the fact that every responsively cohesive item exists within a wider context(s), which may itself tend more towards fixed cohesion, responsive cohesion, or discohesion. This raises a number of further issues; for example, what should we do if a responsively cohesive item clashes with – is discohesive with – its responsively cohesive context? I advance a normative theory of contexts to sort out these kinds of issues. In the context of this discussion, I briefly consider a range of other ideas that bear a family resemblance to the idea of responsive cohesion and indicate, equally briefly, why the theory of responsive cohesion approach is superior to these other approaches. I conclude with some guidance on how we can implement the ideas advanced here (“we” because we all design things in our own way) and then, more specifically, on the implications of these ideas for the professional designer-client relationship. (shrink)

This comment is offered in response to Hansen's "A Multidimensional Scale for Measuring Business Ethics: A Purification and Refinement". Five issues arising from Hansen's purification and refinement efforts are addressed. These include the issues of parsimony, predictive validity, collinearity, reliability, and what we see as a confusion between normative and positive theory.

In “Conceptual Differences Between Children and Adults,” Susan Carey discusses phlogiston theory in order to defend the view that there can be non-translatability between scientific languages. I present an objection to her defence.

The meaning that expressions take on particular occasions often depends on the context in ways which seem to transcend its direct effect on context-sensitive parameters. ‘Truth-conditional pragmatics’ is the project of trying to model such semantic flexibility within a compositional truth-conditional framework. Most proposals proceed by radically ‘freeing up’ the compositional operations of language. I argue, however, that the resulting theories are too unconstrained, and predict flexibility in cases where it is not observed. These accounts fall into this position because (...) they rarely, if ever, take advantage of the rich information made available by lexical items. I hold, instead, that lexical items encode both extension and non-extension determining information. Under certain conditions, the non-extension determining information of an expression e can enter into the compositional processes that determine the meaning of more complex expressions which contain e. This paper presents and motivates a set of type-driven compositional operations that can access non-extension determining information and introduce bits of it into the meaning of complex expressions. The resulting multidimensional semantics has the tools to deal with key cases of semantic flexibility in appropriately constrained ways, making it a promising framework to pursue the project of truth-conditional pragmatics. (shrink)

Semantic memory encompasses one's knowledge about the world. Distributional semantic models, which construct vector spaces with embedded words, are a proposed framework for understanding the representational structure of human semantic knowledge. Unlike some classic semantic models, distributional semantic models lack a mechanism for specifying the properties of concepts, which raises questions regarding their utility for a general theory of semantic knowledge. Here, we develop a computational model of a binary semantic classification task, in which participants judged target words for (...) the referent's size or animacy. We created a family of models, evaluating multiple distributional semantic models, and mechanisms for performing the classification. The most successful model constructed two composite representations for each extreme of the decision axis (e.g., one averaging together representations of characteristically big things and another of characteristically small things). Next, the target item was compared to each composite representation, allowing the model to classify more than 1,500 words with human‐range performance and to predict response times. We propose that when making a decision on a binary semantic classification task, humans use task prompts to retrieve instances representative of the extremes on that semantic dimension and compare the probe to those instances. This proposal is consistent with the principles of the instance theory of semantic memory. (shrink)

The concept of business responsibility, usually termed as corporate social responsibility (CSR), originated in the early 1930s after the Wall Street crash of 1929 exposed corporate irresponsibility in large organisations. The understanding of CSR has evolved since then and its scope has now broadened from mere compliance to corporate laws to active alignment of internal business goals with externally set societal aspirations. Unfortunately, the significance of this multidimensional concept within the small and medium enterprise (SME) sector has continued to (...) be overshadowed by its application in large and multinational organisations. More importantly, this has led to the practice of judging SMEs, which are experiencing increasing pressure to engage in social activities, as if they are no different from their larger counterparts. This study therefore investigates CSR from the perspective of SMEs in Australia without any theoretical presumptions and then comments on the relevance and applicability of the two theories that have been commonly used to investigate business responsibility, namely, stakeholder theory (ST) and social capital theory (SCT). The research findings indicate that CSR within the SME sector is more aligned to the fundamentals of SCT, mainly owing to the unique resource and survival challenges that they face, and which are, arguably, not so pronounced in large organisations. (shrink)

The Musical Emotion Discrimination Task (MEDT) is a short, non-adaptive test of the ability to discriminate emotions in music. Test-takers hear two performances of the same melody, both played by the same performer but each trying to communicate a different basic emotion, and are asked to determine which one is “happier”, for example. The goal of the current study was to construct a new version of the MEDT using a larger set of shorter, more diverse music clips and an adaptive (...) framework to expand the ability range for which the test can deliver measurements. The first study analysed responses from a large sample of participants (N = 624) to determine how musical features contributed to item difficulty, which resulted in a quantitative model of musical emotion discrimination ability rooted in Item Response Theory (IRT). This model informed the construction of the adaptive MEDT. A second study contributed preliminary evidence for the validity and reliability of the adaptive MEDT, and demonstrated that the new version of the test is suitable for a wider range of abilities. This paper therefore presents the first adaptive musical emotion discrimination test, a new resource for investigating emotion processing which is freely available for research use. (shrink)

The need for better incorporation of the construct emotional intelligence (EI) into counterproductive work behavior (CWB) research may be achieved via a unified conceptual framework. Accordingly, the purpose of this paper is to use the Profile Analysis via Multidimensional Scaling (PAMS) approach, a conceptual framework that unifies motivational process with antecedents and outcomes, to assess differences in EI concerning a variety of constructs: organizational justice, CWB, emotional exhaustion, job satisfaction, and intrinsic motivation. Employing established scales within a framework unifying (...) CWB, intrinsic motivation, EI, organizational justice, and outcome constructs, two EI-based profiles displayed associations with CWB based on responses from 3,293 employees. Both the first core profile, high overall justice and low emotional intelligence, and the second core profile, high emotional intelligence and low work motivation, displayed associations with interpersonal deviance and organizational deviance, as well as emotional exhaustion and job satisfaction. The results are discussed with respect to possible underlying theory and an overarching unified motivation framework that incorporates goal choice, intrinsic motivation, antecedents, and outcomes. We also provide directions for future research and implications for managers in the workplace based on heuristic conceptual frameworks that combine multiple motivational perspectives into a unified model. (shrink)