The primary goal of the peer review of research grant proposals is to evaluate their quality for the funding agency. An important secondary goal is to provide constructive feedback to applicants for their resubmissions. However, little is known about whether review feedback achieves this goal. In this paper, we present a multi-methods analysis of responses from grant applicants regarding their perceptions of the effectiveness and appropriateness of peer review feedback they received from grant submissions. (...) Overall, 56–60% of applicants determined the feedback to be appropriate, although their judgments were more favorable if their recent application was funded. Importantly, independent of funding success, women found the feedback better written than men, and more white applicants found the feedback to be fair than non-white applicants. Also, perceptions of a variety of biases were specifically reported in respondents’ feedback. Less than 40% of applicants found the feedback to be very useful in informing their research and improving grantsmanship and future submissions. Further, negative perceptions of the appropriateness of review feedback were positively correlated with more negative perceptions of feedback usefulness. Importantly, respondents suggested that highly competitive funding pay-lines and poor inter-panel reliability limited the usefulness of review feedback. Overall, these results suggest that more effort is needed to ensure that appropriate and useful feedback is provided to all applicants, bolstering the equity of the review process and likely improving the quality of resubmitted proposals. (shrink)

Objectives To explore how factors relating to grades and grading affect the correctness of choices that grant-review panels make among submitted proposals. To identify interventions in panel design that may be expected to increase the correctness of choices. -/- Method Experimentation with an empirically-calibrated computer simulation model of panel review. Model parameters are set in accordance with procedures at a national science funding agency. Correctness of choices among research proposals is operationalized as agreement with the choices of (...) an elite panel. -/- Conclusions The simulation model generates several hypotheses to guide further research. Increasing the number of grades used by panel members increases the correctness of simulated choices among submitted proposals. Collective decision procedures giving panels a greater capacity for discriminating among proposals also increase correctness. Surprisingly, differences in grading standards among panel members do not appreciably decrease correctness. (shrink)

As more objections have been raised against grant peer-review for being costly and time-consuming, the legitimate question arises whether machine learning algorithms could help assess the epistemic efficiency of the proposed projects. As a case study, we investigated whether project efficiency in high energy physics can be algorithmically predicted based on the data from the proposal. To analyze the potential of algorithmic prediction in HEP, we conducted a study on data about the structure and outcomes of HEP experiments (...) with the goal of predicting their efficiency. In the first step, we assessed the project efficiency using Data Envelopment Analysis of 67 experiments conducted in the HEP laboratory Fermilab. In the second step, we employed predictive algorithms to detect which team structures maximize the epistemic performance of an expert group. For this purpose, we used the efficiency scores obtained by DEA and applied predictive algorithms – lasso and ridge linear regression, neural network, and gradient boosted trees – on them. The results of the predictive analyses show moderately high accuracy, indicating that they can be beneficial as one of the steps in grant review. Still, their applicability in practice should be approached with caution. Some of the limitations of the algorithmic approach are the unreliability of citation patterns, unobservable variables that influence scientific success, and the potential predictability of the model. (shrink)

Previous research has found that funding disparities are driven by applications’ final impact scores and that only a portion of the black/white funding gap can be explained by bibliometrics and topic choice. Using National Institutes of Health R01 applications for council years 2014–2016, we examine assigned reviewers’ preliminary overall impact and criterion scores to evaluate whether racial disparities in impact scores can be explained by application and applicant characteristics. We hypothesize that differences in commensuration—the process of combining criterion scores into (...) overall impact scores—disadvantage black applicants. Using multilevel models and matching on key variables including career stage, gender, and area of science, we find little evidence for racial disparities emerging in the process of combining preliminary criterion scores into preliminary overall impact scores. Instead, preliminary criterion scores fully account for racial disparities—yet do not explain all of the variability—in preliminary overall impact scores. (shrink)

This is an interview with author Lester Grinspoon, M.D., whose work on psychoactive substances over the last thirty‐five years has been highly influential. His book, Marihuana: The Forbidden Medicine (written with James B. Bakalar), is a classic source on the medical marijuana controversy. His books Psychedelic Drugs Reconsidered and Cocaine: A Drug and Its Social Evolution are standards in the field. Dr. Grinspoon received his M.D. from Harvard Medical School and currently is associate professor emeritus at Harvard Medical School. His (...) academic work has also reached a general audience through publications ranging from the New York Times Book Review to Playboy. Describing him as the "complete medical scholar," his citation for the Lindesmith Award for Achievement in the Field of Scholarship also notes, "Lester Grinspoon represents all those scholars who report the results of their research truthfully, despite the political consequences of this unwelcomed honesty.". (shrink)

BackgroundFunding agencies have long used panel discussion in the peer review of research grant proposals as a way to utilize a set of expertise and perspectives in making funding decisions. Little research has examined the quality of panel discussions and how effectively they are facilitated.MethodsHere, we present a mixed-method analysis of data from a survey of reviewers focused on their perceptions of the quality, effectiveness, and influence of panel discussion from their last peer review experience.ResultsReviewers indicated that (...) panel discussions were viewed favorably in terms of participation, clarifying differing opinions, informing unassigned reviewers, and chair facilitation. However, some reviewers mentioned issues with panel discussions, including an uneven focus, limited participation from unassigned reviewers, and short discussion times. Most reviewers felt the discussions affected the review outcome, helped in choosing the best science, and were generally fair and balanced. However, those who felt the discussion did not affect the outcome were also more likely to evaluate panel communication negatively, and several reviewers mentioned potential sources of bias related to the discussion. While respondents strongly acknowledged the importance of the chair in ensuring appropriate facilitation of the discussion to influence scoring and to limit the influence of potential sources of bias from the discussion on scoring, nearly a third of respondents did not find the chair of their most recent panel to have performed these roles effectively.ConclusionsIt is likely that improving chair training in the management of discussion as well as creating review procedures that are informed by the science of leadership and team communication would improve review processes and proposal review reliability. (shrink)

There has recently been a reappraisal of value in UK construction and calls from a wide range of influential individuals, professional institutions and government bodies for the industry to exceed stakeholders’ expectations and develop integrated teams that can deliver world class products and services. As such value is certainly topical, but the importance of values as a separate but related concept is less well understood. Most construction firms have well-defined and well-articulated values, expressed in annual reports and on websites; however, (...) the lack of rigorous and structured approaches published within construction management research and the practical, unsupported advice on construction institution websites may indicate a shortfall in the approaches used. This article reviews and compares the content and␣structure of some of the most widely used values approaches, and discusses their application within the construction sector. One of the most advanced and empirically tested theories of human values is appraised, and subsequently adopted as a suitable approach to eliciting and defining shared organisational values. Three studies within six construction organisations demonstrate the potential application of this individually grounded approach to reveal and align the relative values priorities of individuals and organisations to understand the strength of their similarity and difference. The results of these case studies show that this new universal values structure can be used along with more qualitative elicitation techniques to understand organisational cultures. (shrink)

Promoting the ethical formation of engineering students through the cultivation of their discipline-specific knowledge, sensitivity, imagination, and reasoning skills has become a goal for many engineering education programs throughout the United States. However, there is neither a consensus throughout the engineering education community regarding which strategies are most effective towards which ends, nor which ends are most important. This study provides an overview of engineering ethics interventions within the U.S. through the systematic analysis of articles that featured ethical interventions in (...) engineering, published in select peer-reviewed journals, and published between 2000 and 2015. As a core criterion, each journal article reviewed must have provided an overview of the course as well as how the authors evaluated course-learning goals. In sum, 26 articles were analyzed with a coding scheme that included 56 binary items. The results indicate that the most common methods for integrating ethics into engineering involved exposing students to codes/standards, utilizing case studies, and discussion activities. Nearly half of the articles had students engage with ethical heuristics or philosophical ethics. Following the presentation of the results, this study describes in detail four articles to highlight less common but intriguing pedagogical methods and evaluation techniques. The findings indicate that there is limited empirical work on ethics education within engineering across the United States. Furthermore, due to the large variation in goals, approaches, and evaluation methods described across interventions, this study does not detail “best” practices for integrating ethics into engineering. The science and engineering education community should continue exploring the relative merits of different approaches to ethics education in engineering. (shrink)

This chapter contains sections titled: Are Videogames Art? A Cluster Theory of Art The Art in Videogames New Art from Old Bottles.

Most public and non-profit organisations that fund health research provide the majority of their funding in the form of grants. The calls for grant applications are often untargeted, such that a wide variety of applications may compete for the same funding. The grant review process therefore plays a critical role in determining how limited research resources are allocated. Despite this, little attention has been paid to whether grant review criteria align with widely endorsed ethical criteria (...) for allocating health research resources. Here, we analyse the criteria and processes that ten of the largest public and non-profit research funders use to choose between competing grant applications. Our data suggest that research funders rarely instruct reviewers to consider disease burden or to prioritise research for sicker or more disadvantaged populations, and typically only include scientists in the review processes. This is liable to undermine efforts to link research funding to health needs. (shrink)

Questioning the usual judgements of political ethics, Ruth W. Grant argues that hypocrisy can actually be constructive while strictly principled behavior can be destructive. _Hypocrisy and Integrity_ offers a new conceptual framework that clarifies the differences between idealism and fanaticism while it uncovers the moral limits of compromise. "Exciting and provocative.... Grant's work is to be highly recommended, offering a fresh reading of Rousseau and Machiavelli as well as presenting a penetrating analysis of hypocrisy and integrity."—Ronald J. Terchek, (...) _American Political Science Review_ "A great refreshment.... With liberalism's best interests at heart, Grant seeks to make available a better understanding of the limits of reason in politics."—Peter Berkowitz, _New Republic_. (shrink)

This study examines the relationship between thought and language by considering the views of Kant and the later Wittgenstein along with many strands of contemporary debate in the area of mental content. Building on an analysis of the nature of concepts and conceptions of objects, Gillett provides an account of psychological explanation and the subject of experience, offers a novel perspective on mental representation and linguistic meaning, looks at the difficult topics of cognitive roles and singular thought, and concludes with (...) an outline of certain considerations relevant to skeptical arguments and the nature of perception. The resulting synthesis demonstrates interesting correlations with current work in cognitive and developmental psychology, and is directly relevant to continuing work in epistemology, philosophy of mind, and philosophical psychology. (shrink)

In Time as History, a collection of his 1969 Massey lectures, George Grant reviews the thought of Nietzsche and concludes that the conception of time as history ...

We propose a new metric for evaluating the informativeness of a set of ratings from a single rater on a given scale. Such evaluations are of interest when raters rate numerous comparable items on the same scale, as occurs in hiring, college admissions, and peer review. Our exposition takes the context of peer review, which involves univariate and multivariate cardinal ratings. We draw on this context to motivate an information-theoretic measure of the refinement of a set of ratings (...) – entropic refinement – as well as two secondary measures. A mathematical analysis of the three measures reveals that only the first, which captures the information content of the ratings, possesses properties appropriate to a refinement metric. Finally, we analyse refinement in real-world grant-review data, finding evidence that overall merit scores are more refined than criterion scores. (shrink)

In the United States today, much interpersonal racism is driven by corrupt forms of self-preservation. Drawing from Jean- Jacques Rousseau, I refer to this as self-love racism. The byproduct of socially-induced racial anxieties and perceived threats to one’s physical or social wellbeing, self-love racism is the protective attachment to the racialized dimensions of one’s social status, wealth, privilege, and/or identity. Examples include police officer related shootings of unarmed Black Americans, anti-immigrant sentiment, and the resurgence of unabashed white supremacy. This form (...) of racism is defined less by the introduction of racism into the world and more on the perpetuation of racially unjust socioeconomic and political structures. My theory, therefore, works at the intersection of the interpersonal and structural by offering an account of moral complacency in racist social structures. My goal is to reorient the directionality of philosophical work on racism by questioning the sense of innocence at the core of white ways-of-being. (shrink)

In this essay I examine a well-known articulation of human nature skepticism, a paper by Hull. I then review a recent reply to Hull by Machery, which argues for an account of human nature that he claims is both useful and scientifically robust. I challenge Machery’s account and introduce an alternative account—the “life-history trait cluster” conception of human nature—that I hold is scientifically sound and makes sense of our intuitions about—and desiderata for—human nature.

Guilt poses a unique evolutionary problem. Unlike other dysphoric emotions, it is not immediately clear what its adaptive significance is. One can imagine thriving despite or even because of a lack of guilt. In this article, we review solutions offered by Scott James, Richard Joyce, and Robert Frank and show that although their solutions have merit, none adequately solves the puzzle. We offer an alternative solution, one that emphasizes the role of empathy and posttransgression behavior in the evolution of (...) guilt. Our solution, we contend, offers a better account of why guilt evolved to play its distinctive social role. (shrink)

Frederick Beiser’s new work provides English readers a comprehensive and masterly explanation of the central forces that shaped the important philosophical movement known as German idealism. German Idealism is well written, exquisitely argued, and copiously researched. It easily outdistances much of the German scholarship and will serve as a benchmark for future English language scholarship. It is a must-read for scholars of the field, a helpful, accessible guide for the interested, and a valuable resource for all historians of philosophy.

Ethical becoming represents a novel framework for teaching engineering ethics. This framework insists on the complementarity of pragmatism, care, and virtue. The dispositional nature of the self is a central concern, as are relational considerations. However, unlike previous conceptual work, this paper introduces additional lenses for exploring ethical relationality by focusing on indebtedness, harmony, potency, and reflective thought. This paper first reviews relevant contributions in the engineering ethics literature. Then, the relational process ontology of Alfred North Whitehead is described and (...) identified as the foundation of the ethical becoming concept. Following this, ethical becoming is imagined as comprising five components: relationality and indebtedness, harmony and potency (i.e., beauty), care, freedom and reflective thought, and ethical inquiry. Each component will be unpacked and knit together to argue that (1) becoming in all its forms is relational and, therefore, whatever becomes is indebted to all to which it relates; (2) one’s ethical engagement must be directed toward the creation of harmony and potency; (3) care practices are necessary to ensure that multiplicity is valued and safeguarded in the meeting of needs; (4) the capacity for reflective thought is necessary to fashion one’s self and others in the direction of harmony, potency, and care; and (5) ethical thought and action must operate through a cycle of ethical inquiry. This paper will close with a brief exploration of how ethical becoming could be utilized in engineering education contexts. (shrink)

To speak of human rights in the twenty-first century is to speak of proportionality. Proportionality has been received into the constitutional doctrine of courts in continental Europe, the United Kingdom, Canada, New Zealand, Israel, South Africa, and the United States, as well as the jurisprudence of treaty-based legal systems such as the European Convention on Human Rights. Proportionality provides a common analytical framework for resolving the great moral and political questions confronting political communities. But behind the singular appeal to proportionality (...) lurks a range of different understandings. This volume brings together many of the world's leading constitutional theorists - proponents and critics of proportionality - to debate the merits of proportionality, the nature of rights, the practice of judicial review, and moral and legal reasoning. Their essays provide important new perspectives on this leading doctrine in human rights law. (shrink)

Recent scientific advances have indicated that it may be technically feasible to sustain human embryos in vitro beyond 14 days. Research beyond this stage is currently restricted by a guideline known as the 14-day rule. Since the advances in embryo culturing there have been calls to extend the current limit. Much of the current debate concerning an extension has regarded the 14-day rule as a political compromise and has, therefore, focused on policy concerns rather than assessing the philosophical foundations of (...) the limit. While there are relevant political considerations, I maintain that the success of extension arguments will ultimately depend on the strength of the justifications supporting the current 14-day limit. I argue that the strongest and most prevalent justifications for the 14-day rule—an appeal to individuation and neural development—do not provide adequate support for the limit of 14 days. I instead suggest that an alternative justification based on sentience would constitute a more defensible basis for embryo protection and that a consideration of such grounds appears to support an amendment to the current limit, rather than the retention of it. While these conclusions do not establish conclusively that the current limit should be extended; they do suggest that an extension may be warranted and permissible. As such, this paper offers grounds on which a reassessment of the 14-day rule may be justified. (shrink)

A critical review essay, this work explains the methodological, material, and ideological reasons for why "diversity" initiatives in philosophy face an up-hill battle.