Robot ethics encompasses ethical questions about how humans should design, deploy, and treat robots; machine morality encompasses questions about what moral capacities a robot should have and how these capacities could be computationally implemented. Publications on both of these topics have doubled twice in the past 10 years but have often remained separate from one another. In an attempt to better integrate the two, I offer a framework for what a morally competent robot would look like and discuss (...) a number of ethical questions about the design, use, and treatment of such moral robots in society. Instead of searching for a fixed set of criteria of a robot’s moral competence I identify the multiple elements that make up human moral competence and probe the possibility of designing robots that have one or more of these human elements, which include: moral vocabulary; a system of norms; moral cognition and affect; moral decision making and action; moral communication. Juxtaposing empirical research, philosophical debates, and computational challenges, this article adopts an optimistic perspective: if robotic design truly commits to building morally competent robots, then those robots could be trustworthy and productive partners, caretakers, educators, and members of the human community. Moral competence does not resolve all ethical concerns over robots in society, but it may be a prerequisite to resolve at least some of them. (shrink)

We propose that the prevalent moral aversion to AWS is supported by a pair of compelling objections. First, we argue that even a sophisticated robot is not the kind of thing that is capable of replicating human moral judgment. This conclusion follows if human moral judgment is not codifiable, i.e., it cannot be captured by a list of rules. Moral judgment requires either the ability to engage in wide reflective equilibrium, the ability to perceive certain facts as moral considerations, moral (...) imagination, or the ability to have moral experiences with a particular phenomenological character. Robots cannot in principle possess these abilities, so robots cannot in principle replicate human moral judgment. If robots cannot in principle replicate human moral judgment then it is morally problematic to deploy AWS with that aim in mind. Second, we then argue that even if it is possible for a sufficiently sophisticated robot to make ‘moral decisions’ that are extensionally indistinguishable from (or better than) human moral decisions, these ‘decisions’ could not be made for the right reasons. This means that the ‘moral decisions’ made by AWS are bound to be morally deficient in at least one respect even if they are extensionally indistinguishable from human ones. Our objections to AWS support the prevalent aversion to the employment of AWS in war. They also enjoy several significant advantages over the most common objections to AWS in the literature. (shrink)

Du fait de sa programmabilité, l’ordinateur est souvent qualifié de machine universelle. Si la machine classique est la représentation d’un programme unique et spécifique, l’ordinateur est un mécanisme qui représente physiquement n’importe quel programme installé comme une procédure d’exploitation parmi d’autres possibles. En raison de cette versatilité et de cette flexibilité..

This thesis shows morality to be broader and more diverse than its human instantiation. It uses the idea of machine morality to argue for this position. Specifically, it contrasts the possibilities open to humans with those open to machines to meaningfully engage with the moral domain. -/- This contrast identifies distinctive characteristics of human morality, which are not fundamental to morality itself, but constrain our thinking about morality and its possibilities. It also highlights the (...) inherent potential of machine morality to be radically different from its human counterpart and the implications this has for the moral significance of machines. -/- My argument is particularly focussed on moral theory, which is the study of the observable and hypothetical conceptual structures of morality. By identifying structures that are recognisably moral in nature but which sit outside the boundaries of human realisation, we have tangible proof that a meaningful distinction exists between human morality and the wider moral domain. -/- This is achieved by showing that certain essentially human limits restrict the conceptual possibilities open to human realisation. The tight coupling between these limits and the existing conceptual structures of human morality also explains why it is unjustifiable to assume that the same structures would be suitable for machines. They do not share these same limits with us, which leads me to conclude that many conceptual structures are quite distinctive to human morality and that the structures of machine morality would be significantly different. Four examples illustrate these conclusions concretely. -/- The first, supererogation, is an example of a moral concept that doesn't easily extend to machines. Human limits dictate what it is reasonable to expect from one another and restrict our ability to pursue aspirational moral goals. I show that machine supererogation, if it is at all possible, would require a very different justificatory basis to be coherent. -/- The second, agency, is an example of a concept whose structures extend beyond the bounds of human realisation. The greater flexibility of artificial identity allows machines to experiment with novel forms of inter- and intra-agency. In comparison, human agency structures are limited by their tight coupling with human conceptions of identity. -/- The third, moral aspiration, is a concept with a distinctive function in human morality. Certain aspirational ends are peculiar in that they are obviously unrealisable and even undesirable, yet their pursuit is instrumentally justifiable. This justification depends on cognitive limits that aren't shared by machines, which leads me to conclude that the role of moral aspiration in machine morality, if there is any, would necessarily differ from its human counterpart. -/- The fourth, moral responsibility, is an example of a concept whose existing practices don't translate over to machines. We don't understand machine agency well enough to be able to judge a machine's culpability or effectively blame it. Consequently, I suggest that a responsibility conception prioritising understanding over blame is a more promising avenue for a shared conception suitable for both humans and machines. -/- This thesis does not speculate about the existence of moral machines. This remains an open question, and one that is largely irrelevant for my conclusions as the idea alone is enough to advance our thinking. It does this by helping us identify the boundaries of human morality, and then, to think beyond them by recognising the possibilities of machine morality. (shrink)

In this paper we address the problem of short-term electric energy prediction using a time series forecasting approach applied to data generated by a Paraguayan electricity distribution provider. The dataset used in this work contains data collected over a three-year period. This is the first time that these data have been used; therefore, a preprocessing phase of the data was also performed. In particular, we propose a comparative study of various machine learning and statistical strategies with the objective of (...) predicting the electric energy consumption for a given prediction horizon, in our case seven days, using historical data. In this paper we have tested the effectiveness of the techniques with different historical window sizes. Specifically, we considered two ensemble strategies, a neural network, a deep learning technique and linear regression. Moreover, in this study, we tested whether the inclusion of meteorological data can help achieve better predictions. In particular, we considered data regarding temperature, humidity, wind speed and atmospheric pressure registered during the three-year period of data collection. The results show that, in general, the deep learning approach obtains the best results and that such results are obtained when meteorological data are also considered. Moreover, when meteorological data is used, a smaller historical window size is required to obtain precise predictions. (shrink)

The creation of artificial moral systems requires us to make difficult choices about which of varying human value sets should be instantiated. The industry-standard approach is to seek and encode moral consensus. Here we argue, based on evidence from empirical psychology, that encoding current moral consensus risks reinforcing current norms, and thus inhibiting moral progress. However, so do efforts to encode progressive norms. Machine ethics is thus caught between a rock and a hard place. The problem is particularly acute (...) when progress beyond prevailing moral norms is particularly urgent, as is currently the case due to the inadequacy of prevailing moral norms in the face of the climate and ecological crisis. (shrink)

The ability of very wealthy individuals (or, as I will call them, the ‘super-rich’) to turn their economic power into political power has been—and remains—an important cause of political inequality. In response, this paper advocates an original solution. Rather than solving the problem through implementing a comprehensive conception of political equality, or through enforcing complex rules about financial disclosure etc., I argue that we should impose a choice on the super-rich. The super-rich must choose between (i) forfeiting the things that (...) make them super-rich, i.e., pay a 100 % tax on their wealth above a certain level, or, (ii) they must forfeit some of their political rights. These rights include entitlements to fund political parties; to stand for office; and to work or volunteer for political parties. The right to vote, though, is not limited. I defend my proposal against non-consequentialist and consequentialist objections. I also argue that it avoids two problems that many attempts to reduce political inequality face; these are the political egalitarian’s dilemma and the problem of political equality’s relative moral importance. (shrink)

Moral distress is an experience of profound moral compromise with deeply impactful and potentially long‐term consequences to the individual. Critical care areas are fraught with ethical issues, and end‐of‐life care has been associated with numerous incidences of moral distress among nurses. One such area where the dichotomy of life and death seems to be at its sharpest is in the pediatric intensive care unit. The purpose of this study was to understand the moral distress experiences of pediatric intensive care nurses (...) when caring for pediatric patients at the end of life. A secondary analysis was undertaken of seven transcripts from registered nurses across six Canadian pediatric intensive care units and produced three themes: under prioritization of child patient dignity, burden of insider knowledge, and environmental constraints on nursing roles and responsibilities. When caring for patients at the end of life, nurses experienced moral distress when a dignified death was not realized. Furthermore, despite interprofessional collaboration efforts in Canada, the concept of silo mentality persists and contributes to moral distress. Organizational involvement is needed to address moral distress in pediatric intensive care nurses both to achieve a dignified death for child patients and in addressing silo mentality. (shrink)

There has been criticism of how Fair-Trade products represent workers in remote parts of the world where packaging offers an encounter with distant others which romanticizes and homogenizes them as a pre-modern form of ethnicity. Such workers are shown as always engaged in authentic, simple, honest decontextualized manual labor. And they are depicted as highly appreciative of, and empowered by, the act of ethical shopping. This paper shows that a close social semiotic analysis of Fair-Trade packaging reveals a different set (...) of meanings which sit alongside the decontextualized ones. Designs integrate these workers into more contemporary kinds of modernist, rational, design chic, which communicates its own kind of honesty and authenticity. We consider how this, too, shapes how such consumers encounter distant others and its consequence for the meaning of the act of ethical shopping, where consumers can buy into moral alignment offered by products. (shrink)

The implementation of moral decision making abilities in artificial intelligence (AI) is a natural and necessary extension to the social mechanisms of autonomous software agents and robots. Engineers exploring design strategies for systems sensitive to moral considerations in their choices and actions will need to determine what role ethical theory should play in defining control architectures for such systems. The architectures for morally intelligent agents fall within two broad approaches: the top-down imposition of ethical theories, and the bottom-up building of (...) systems that aim at goals or standards which may or may not be specified in explicitly theoretical terms. In this paper we wish to provide some direction for continued research by outlining the value and limitations inherent in each of these approaches. (shrink)

The United Nations ‘Transforming our world: the 2030 Agenda for Sustainable Development’ lays out 17 Sustainable Development Goals to address a range of global issues related to the future of the planet and human well-being. Critics, however, argue that the Agenda, a complex product of multi-stakeholder governance, in its drive to accommodate many competing voices, is overloaded with weakly defined, overlapping and contradictory issues, concepts and buzzwords. These serve to gloss over actual concrete global problems and forces, concealing an underlying (...) free-trade ideology. In this paper, using Multimodal Critical Discourse Analysis, we draw attention to the nature of the documents used to communicate the Agenda. These documents comprise an edifice of self-referential texts that rely heavily on infographics, bullet points, charts and tables. Such formats appear to helpfully simplify, distil information and break things down into workable components. But, we show, through the affordances of these formats, the the vagueness of buzzwords, contradictions and lack of clear causalities can be glossed over, presenting the Agenda as a highly technical, engaging, and above all moral process. These formats are important, therefore, for the legitimization and rhetorical power of the Agenda, necessary for its take-up by governments and organizations around the world. (shrink)

One of the enduring concerns of moral philosophy is deciding who or what is deserving of ethical consideration. This special issue of Philosophy and Technology investigates whether and to what extent machines, of various designs and configurations, can or should be considered moral subjects, defined here as either a moral agent, a moral patient, or both. The articles that comprise the issue were competitively selected from papers initially prepared for and presented at a symposium on this subject matter convened during (...) the AISB/IACAP 2012 World Congress, held in at the University of Birmingham in Birmingham, UK. (shrink)

Computers are already approving financial transactions, controlling electrical supplies, and driving trains. Soon, service robots will be taking care of the elderly in their homes, and military robots will have their own targeting and firing protocols. Colin Allen and Wendell Wallach argue that as robots take on more and more responsibility, they must be programmed with moral decision-making abilities, for our own safety. Taking a fast paced tour through the latest thinking about philosophical ethics and artificial intelligence, the authors argue (...) that even if full moral agency for machines is a long way off, it is already necessary to start building a kind of functional morality, in which artificial moral agents have some basic ethical sensitivity. But the standard ethical theories don't seem adequate, and more socially engaged and engaging robots will be needed. As the authors show, the quest to build machines that are capable of telling right from wrong has begun. -/- Moral Machines is the first book to examine the challenge of building artificial moral agents, probing deeply into the nature of human decision making and ethics. (shrink)

The aim of this thesis is to advance a philosophically justifiable account of Artificial Moral Agency (AMA). Concerns about the moral status of Artificial Intelligence (AI) traditionally turn on questions of whether these systems are deserving of moral concern (i.e. if they are moral patients) or whether they can be sources of moral action (i.e. if they are moral agents). On the Organic View of Ethical Status, being a moral patient is a necessary condition for an entity to qualify as (...) a moral agent. This view claims that because artificial agents (AAs) lack sentience, they cannot be proper subjects of moral concern and hence cannot be considered to be moral agents. I raise conceptual and epistemic issues with regards to the sense of sentience employed on this view, and I argue that the Organic View does not succeed in showing that machines cannot be moral patients. Nevertheless, irrespective of this failure, I also argue that the entire project is misdirected in that moral patiency need not be a necessary condition for moral agency. Moreover, I claim that whereas machines may conceivably be moral patients in the future, there is a strong case to be made that they are (or will very soon be) moral agents. Whereas it is often argued that machines cannot be agents simpliciter, let alone moral agents, I claim that this argument is predicated on a conception of agency that makes unwarranted metaphysical assumptions even in the case of human agents. Once I have established the shortcomings of this “standard account”, I move to elaborate on other, more plausible, conceptions of agency, on which some machines clearly qualify as agents. Nevertheless, the argument is still often made that while some machines may be agents, they cannot be moral agents, given their ostensible lack of the requisite phenomenal states. Against this thesis, I argue that the requirement of internal states for moral agency is philosophically unsound, as it runs up against the problem of other minds. In place of such intentional accounts of moral agency, I provide a functionalist alternative, which makes conceptual room for the existence of AMAs. The implications of this thesis are that at some point in the future we may be faced with situations for which no human being is morally responsible, but a machine may be. Moreover, this responsibility holds, I claim, independently of whether the agent in question is “punishable” or not. (shrink)

A key distinction in ethics is between members and nonmembers of the moral community. Over time, our notion of this community has expanded as we have moved from a rationality criterion to a sentience criterion for membership. I argue that a sentience criterion is insufficient to accommodate all members of the moral community; the true underlying criterion can be understood in terms of whether a being has interests. This may be extended to conscious, self-aware machines, as well as to any (...) autonomous intelligent machines. Such machines exhibit an ability to formulate desires for the course of their own existence; this gives them basic moral standing. While not all machines display autonomy, those which do must be treated as moral patients; to ignore their claims to moral recognition is to repeat past errors. I thus urge moral generosity with respect to the ethical claims of intelligent machines. (shrink)

Experience machines, popularized in print by Robert Nozick and on the screen by the Wachowskis’ film The Matrix, provide highly or perfectly realistic experiences that are more pleasant and less painful than those generated in real life.1 The recent surge in virtual reality and neuro-prosthetic technologies is making the creation of real-world experience machines seem inevitable and perhaps imminent.2 Given the likelihood of the near-future availability of such machines, it behooves ethicists to consider the moral status of their potential uses. (...) In this chapter, we investigate the use of experience machines in palliative and end-of-life care situations. We pair up various kinds of experience machines with patients in a range of conditions, to illuminate the moral problems and benefits of using experience machines in this way. We argue that the use of Nozickian experience machines to treat patients in most conditions would be morally problematic, most notably for the negative effects on patients’ characters and real-world relationships. Informed by this initial moral analysis, we describe an experience machine that is more closely related to a virtual reality game, and argue that it can avoid the moral problems encountered by Nozickian experience machines. In fact, we argue that this new kind of experience machine could improve some patients’ characters and relationships with real-world people. We conclude that some kinds of experience machines could benefit many patients, especially those in extreme pain and those not in the position to meaningfully interact with their loved ones in reality. We also note that certain kinds of experience machines could be useful for religious people, for whom the range of palliative and end-of-life care options is often thought to be relatively narrow. (shrink)

Synthetic biology, as a research field, brings together molecular life scientists, computational biologists, and social scientists to engineer biological systems toward societally desired goals. Given the field’s broad multidisciplinarity and relatively young age, innovative educational methods are required to provide students with the needed background knowledge to push the field forward in the future. The international Genetically Engineered Machine competition is such an example where education and high-level research merge, providing the synthetic biology field with trained students, new ideas, (...) and novel results. In the 2021 edition alone, 343 teams from across the world completed the competition to tackle societal problems with synthetic biology. As Wageningen University & Research celebrates 10 years of participation in iGEM, we share our thoughts and experiences on supervising iGEM teams, which is especially relevant to organizers of current and new teams, and also others interested in the iGEM competition. (shrink)

Our ability to locate moral responsibility is often thought to be a necessary condition for conducting morally permissible medical practice, engaging in a just war, and other high-stakes endeavors. Yet, with increasing reliance upon artificially intelligent systems, we may be facing a wideningresponsibility gap, which, some argue, cannot be bridged by traditional concepts of responsibility. How then, if at all, can we make use of crucial emerging technologies? According to Colin Allen and Wendell Wallach, the advent of so-called ‘artificial moral (...) agents’ (AMAs) is inevitable. Still, this notion may seem to push back the problem, leaving those who have an interest in developing autonomous technology with a dilemma. We may need to scale-back our efforts at deploying AMAs (or at least maintain human oversight); otherwise, we must rapidly and drastically update our moral and legal norms in a way that ensures responsibility for potentially avoidable harms. This paper invokes contemporary accounts of responsibility in order to show how artificially intelligent systems might be held responsible. Although many theorists are concerned enough to develop artificial conceptions ofagencyor to exploit our present inability to regulate valuable innovations, the proposal here highlights the importance of—and outlines a plausible foundation for—a workable notion ofartificial moral responsibility. (shrink)

Environmental philosophers are often concerned to show that non-sentient things, such as plants or ecosystems, have interests and therefore are appropriate objects of moral concern. They deny that mentality is a necessary condition for having interests. Yet they also deny that they are committed to recognizing interests in things like machines. I argue that either machines have interests (and hence moral standing) too or mentality is a necessary condition for inclusion within the purview of morality. I go on to (...) argue that the aspect of mentality necessary for having interests is more complicated than mere sentience. (shrink)

With the expansion of artificial intelligence and advanced technologies, theworld in the 21st century is rapidly changing and imposing new living dynamics. Althoughsuch changes affect all age groups, younger generations accept them faster andreact more positively. The new cohorts - Generation Z and Alpha - live in a digital worldthat affect their lifestyle, interpersonal relations, quality of mental health, psychologicalwell-being and everyday challenges. The presence of the so called “Frankenstein effect”in some adults provoked by the fast development of artificial intelligence (...) and robotics,reflects a “humans versus machines” position, viewing artificial intelligence as athreat to humanity. However, the reality is that digital and human world are not inconflict, since many people are already using artificial intelligence tools on daily basis.It is implemented in certain aspects of medicine, education, business, law, agriculture,industry, space technology and in many other fields. With this in mind, the aspect ofmorality pops up as a very important one. A frequently asked question is: Does artificialintelligence have the capacity to make moral decisions independently? Therefore, integratingmorality into AI algorithms is one of the priorities that interdisciplinary teamsfrom engineering and computer sciences, psychology, philosophy, sociology, law, etc.are intensively working on. This paper addresses this issue by presenting findings fromrelevant research which discusses the challenges and possibilities for integrating thedimensions of morality and introducing human values into autonomous systems thatperform complex tasks. (shrink)

As robots and Artificial Intelligences become more enmeshed in rich social contexts, it seems inevitable that we will have to make them into moral machines equipped with moral skills. Apart from the technical difficulties of how we could achieve this goal, we can also ask the ethical question of whether we should seek to create such Artificial Moral Agents (AMAs). Recently, several papers have argued that we have strong reasons not to develop AMAs. In response, we develop a comprehensive analysis (...) of the relevant arguments for and against creating AMAs, and we argue that all things considered we have strong reasons to continue to responsibly develop AMAs. The key contributions of this paper are threefold. First, to provide the first comprehensive response to the important arguments made against AMAs by Wynsberghe and Robbins (in “Critiquing the Reasons for Making Artificial Moral Agents”, Science and Engineering Ethics 25, 2019) and to introduce several novel lines of argument in the process. Second, to collate and thematise for the first time the key arguments for and against AMAs in a single paper. Third, to recast the debate away from blanket arguments for or against AMAs in general, to a more nuanced discussion about the use of what sort of AMAs, in what sort of contexts, and for what sort of purposes is morally appropriate. (shrink)

Technology is our conduit of power. In our modern world, technology is the gatekeeper deciding who shall have and who shall have not. Either technology works for you or you work for technology. It shapes the human race just as much as we shape it. But where is this symbiosis going? Who provides the directions, the intentions, the goals of this human-machine partnership? Such decisions do not derive from the creators of technology who are enmeshed in their individual innovations. (...) They neither come from our social leaders who possess only sufficient technical understanding to react to innovations, not to anticipate or direct their progress. Neither is there evidence of some omnipotent 'invisible hand,' the simple fact is that no one is directing this enterprise. In Mind, Machine and Morality, Peter Hancock asks questions about this insensate progress and has the temerity to suggest some cognate answers. He argues for the unbreakable symbiosis of purpose and process, and examines the dangerous possibilities that emerge when science and purpose meet. Historically, this work is a modern-day child of Bacon's hope for the 'Great Instauration.' However, unlike its forebear, the focus here is on human-machine systems. The emphasis centers on the conception that the active, extensive face of modern philosophy is technology. Whatever we are to become is bound up not only in our biology but critically in our technology also. And to achieve rational progress we need to articulate manifest purpose. This book is one step along the purposive road. (shrink)

Should we give moral standing to machines? In this paper, I explore the implications of a relational approach to moral standing for thinking about machines, in particular autonomous, intelligent robots. I show how my version of this approach, which focuses on moral relations and on the conditions of possibility of moral status ascription, provides a way to take critical distance from what I call the “standard” approach to thinking about moral status and moral standing, which is based on properties. It (...) does not only overcome epistemological problems with the standard approach, but can also explain how we think about, experience, and act towards machines—including the gap that sometimes occurs between reasoning and experience. I also articulate the non-Cartesian orientation of my “relational” research program and specify the way it contributes to a different paradigm in thinking about moral standing and moral knowledge. (shrink)

Leibniz dit souvent que toutes les substances individuelles et seulement les substances individuelles peuvent être agents moraux authentiques. Mais, dans un passage fascinant des "Nouveaux essais", Leibniz semble concéder à John Locke que si les machines pensantes existaient, elles pourraient être des agents moraux authentiques. Ce serait une concession très significative considérant le fait que pour Leibniz les machines ne sont pas du tout des substances authentiques, mais de simple agrégats de matière. En général, les érudits ont interprété ce passage (...) comme un moyen pour Leibniz d'affirmer que l'identité métaphysique à long terme n'est pas une condition nécessaire pour l'identité morale à long terme. Mais, dans cette étude, je vais soutenir que Leibniz ne concède réellement pas à Locke que les machines pensantes pourraient être des agents moraux. (shrink)

In a passage in A Theory of Justice, which has become increasingly influential in recent years, John Rawls (1971) noted an analogy between moral phi- losophy and grammar. Moral philosophy, or at least the first stage of moral philosophy, Rawls maintained, can be thought of as the attempt to describe our moral capacity – the capacity which underlies “the poten- tially infinite number and variety of [moral] judgments we are prepared..

In his famous 1950 paper where he presents what became the benchmark for success in artificial intelligence, Turing notes that "at the end of the century the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted" (Turing 1950, 442). Kurzweil (1990) suggests that Turing's prediction was correct, even if no machine has yet to pass the Turing Test. In the wake of (...) the computer revolution, research in artificial intelligence and cognitive science has pushed in the direction of interpreting "thinking" as some sort of computational process. On this understanding, thinking is something computers (in principle) and humans (in practice) can both do. It is difficult to say precisely when in history the meaning of the term "thinking" headed in this direction. Signs are already present in the mechanistic and mathematical tendencies of the early Modern period, and maybe even glimmers are apparent in the ancient Greeks themselves. But over the long haul, we somehow now consider "thinking" as separate from the categories of "thoughtfulness" (in the general sense of wondering about things), "insight" and "wisdom." Intelligent machines are all around us, and the world is populated with smart cars, smart phones and even smart (robotic) appliances. But, though my cell phone might be smart, I do not take that to mean that it is thoughtful, insightful or wise. So, what has become of these latter categories? They seem to be bygones left behind by scientific and computational conceptions of thinking and knowledge that no longer have much use for them. In 2000, Allen, Varner and Zinser addressed the possibility of a Moral Turing Test (MTT) to judge the success of an automated moral agent (AMA), a theme that is repeated in Wallach and Allen (2009).. (shrink)

The advance of mechanism in science and philosophy in the 17th century created a great interest to machines or automata. Leibniz was no exception - in an early memoir Drôle de pensée he wrote admiringly about a machine that could walk on water, exhibited in Paris. The idea of automatic processing in general had a large role in his thought, as can be seen, for example, in his invention of the binary code and the so-called Calculemus!-model for solving controversies. (...) In metaphysics, the idea of an automata was expressed most clearly in the 1695 article New System of the Nature of Substances and their Communication, and the ensuing correspondence with, among others, Foucher, Bayle, Lamy, Jaquelot and Masham. In the article Leibniz discusses the soul as a spiritual machine in the context of pre-established harmony, arguing that God can "give to a substance at the outset a nature or internal force which could produce in it an orderly way (as in spiritual or formal automaton; but a free one, in the case of a substance which is endowed with a share of reason) everything that is going to happen to it, that is to say, all the appearances or expressions it is going to have, and all without the help of any created thing." The basic idea of Leibniz's spiritual machine is that the soul or entelechy is an autonomous and spontaneous unity, consisting of internal active force and producing its own perceptions (both confused and distinct). It is a self-moving machine, driven by its perceptions and appetites, but it follows (without being conscious of it) a lawful series or programme created by God. The entelechy remains the same despite undergoing an infinite number of changes. To Foucher he explained that each state of the individual substance is a consequence of its preceding one, "as if there were only God and the substance in the world". Despite this, the spiritual machine is related not only to God, but through the pre-established harmony to bodies or natural machines. However, as it is not dependent on them, the spiritual machine is superiot to natural machines. In this paper I concentrate on three moral themes related to the spiritual machine: moral deliberation, moral identity and the goal of moral action. All these themes are more or less implicit in the New System, but are discussed in more detail in the ensuing correspondence after the publication of the article. Finally, the themes are given an extended discussion especially in the second book of New Essays on Human Understanding (1704, published 1765), written partly at the same time as some of the correspondence and unpublished related material. I will first give an overview of Leibniz's position concerning the spiritual machine or automaton in the New System and then go on to explore the three moral themes one by one, as they feature in the subsequent correspondence and in the New Essays. I will show that the three topics are essential to the function of the spiritual machine – to Sophie Charlotte Leibniz wrote: "...let us say that everything in bodies happens mechanically, or in accordance with laws of motion, and that everything in the soul happens morally, or in accordance with perceived good or evil." There are many texts that anticipate the views in the New System (notably the unpublished memoir De Affectibus of 1679) and Leibniz continued to discuss its themes later on (in addition to correpondence, for example, in Theodicy of 1710 and Monadology and Principles of Nature and Grace of 1714). Here I focus on the short-term development of Leibniz's views on the topic (around 1695-1705), but I argue that his basic view of the spiritual machine did not change much after finishing the dialogue with Locke in 1704. (shrink)

In order to determine whether current (or future) machines have a welfare that we as agents ought to take into account in our moral deliberations, we must determine which capacities give rise to interests and whether current machines have those capacities. After developing an account of moral patiency, I argue that current machines should be treated as mere machines. That is, current machines should be treated as if they lack those capacities that would give rise to psychological interests. Therefore, they (...) are moral patients only if they have non-psychological interests. I then provide an account of what I call teleo interests that constitute the most plausible type of non-psychological interest that a being might have. I then argue that even if current machines have teleo interests, they are such that agents need not concern themselves with these interests. Therefore, for all intents and purposes, current machines are not moral patients. (shrink)

The fact that real-world decisions made by artificial intelligences (AI) are often ethically loaded has led a number of authorities to advocate the development of “moral machines”. I argue that the project of building “ethics” “into” machines presupposes a flawed understanding of the nature of ethics. Drawing on the work of the Australian philosopher, Raimond Gaita, I argue that ethical dilemmas are problems for particular people and not (just) problems for everyone who faces a similar situation. Moreover, the force of (...) an ethical claim depends in part on the life history of the person who is making it. For both these reasons, machines could at best be engineered to provide a shallow simulacrum of ethics, which would have limited utility in confronting the ethical and policy dilemmas associated with AI. (shrink)

In light of recent breakneck pace in machine learning, questions about whether near-future artificial systems might be conscious and possess moral status are increasingly pressing. This paper argues that as matters stand these debates lack any clear criteria for resolution via the science of consciousness. Instead, insofar as they are settled at all, it is likely to be via shifts in public attitudes brought about by the increasingly close relationships between humans and AI users. Section 1 of the paper (...) I briefly lays out the current state of the science of consciousness and its limitations insofar as these pertain to machine consciousness, and claims that there are no obvious consensus frameworks to inform public opinion on AI consciousness. Section 2 examines the rise of conversational chatbots or Social AI, and argues that in many cases, these elicit strong and sincere attributions of consciousness, mentality, and moral status from users, a trend likely to become more widespread. Section 3 presents an inconsistent triad for theories that attempt to link consciousness, behaviour, and moral status, noting that the trends in Social AI systems will likely make the inconsistency of these three premises more pressing. Finally, Section 4 presents some limited suggestions for how consciousness and AI research communities should respond to the gap between expert opinion and folk judgment. (shrink)

Virtual reality is a useful tool to study consumer behavior while they are immersed in a realistic scenario. Among several other factors, personality traits have been shown to have a substantial influence on purchasing behavior. The primary objective of this study was to classify consumers based on the Big Five personality domains using their behavior while performing different tasks in a virtual shop. The personality recognition was ascertained using behavioral measures received from VR hardware, including eye-tracking, navigation, posture and interaction. (...) Responses from 60 participants were collected while performing free and directed search tasks in a virtual hypermarket. A set of behavioral features was processed, and the personality domains were recognized using a statistical supervised machine learning classifier algorithm via a support vector machine. The results suggest that the open-mindedness personality type can be classified using eye gaze patterns, while extraversion is related to posture and interactions. However, a combination of signals must be exhibited to detect conscientiousness and negative emotionality. The combination of all measures and tasks provides better classification accuracy for all personality domains. The study indicates that a consumer’s personality can be recognized using the behavioral sensors included in commercial VR devices during a purchase in a virtual retail store. (shrink)

This paper explores the ambiguous impact of new information and communications technologies on the cultivation of moral skills in human beings. Just as twentieth century advances in machine automation resulted in the economic devaluation of practical knowledge and skillsets historically cultivated by machinists, artisans, and other highly trained workers , while also driving the cultivation of new skills in a variety of engineering and white collar occupations, ICTs are also recognized as potential causes of a complex pattern of economic (...) deskilling, reskilling, and upskilling. In this paper, I adapt the conceptual apparatus of sociological debates over economic deskilling to illuminate a different potential for technological deskilling/upskilling, namely the ability of ICTs to contribute to the moral deskilling of human users, a potential that exists alongside rich but currently underrealized possibilities for moral reskilling and/or upskilling. I flesh out this general hypothesis by means of examples involving automated weapons technology, new media practices, and social robotics. I conclude that since moral skills are essential prerequisites for the effective development of practical wisdom and virtuous character, and since market and cultural forces are not presently aligned to bring about the more salutary of the ambiguous potentials presented here, the future shape of these developments warrants our close attention—and perhaps active intervention. (shrink)

Lake et al. propose three criteria which, they argue, will bring artificial intelligence (AI) systems closer to human cognitive abilities. In this paper, we explore the application of these criteria to a particular domain of human cognition: our capacity for moral reasoning. In doing so, we explore a set of considerations relevant to the development of AI moral decision-making. Our main focus is on the relation between dual-process accounts of moral reasoning and model-free/model-based forms of machine learning. We also (...) discuss how work in embodied and situated cognition could provide a valu- able perspective on future research. (shrink)

According to the most popular theories of intentionality, a family of theories we will refer to as “functional intentionality,” a machine can have genuine intentional states so long as it has functionally characterizable mental states that are causally hooked up to the world in the right way. This paper considers a detailed description of a robot that seems to meet the conditions of functional intentionality, but which falls victim to what I call “the composition problem.” One obvious way to (...) escape the problem (arguably, the only way) is if the robot can be shown to be a moral patient – to deserve a particular moral status. If so, it isn’t clear how functional intentionality could remain plausible (something like “phenomenal intentionality” would be required). Finally, while it would have seemed that a reasonable strategy for establishing the moral status of intelligent machines would be to demonstrate that the machine possessed genuine intentionality, the composition argument suggests that the order of precedence is reversed: The machine must first be shown to possess a particular moral status before it is a candidate for having genuine intentionality. (shrink)

In this paper I provide an exposition and critique of Johnson and Noorman’s (2014) three conceptualizations of the agential roles artificial systems can play. I argue that two of these conceptions are unproblematic: that of causally efficacious agency and “acting for” or surrogate agency. Their third conception, that of “autonomous agency,” however, is one I have reservations about. The authors point out that there are two ways in which the term “autonomy” can be used: there is, firstly, the engineering sense (...) of the term, which simply refers to the ability of some system to act independently of substantive human control. Secondly, there is the moral sense of the term, which has traditionally grounded many notions of human mor-al responsibility. I argue that the continued usage of “autonomy” in discussions of artificial agency complicates matters unnecessarily. This occurs in two ways: firstly, the condition of autonomy, even in its engineering sense, fails to accurately describe the way “autonomous” systems are developed in practice. Secondly, the continued usage of autonomy in the moral sense introduces unnecessary meta-physical baggage form the free will debate into discussions about moral agency. In order to understand the debate surrounding autonomy, we would therefore first need to settle many seemingly intractable metaphysical questions regarding the existence of free will in human beings. (shrink)

One important discussion raised in this special issue on the ethical spectrum of consciousness involves the possibility of providing machines with human mind-like capabilities to the point of allow...

Just as humans can draw conclusions responsibly or irresponsibly, so too can computers. Machine learning systems that have been trained on data sets that include irresponsible judgments are likely to yield irresponsible predictions as outputs. In this paper I focus on a particular kind of inference a computer system might make: identification of the intentions with which a person acted on the basis of photographic evidence. Such inferences are liable to be morally objectionable, because of a way in which (...) they are presumptuous. After elaborating this moral concern, I explore the possibility that carefully procuring the training data for image recognition systems could ensure that the systems avoid the problem. The lesson of this paper extends beyond just the particular case of image recognition systems and the challenge of responsibly identifying a person’s intentions. Reflection on this particular case demonstrates the importance (as well as the difficulty) of evaluating machine learning systems and their training data from the standpoint of moral considerations that are not encompassed by ordinary assessments of predictive accuracy. (shrink)

Wendell Wallach and Colin Allen’s Moral Machines: Teaching Robots Right From Wrong (Oxford University Press, 2009) explores efforts to develop machines that, not only can be employed for good or bad ends, but which themselves can be held morally accountable for what they do— artificial moral agents (AMAs). This essay is a critical response to Wallach and Allen’s conjectures. Although Wallach and Allen do not suggest that we are close to being able to create full-fledged AMAs, they do talk seriously (...) about making incremental progress in the direction of creating them (even if we never fully succeed). However, there are important questions about the moral development of AMAs that Moral Machines does not address. Given the responsibilities entrusted to human moral agents, we take questions about their moral development very seriously. In the case of children, the hope is that eventually they will develop into full-fledged moral agents. How might we expect this to go with less than fully formed AMAs? Will there be a comparable story of moral development and moral education that we can tell? (shrink)

Brain-machine interfaces are a growing field of research and application. The increasing possibilities to connect the human brain to electronic devices and computer software can be put to use in medicine, the military, and entertainment. Concrete technologies include cochlear implants, Deep Brain Stimulation, neurofeedback and neuroprosthesis. The expectations for the near and further future are high, though it is difficult to separate hope from hype. The focus in this paper is on the effects that these new technologies may have (...) on our ‘symbolic order’—on the ways in which popular categories and concepts may change or be reinterpreted. First, the blurring distinction between man and machine and the idea of the cyborg are discussed. It is argued that the morally relevant difference is that between persons and non-persons, which does not necessarily coincide with the distinction between man and machine. The concept of the person remains useful. It may, however, become more difficult to assess the limits of the human body. Next, the distinction between body and mind is discussed. The mind is increasingly seen as a function of the brain, and thus understood in bodily and mechanical terms. This raises questions concerning concepts of free will and moral responsibility that may have far reaching consequences in the field of law, where some have argued for a revision of our criminal justice system, from retributivist to consequentialist. Even without such a (unlikely and unwarranted) revision occurring, brain-machine interactions raise many interesting questions regarding distribution and attribution of responsibility. (shrink)

This paper engages with debates about the increasing use of paid domestic labour in Europe and the USA, contributing with a reflection about the case of Brazil. Relations of gender, class and race are considered in the deployment of maids for housework, the patterns of consumption of household technologies and the moral reasoning of daily living with hierarchical divisions within the home. The paper considers some parallels between the Brazilian context and that of more developed countries and also the specificity (...) of Brazil. Based on participant observation, secondary data and an ethnographic study, rich empirical data is weaved through to discuss material and moral dimensions of domestic labour and care. How does the availability of cheap domestic labour configure relations of inequality? How are social differences in the home lived with and justified? The exploration of the Brazilian case illuminates some of the problems, contradictions and possible consequences of wealthier households benefitting from the displacement of poor women that is currently happening through international migration. The paper argues that in Brazil the deflecting of tensions in gender divisions of labour in households onto a subordinate person has affected relations of equality between women and men and also the patterns of technological innovation to facilitate housework. These are outcomes to be guarded against in Europe and the United States in face of the current trends in ‘global woman’ relations. (shrink)

Who should decide how a machine will decide what to do when it is driving a car, performing a medical procedure, or, more generally, when it is facing any kind of morally laden decision? More and more, machines are making complex decisions with a considerable level of autonomy. We should be much more preoccupied by this problem than we currently are. After a series of preliminary remarks, this paper will go over four possible answers to the question raised above. (...) First, we may claim that it is the maker of a machine that gets to decide how it will behave in morally laden scenarios. Second, we may claim that the users of a machine should decide. Third, that decision may have to be made collectively or, fourth, by other machines built for this special purpose. The paper argues that each of these approaches suffers from its own shortcomings, and it concludes by showing, among other things, which approaches should be emphasized for different types of machines, situations, and/or morally laden decisions. (shrink)

It is a common view that artificial systems could play an important role in dealing with the shortage of caregivers due to demographic change. One argument to show that this is also in the interest of care-dependent persons is that artificial systems might significantly enhance user autonomy since they might stay longer in their homes. This argument presupposes that the artificial systems in question do not require permanent supervision and control by human caregivers. For this reason, they need the capacity (...) for some degree of moral decision-making and agency to cope with morally relevant situations (artificial morality). Machine ethics provides the theoretical and ethical framework for artificial morality. This article scrutinizes the question how artificial moral agents that enhance user autonomy could look like. It discusses, in particular, the suggestion that they should be designed as moral avatars of their users to enhance user autonomy in a substantial sense. (shrink)

The moral and ethical challenges of living in community pertain not only to the intersection of human beings one with another, but also our interactions with our machine creations. This article explores the philosophical and theological framework for reasoning and decision-making through the lens of science fiction, religion, and artificial intelligence (both real and imagined). In comparing the programming of autonomous machines with human ethical deliberation, we discover that both depend on a concrete ordering of priorities derived from a (...) clearly defined value system. (shrink)

The continuing debate between Persson and Savulescu and myself over moral enhancement concerns two dimensions of a very large question. The large question is: what exactly makes something a moral enhancement? This large question needs a book length study and this I provide in my How to be Good, Oxford 2016.. In their latest paper Moral Bioenhancement, Freedom and Reason take my book as their point of departure and the first dimension of the big question they address is one that (...) emphasizes a distinction, not highlighted in their original 2008 paper, between a moral enhancement that will ensure an improvement in morality and one that will simply make people more motivated to be moral. The second issue concerns whether anything that would be a “moral enhancement” properly so called, could involve denying moral agents the very possibility of autonomously choosing to try to be good. In this response, although P&S cover a number of other related issues, I shall concentrate on these two points. (shrink)