Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social (...) robots to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

We study whether robots can satisfy the conditions for agents fit to be held responsible in a normative sense, with a focus on autonomy and self-control. An analogy between robots and human groups enables us to modify arguments concerning collective responsibility for studying questions of robot responsibility. On the basis of Alfred R. Mele’s history-sensitive account of autonomy and responsibility it can be argued that even if robots were to have all the capacities usually required of moral (...) agency, their history as products of engineering would undermine their autonomy and thus responsibility. (shrink)

In this paper, I develop a view about machine autonomy grounded in the theoretical frameworks of 4E cognition and PF Strawson’s reactive attitudes. I begin with critical discussion of White, and conclude that his view is strongly committed to functionalism as it has developed in mainstream analytic philosophy since the 1950s. After suggesting that there is good reason to resist this view by appeal to developments in 4E cognition, I propose an alternative view of machine autonomy. Namely, machines (...) count as autonomous when we members of the moral community adopt reactive attitudes in response to their actions. I distinguish this view from White’s and suggest assets and liabilities of this approach. (shrink)

Technological developments involving robotics and artificial intelligence devices are being employed evermore in elderly care and the healthcare sector more generally, raising ethical issues and practical questions warranting closer considerations of what we mean by “care” and, subsequently, how to design such software coherently with the chosen definition. This paper starts by critically examining the existing approaches to the ethical design of care robots provided by Aimee van Wynsberghe, who relies on the work on the ethics of care by Joan (...) Tronto. In doing so, it suggests an alternative to their non-principled approach, an alternative suited to tackling some of the issues raised by Tronto and van Wynsberghe, while allowing for the inclusion of two orientative principles. Our proposal centres on the principles of autonomy and vulnerability, whose joint adoption we deem able to constitute an original revision of a bottom-up approach in care ethics. Conclusively, the ethical framework introduced here integrates more traditional approaches in care ethics in view of enhancing the debate regarding the ethical design of care robots under a new lens. (shrink)

Service and personal care robots are starting to cross the threshold into the wilderness of everyday life, where they are supposed to interact with inexperienced lay users in a changing environment. In order to function as intended, robots must become independent entities that monitor themselves and improve their own behaviours based on learning outcomes in practice. This poses a great challenge to robotics, which we are calling the “autonomy-safety-paradox” (ASP). The integration of robot applications into society requires the (...) reconciliation of two conflicting aspects: increasing machine autonomy and ensuring safety in end-use. As the level of robot autonomy grows, the risk of accidents will increase, and it will become more and more difficult to identify who is responsible for any damage incurred. However, emphasizing safety impairs the autonomous functioning of the robot. This problem implies the need for a broadened concept of product safety. Our comparative study shows that the institutional framing of the ASP as well as concrete solutions to this problem differs between Europe and Japan in two respects: (1) the understanding of robot agency and (2) the concept of “appropriate” user–robot interaction. (shrink)

Robotics can be seen as a cognitive technology, assisting us in understanding various aspects of autonomy. In this paper I will investigate a difference between the interpretations of autonomy that exist within robotics and philosophy. Based on a brief review of some historical developments I suggest that within robotics a technical interpretation of autonomy arose, related to the independent performance of tasks. This interpretation is far removed from philosophical analyses of autonomy focusing on the capacity to (...) choose goals for oneself. This difference in interpretation precludes a straightforward debate between philosophers and roboticists about the autonomy of artificial and organic creatures. In order to narrow the gap I will identify a third problem of autonomy, related to the issue of what makes one’s goals genuinely one’s own. I will suggest that it is the body, and the ongoing attempt to maintain its stability, that makes goals belong to the system. This issue could function as a suitable focal point for a debate in which work in robotics can be related to issues in philosophy. Such a debate could contribute to a growing awareness of the way in which our bodies matter to our autonomy. (shrink)

In this article, I propose an ethical analysis of assistive domestic robots for older users. In doing so, I illustrate my inquiry with the example of ROB-IN assistive robot. ROB-IN is a Spanish project which is devoted to developing a robot that will perform in the private home of nondependent, aged users. It is aimed to help people in their daily activities and contribute to appropriate health monitoring. One of their potentially most useful features is related to data (...) gathering and sharing. For the inquiry on the ethical underpinnings of this case, I develop a framework for domestic assistive robots for competent older adults drawn on the ethics of care. I assess that this type of robots could be ethically appraised attending to their impact on the well-being and autonomy of users. I approach autonomy from a relational perspective, and I delve into the relationship between autonomy and well-being through the concept of paternalism. I argue that this type of assistive robots should never act paternalistically. Given ROB-IN great implications regarding privacy, I subsequently explore the ways in which the privacy of users should be respected in their interaction with assistive robots, focusing on the relation with autonomy and well-being. Lastly, I highlight the need for avoiding ageism. This investigation focuses on aged users, but it is suggested that the situation of caregivers should be also the object of further investigations. (shrink)

There is an urge to introduce high technology and robotics in care settings. Assisted living (AL) is the fastest growing form of older adults’ long-term care. Resident autonomy has become the watchword for good care. This article sheds light on the potential effects of care robotics on the sense of autonomy of older people in AL. Three aspects of the residents’ sense of autonomy are of particular interest: (a) interaction-based sense of autonomy, (b) coping-based sense of (...) autonomy, and (c) potential-based sense of autonomy. Ethnographical data on resident autonomy in an AL facility and existing literature on care robots are utilized in studying what kind of assurances different types of robots would provide to maintain the sense of autonomy in AL. Robots could strengthen the different types of sense of autonomy in multiple ways. Different types of robots could widen the residents’ space of daily movements, sustain their capacities, and help them maintain and even create future expectations. Robots may strengthen the sense of autonomy of older persons in AL; however, they may simultaneously pose a threat. Multi-professional discussions are needed on whether robots are welcomed in care, and if they are, how, for whom, and in what areas. (shrink)

Central to the ethical concerns raised by the prospect of increasingly autonomous military robots are issues of responsibility. In this paper we examine different conceptions of autonomy within the discourse on these robots to bring into focus what is at stake when it comes to the autonomous nature of military robots. We argue that due to the metaphorical use of the concept of autonomy, the autonomy of robots is often treated as a black box in discussions about (...) autonomous military robots. When the black box is opened up and we see how autonomy is understood and ‘made’ by those involved in the design and development of robots, the responsibility questions change significantly. (shrink)

This article argues that legal discourses about robots are framed within a limiting ‘human paradigm.’ While this is not a specific failure of lawyers, it has significant consequences for law in a digital future. This visualising of robots has its origins in mainstream twentieth-century science fictional tropes of artificial beings. This article begins by identifying the predominant science fiction tropes regarding artificial beings as a source of anxiety for human futures, as located in discrete bodies and as separate from humans. (...) The article then traces this ‘human paradigm’ in robot law scholarship. It is shown how a focus on embodiment and separation disrupts appreciation of the emerging partial disembodiment and hybridity of digital autonomy. There is a continual sense of needing to keep robots and humans distinct and separate, which is not how digital futures are manifesting. (shrink)

The false attribution of autonomy and related concepts to artificial agents that lack the attributed levels of the respective characteristic is problematic in many ways. In this article, we contrast this view with a positive viewpoint that emphasizes the potential role of such false attributions in the context of robotic language acquisition. By adding emotional displays and congruent body behaviors to a child-like humanoid robot’s behavioral repertoire, we were able to bring naïve human tutors to engage in so (...) called intent interpretations. In developmental psychology, intent interpretations can be hypothesized to play a central role in the acquisition of emotion, volition, and similar autonomy-related words. The aforementioned experiments originally targeted the acquisition of linguistic negation. However, participants produced other affect- and motivation-related words with high frequencies too and, as a consequence, these entered the robot’s active vocabulary. We will analyze participants’ non-negative emotional and volitional speech and contrast it with participants’ speech in a non-affective baseline scenario. Implications of these findings for robotic language acquisition in particular and artificial intelligence and robotics more generally will also be discussed. (shrink)

The concept of autonomy is crucial for the theoretical characterization of robots and, more in general, complex technological artifacts. The aim of this paper is to provide a conceptual and logical framework in which it is possible to define two concepts of autonomy: autonomy of performance and autonomy of process. The analysis is carried out exploiting the logical resources of the counterfactual semantics-developed by Lewis' and Stalnaker's seminal works-and branching structures of the possible courses of actions. (...) It allows to differentiate the autonomy of a robotic arm from the autonomy of a highly complex machine-like rovers for the explorations of the planets. The clarification of the concept of autonomy is, moreover, an essential precondition for the investigation concerning the ethics of artificial agents. (shrink)

The concept of autonomy is crucial for the theoretical characterization of robots and, more in general, complex technological artifacts. The aim of this paper is to provide a conceptual and logical framework in which it is possible to define two concepts of autonomy: autonomy of performance and autonomy of process. The analysis is carried out exploiting the logical resources of the counterfactual semantics-developed by Lewis' and Stalnaker's seminal works-and branching structures of the possible courses of actions. (...) It allows to differentiate the autonomy of a robotic arm from the autonomy of a highly complex machine-like rovers for the explorations of the planets. The clarification of the concept of autonomy is, moreover, an essential precondition for the investigation concerning the ethics of artificial agents. (shrink)

The success of social robots in achieving natural coexistence with humans depends on both their level of autonomy and their interactive abilities. Although a lot of robotic architectures have been suggested and many researchers have focused on human–robot interaction, a robotic architecture that can effectively combine interactivity and autonomy is still unavailable. This paper contributes to the research efforts toward this architecture in the following ways. First a theoretical analysis is provided that leads to the notion of (...) co-evolution between the agent and its environment and with other agents as the condition needed to combine both autonomy and interactivity. The analysis also shows that the basic competencies needed to achieve the required level of autonomy and the envisioned level of interactivity are similar but not the same. Secondly nine specific requirements are then formalized that should be achieved by the architecture. Thirdly a robotic architecture that tries to achieve those requirements by utilizing two main theoretical hypothesis and several insights from social science, developmental psychology and neuroscience is detailed. Lastly two experiments with a humanoid robot and a simulated agent are reported to show the potential of the proposed architecture. (shrink)

This paper offers an ethical framework for the development of robots as home companions that are intended to address the isolation and reduced physical functioning of frail older people with capacity, especially those living alone in a noninstitutional setting. Our ethical framework gives autonomy priority in a list of purposes served by assistive technology in general, and carebots in particular. It first introduces the notion of “presence” and draws a distinction between humanoid multi-function robots and non-humanoid robots to suggest (...) that the former provide a more sophisticated presence than the latter. It then looks at the difference between lower-tech assistive technological support for older people and its benefits, and contrasts these with what robots can offer. This provides some context for the ethical assessment of robotic assistive technology. We then consider what might need to be added to presence to produce care from a companion robot that deals with older people’s reduced functioning and isolation. Finally, we outline and explain our ethical framework. We discuss how it combines sometimes conflicting values that the design of a carebot might incorporate, if informed by an analysis of the different roles that can be served by a companion robot. (shrink)

Robots are becoming an increasingly pervasive feature of our personal lives. As a result, there is growing importance placed on examining what constitutes appropriate behavior when they interact with human beings. In this paper, we discuss whether companion robots should be permitted to “nudge” their human users in the direction of being “more ethical”. More specifically, we use Rawlsian principles of justice to illustrate how robots might nurture “socially just” tendencies in their human counterparts. Designing technological artifacts in such a (...) way to influence human behavior is already well-established but merely because the practice is commonplace does not necessarily resolve the ethical issues associated with its implementation. (shrink)

Much of modern ethics is built around the idea that we should respect one another’s autonomy. Here, “we” are typically imagined to be adult human beings of sound mind, where the soundness of our mind is measured against what we take to be the typical mental capacities of a neurodevelopmentally “normal” person—perhaps in their mid-thirties or forties. When deciding about what constitutes ethical sex, for example, our dominant models hold that ethical sex is whatever is consented to, while a (...) lack of consent makes sex wrong.1 Consent, in turn, is analysed in terms of autonomous decision-making: a “yes” or “no” that reflects the free and informed will of our idealised, sound-minded adult. Whether such models provide adequate normative guidance for ethical, much less good, sex between neurotypical human adults is an open question.2 3 When it comes to the ethics of sexual activity between humans and non-humans—robots, say—or between humans who don’t fit the rational stereotype, we hardly know where to begin.4–7 It is therefore heartening to see a number of papers in this issue tackling the difficult question how to respectfully facilitate or respond to the needs, desires, and decisions of people with different kinds or degrees of autonomy.8 For example, Sumytra Menon and colleagues9 explicitly discuss the notion of “borderline capacity” and argue, in the medical domain, for shared and supportive decision-making practices to “foster the autonomy of patients with compromised mental capacity while being mindful of the need to safeguard their well-being.” Touching on a similar theme, Zahra Ladan 10 asks how we should conceive of liberty in the case of persons with certain inborn physical or mental limitations. Might it sometimes be necessary to …. (shrink)

The concept of “autonomy”, once at the core of the original enactivist proposal in The Embodied Mind, is nowadays ignored or neglected by some of the most prominent contemporary enactivists approaches. Theories of autonomy, however, come to fill a theoretical gap that sensorimotor accounts of cognition cannot ignore: they provide a naturalized account of normativity and the resources to ground the identity of a cognitive subject in its specific mode of organization. There are, however, good reasons for the (...) contemporary neglect of autonomy as a relevant concept for enactivism. On the one hand, the concept of autonomy has too often been assimilated into autopoiesis and the implications are not always clear for a dynamical sensorimotor approach to cognitive science. On the other hand, the foundational enactivist proposal displays a metaphysical tension between the concept of operational closure, deployed as constitutive, and that of structural coupling ; making it hard to reconcile with the claim that experience is sensorimotorly constituted. This tension is particularly apparent when Varela et al. propose Bittorio as a model of the operational closure of the nervous system as it fails to satisfy the required conditions for a sensorimotor constitution of experience. It is, however, possible to solve these problems by re-considering autonomy at the level of sensorimotor neurodynamics. Two recent robotic simulation models are used for this task, illustrating the notion of strong sensorimotor dependency of neurodynamic patterns, and their networked intertwinement. The concept of habit is proposed as an enactivist building block for cognitive theorizing, re-conceptualizing mental life as a habit ecology, tied within an agent’s behaviour generating mechanism in coordination with its environment. Norms can be naturalized in terms of dynamic, interactively self-sustaining, coherentism. This conception of autonomous sensorimotor agency is put in contrast with those enactive approaches that reject autonomy or neglect the theoretical resources it has to offer for the project of naturalizing minds. (shrink)

In this paper, I am concerned with what automation—widely considered to be the “future of work”—holds for the artificially intelligent agents we aim to employ. My guiding question is whether it is normatively problematic to employ artificially intelligent agents like, for example, autonomous robots as workers. The answer I propose is the following. There is nothing inherently normatively problematic about employing autonomous robots as workers. Still, we must not put them to perform just any work, if we want to avoid (...) blame. This might not sound like much of a limitation. Interestingly, however, we can argue for this claim based on metaphysically and normatively parsimonious grounds. Namely, all I rely on when arguing for my claim is that the robots we aim to employ exhibit a kind of autonomy. (shrink)

A historical sketch of Autonomous Systems Research (ASR) is presented to show its roots in cybernetics, AI, Robotics, Cognitive Science, and in theoretical biology. These connections are considered in the light of the epistemology of human observers as a special kind of agents modeling other systems as representing and eventually realising autonomy. It is argued that ASR must primarily be understood as an opposition to traditional AI style ‘disembodied’ robotics, and that contemporary ASR provides a partial shift of focus (...) towards the organismic roots of cognition. Finally, it is suggested that a deeper understanding of situated autonomous systems as being a kind of complex self-organizing semiotic agents with emergent qualitative properties can be gained from the broad field of theoretical biology, including recent perspectives from Artificial Life, Evolutionary Systems, the Developmental Systems Approach, and Biosemiotics. Inspired by theoretical biology we suggest to investigate a new notion of autonomy that includes a qualitative aspect of the organism. (shrink)

It is argued in this paper that robots are just quasi-autonomous beings, which must be understood, within an emergent systems view, as intrinsically linked to and presupposing human beings as societal creatures within a technologically mediated world. Biosemiotics is introduced as a perspective on living systems that is based upon contemporary biology but reinterpreted through a qualitative organicist tradition in biology. This allows for emphasizing the differences between an organism as a general semiotic system with vegetative and self-reproductive capacities, an (...) animal body also with sentience and phenomenal states, and higher forms of anthroposemiotic systems such as humans, machines and robots. On all three levels, representations are crucial processes. The “representationalism” invoked by critiques of cognitive science and robotics tends to focus only on simplistic notions of representation, and must be distinguished from a Peircean or biosemiotic notion of representation. Implications for theorizing about the physical, biological, animate, phenomenal and social body and their forms of autonomy are discussed. (shrink)

The development of autonomous, robotic weaponry is progressing rapidly. Many observers agree that banning the initiation of lethal activity by autonomous weapons is a worthy goal. Some disagree with this goal, on the grounds that robots may equal and exceed the ethical conduct of human soldiers on the battlefield. Those who seek arms-control agreements limiting the use of military robots face practical difficulties. One such difficulty concerns defining the notion of an autonomous action by a robot. Another challenge concerns (...) how to verify and monitor the capabilities of rapidly changing technologies. In this article we describe concepts from our previous work about autonomy and ethics for robots and apply them to military robots and robot arms control. We conclude with a proposal for a first step toward limiting the deployment of autonomous weapons capable of initiating lethal force. (shrink)

This volume brings together a set of conceptual, moral, and cultural concerns carefully to assess a significant public policy issue: the development and proliferation of sex robots. Critics argue, for example, that sex robots present a clear risk to real persons as well as a degradation of society. They claim that the prevalence of sex robots will increase sexual violence, immorally objectify women, encourage pedophilia, reinforce negative body image stereotypes, increase forms of sexual dysfunction, and pass on sexually transmitted disease. (...) Proponents judge robotic sexual companionship as just another step in the exploration of human erotic desire. Sex robots, and similar technology, such as virtual reality pornography and other forms of “digi-sexuality,” are appreciated as providing autonomy affirming companionship, sexual release for the lonely, and a relatively harmless outlet for sexual fantasies that avoids the use of human prostitutes and thus reduces sexual victimization. As these chapters explore, to secure normative claims about sexual activity with artificial humanoids, one will need first to understand what the meaning of the morality of sexual activity can be as well as the significance of various practices with robotic partners on such cardinal social institutions as the family and the relationship between the sexes. One will also need to consider in terms of which ranking of human goods, right-making conditions, social outcomes, or personal virtues we ought to evaluate the significance of sexual relations with robots that look like women, men and children. Without such analysis, it will be unclear whether sex robots ought to be appreciated as a social evil that will further degrade moral culture, a positive technological innovation that will help preserve human dignity, or a more or less harmless pastime. (shrink)

Robots are slowly, but certainly, entering people's professional and private lives. They require the attention of regulators due to the challenges they present to existing legal frameworks and the new legal and ethical questions they raise. This paper discusses four major regulatory dilemmas in the field of robotics: how to keep up with technological advances; how to strike a balance between stimulating innovation and the protection of fundamental rights and values; whether to affirm prevalent social norms or nudge social norms (...) in a different direction; and, how to balance effectiveness versus legitimacy in techno-regulation. The four dilemmas are each treated in the context of a particular modality of regulation: law, market, social norms, and technology as a regulatory tool; and for each, we focus on particular topics? such as liability, privacy, and autonomy? that often feature as the major issues requiring regulatory attention. The paper then highlights the role and potential of the European framework of rights and values, responsible research and innovation, smart regulation and soft law as means of dealing with the dilemmas. (shrink)

Autonomous robots are increasingly interacting with users who have limited knowledge of robotics and are likely to have an erroneous mental model of the robot’s workings, capabilities, and internal structure. The robot’s real capabilities may diverge from this mental model to the extent that one might accuse the robot’s manufacturer of deceiving the user, especially in cases where the user naturally tends to ascribe exaggerated capabilities to the machine (e.g. conversational systems in elder-care contexts, or toy robots (...) in child care). This poses the question, whether misleading or even actively deceiving the user of an autonomous artifact about the capabilities of the machine is morally bad and why. By analyzing trust, autonomy, and the erosion of trust in communicative acts as consequences of deceptive robot behavior, we formulate four criteria that must be fulfilled in order for robot deception to be morally permissible, and in some cases even morally indicated. (shrink)

Service-Robotic—mainly defined as “non-industrial robotics”—is identified as the next economical success story to be expected after robots have been ubiquitously implemented into industrial production lines. Under the heading of service-robotic, we found a widespread area of applications reaching from robotics in agriculture and in the public transportation system to service robots applied in private homes. We propose for our interdisciplinary perspective of technology assessment to take the human user/worker as common focus. In some cases, the user/worker is the effective subject (...) acting by means of and in cooperation with a service robot; in other cases, the user/worker might become a pure object of the respective robotic system, for example, as a patient in a hospital. In this paper, we present a comprehensive interdisciplinary framework, which allows us to scrutinize some of the most relevant applications of service robotics; we propose to combine technical, economical, legal, philosophical/ethical, and psychological perspectives in order to design a thorough and comprehensive expert-based technology assessment. This allows us to understand the potentials as well as the limits and even the threats connected with the ongoing and the planned implementation of service robots into human lifeworld—particularly of those technical systems displaying increasing grades of autonomy. (shrink)

The concept of meaningful work has recently received increased attention in philosophy and other disciplines. However, the impact of the increasing robotization of the workplace on meaningful work has received very little attention so far. Doing work that is meaningful leads to higher job satisfaction and increased worker well-being, and some argue for a right to access to meaningful work. In this paper, we therefore address the impact of robotization on meaningful work. We do so by identifying five key aspects (...) of meaningful work: pursuing a purpose, social relationships, exercising skills and self-development, self-esteem and recognition, and autonomy. For each aspect, we analyze how the introduction of robots into the workplace may diminish or enhance the meaningfulness of work. We also identify a few ethical issues that emerge from our analysis. We conclude that robotization of the workplace can have both significant negative and positive effects on meaningful work. Our findings about ways in which robotization of the workplace can be a threat or opportunity for meaningful work can serve as the basis for ethical arguments for how to—and how not to—implement robots into workplaces. (shrink)

Researchers are beginning to transition from studying human–automation interaction to human–autonomy teaming. This distinction has been highlighted in recent literature, and theoretical reasons why the psychological experience of humans interacting with autonomy may vary and affect subsequent collaboration outcomes are beginning to emerge (de Visser et al., 2018;Wynne and Lyons, 2018). In this review, we do a deep dive into human–autonomy teams (HATs) by explaining the differences between automation and autonomy and by reviewing the domain of (...) human–human teaming to make inferences for HATs. We examine the domain of human–human teaming to extrapolate a few core factors that could have relevance for HATs. Notably, these factors involve critical social elements within teams that are central (as argued in this review) for HATs. We conclude by highlighting some research gaps that researchers should strive toward answering, which will ultimately facilitate a more nuanced and complete understanding of HATs in a variety of real-world contexts. (shrink)

During the last decade, children have shown an increasing need for mental wellbeing interventions due to their anxiety and depression issues, which the COVID-19 pandemic has exacerbated. Socially Assistive Robotics have been shown to have a great potential to support children with mental wellbeing-related issues. However, understanding how robots can be used to aid the measurement of these issues is still an open challenge. This paper presents a narrative review of child-robot interaction (cHRI) papers (IEEE ROMAN proceedings from 2016–2021 (...) and keyword-based article search using Google Scholar) to investigate the open challenges and potential knowledge gaps in the evaluation of mental wellbeing or the assessment of factors affecting mental wellbeing in children. We exploited the SPIDER framework to search for the key elements for the inclusion of relevant studies. Findings from this work (10 screened papers in total) investigate the challenges in cHRI studies about mental wellbeing by categorising the current research in terms of robot-related factors (robot autonomy and type of robot), protocol-related factors (experiment purpose, tasks, participants and user sensing) and data related factors (analysis and findings). The main contribution of this work is to highlight the potential opportunities for cHRI researchers to carry out measurements concerning children’s mental wellbeing. (shrink)

We propose that virtue ethics can be used to address ethical issues central to discussions about sex robots. In particular, we argue virtue ethics is well equipped to focus on the implications of sex robots for human moral character. Our evaluation develops in four steps. First, we present virtue ethics as a suitable framework for the evaluation of human–robot relationships. Second, we show the advantages of our virtue ethical account of sex robots by comparing it to current instrumentalist approaches, (...) showing how the former better captures the reciprocal interaction between robots and their users. Third, we examine how a virtue ethical analysis of intimate human–robot relationships could inspire the design of robots that support the cultivation of virtues. We suggest that a sex robot which is equipped with a consent-module could support the cultivation of compassion when used in supervised, therapeutic scenarios. Fourth, we discuss the ethical implications of our analysis for user autonomy and responsibility. (shrink)

This article tries to shed light on the difference between human autonomy and AI-driven machine autonomy. The breadth of the studies concerning this topic is constantly increasing, and for this reason, this discussion is very narrow and limited in its extent. Indeed, its hypothesis is that it is possible to distinguish two kinds of autonomy by analysing the way humans and robots narrate stories and the types of stories that, respectively, result from their capability of narrating stories (...) on their own. To approach the question of autonomy and its different interpretations in robots and humans, using narratives and stories as a lens, I proceed through four steps. First, I provide a brief summary concerning the state of the art with regard to issues concerning autonomy and AI. Second, I focus on specific issues concerning AI that are applied to storytelling. Third, I progressively approach narrative autonomy through what could seem a useless digression by addressing the problem of human creativity in relation to machine creativity. Fourth, I hypothesize a radical difference between narrative autonomy—which is proper to humans—and storytelling capability, which can be observed in both humans and machines. (shrink)

Pioneer approaches to Artificial Intelligence have traditionally neglected, in a chronological sequence, the agent body, the world where the agent is situated, and the other agents. With the advent of Collective Robotics approaches, important progresses were made toward embodying and situating the agents, together with the introduction of collective intelligence. However, the currently used models of social environments are still rather poor, jeopardizing the attempts of developing truly intelligent robot teams. In this paper, we propose a roadmap for a (...) new approach to the design of multi-robot systems, mainly inspired by concepts from Institutional Economics, an alternative to mainstream neoclassical economic theory. Our approach intends to sophisticate the design of robot collectives by adding, to the currently popular emergentist view, the concepts of physically and socially bounded autonomy of cognitive agents, uncoupled interaction among them and deliberately set up coordination devices. (shrink)

Among ethicists and engineers within robotics there is an ongoing discussion as to whether ethical robots are possible or even desirable. We answer both of these questions in the positive, based on an extensive literature study of existing arguments. Our contribution consists in bringing together and reinterpreting pieces of information from a variety of sources. One of the conclusions drawn is that artifactual morality must come in degrees and depend on the level of agency, autonomy and intelligence of the (...) machine. Moral concerns for agents such as intelligent search machines are relatively simple, while highly intelligent and autonomous artifacts with significant impact and complex modes of agency must be equipped with more advanced ethical capabilities. Systems like cognitive robots are being developed that are expected to become part of our everyday lives in future decades. Thus, it is necessary to ensure that their behaviour is adequate. In an analogy with artificial intelligence, which is the ability of a machine to perform activities that would require intelligence in humans, artificial morality is considered to be the ability of a machine to perform activities that would require morality in humans. The capacity for artificial (artifactual) morality, such as artifactual agency, artifactual responsibility, artificial intentions, artificial (synthetic) emotions, etc., come in varying degrees and depend on the type of agent. As an illustration, we address the assurance of safety in modern High Reliability Organizations through responsibility distribution. In the same way that the concept of agency is generalized in the case of artificial agents, the concept of moral agency, including responsibility, is generalized too. We propose to look at artificial moral agents as having functional responsibilities within a network of distributed responsibilities in a socio-technological system. This does not take away the responsibilities of the other stakeholders in the system, but facilitates an understanding and regulation of such networks. It should be pointed out that the process of development must assume an evolutionary form with a number of iterations because the emergent properties of artifacts must be tested in real world situations with agents of increasing intelligence and moral competence. We see this paper as a contribution to the macro-level Requirement Engineering through discussion and analysis of general requirements for design of ethical robots. (shrink)

The relationship between humans and animals is complex and influenced by multiple variables. Humans display a remarkably flexible and rich array of social competencies, demonstrating the ability to interpret, predict, and react appropriately to the behavior of others, as well as to engage others in a variety of complex social interactions. Developing computational systems that have similar social abilities is a critical step in designing robots, animated characters, and other computer agents that appear intelligent and capable in their interactions with (...) humans and each other. Further, it will improve their ability to cooperate with people as capable partners, learn from natural instruction, and provide intuitive and engaging interactions for human partners. Thus, human−animal team analogs can be one means through which to foster veridical mental models of robots that provide a more accurate representation of their near-future capabilities. Some digital twins of human−animal teams currently exist but are often incomplete. Therefore, this article focuses on issues within and surrounding the current models of human−animal teams, previous research surrounding this connection, and the challenges when using such an analogy for human−autonomy teams. (shrink)

Mobility robots may soon be among us, triggering a need for safety regulation. Robot safety regulation, however, remains underexplored, with only a few articles analyzing what regulatory approaches could be feasible. This article offers an account of the available regulatory strategies and attempts to theorize the effects of simulation-based safety regulation. The article first discusses the distinctive features of mobility robots as regulatory targets and argues that emergent behavior constitutes the key regulatory concern in designing robot safety regulation (...) regimes. In contrast to many accounts, the article posits that emergent behavior dynamics do not arise from robot autonomy, learning capability, or code unexplainability. Instead, they emerge from the complexity of robot technological constitutions coupled with near-infinite environmental variability and non-linear performance dynamics of the machine learning components. Second, the article reviews rules-based and performance-based regulation and argues that both will fail adequately constrain emergent robot behaviors. The article claims that controlling mobility robots requires a simulation-based regulatory approach. Simulation-based regulation is a novelty with significant theoretical and practical implications. The article argues that the approach signifies a radical break in regulatory forms of knowledge and temporalities. Simulations enact virtual futures to create a new regulatory knowledge type. Practically, the novel safety knowledge type may destabilize the existing conceptual space of safety politics and liability allocation patterns. (shrink)

The underlying thesis of the research in ethical autonomy for lethal autonomous unmanned systems is that they will potentially be capable of performing more ethically on the battlefield than are human soldiers. In this article this hypothesis is supported by ongoing and foreseen technological advances and perhaps equally important by an assessment of the fundamental ability of human warfighters in today's battlespace. If this goal of better-than-human performance is achieved, even if still imperfect, it can result in a reduction (...) in noncombatant casualties and property damage consistent with adherence to the Laws of War as prescribed in international treaties and conventions, and is thus worth pursuing vigorously. (shrink)

Epistemic limitations concerning prediction and explanation of the behaviour of robots that learn from experience are selectively examined by reference to machine learning methods and computational theories of supervised inductive learning. Moral responsibility and liability ascription problems concerning damages caused by learning robot actions are discussed in the light of these epistemic limitations. In shaping responsibility ascription policies one has to take into account the fact that robots and softbots - by combining learning with autonomy, pro-activity, reasoning, and (...) planning - can enter cognitive interactions that human beings have not experienced with any other non-human system. (shrink)

This paper extends Mori’s (IEEE Robot Autom Mag 19:98–100, 2012) uncanny valley-hypothesis to include technologies that fail its basic criterion that uncanniness arises when the subject experiences a discrepancy in a machine’s human likeness. In so doing, the paper considers Mori’s hypothesis about the uncanny valley as an instance of what Heidegger calls the ‘challenging revealing’ nature of modern technology. It introduces seeming autonomy and heteronomy as phenomenological categories that ground human being-in-the-world including our experience of things and (...) people. It is suggested that this categorical distinction is more foundational than Heidegger’s existential structures and phenomenological categories. Having introduced this novel phenomenological distinction, the paper considers the limits of Mori’s hypothesis by drawing on an example from science fiction that showcases that uncanniness need not only be caused by machines that resemble human beings. In so doing, it explores how the seeming autonomy-heteronomy distinction clarifies (at least some of) the uncanniness that can arise when humans encounter advanced technology which is irreducible to the anthropocentrism that shapes Mori’s original hypothesis. (shrink)

In the present enterprise we take a look at the meaning of Autonomy, how the word has been employed and some of the consequences of its use in the sciences of the artificial. Could and should robots really be autonomous entities? Over and beyond this, we use concepts from the philosophy of mind to spur on enquiry into the very essence of human autonomy. We believe our initiative, as does Dennett's life-long research, sheds light upon the problems of (...) robot design with respect to their relation with humans. (shrink)

We study whether robots can satisfy the conditions of an agent fit to be held morally responsible, with a focus on autonomy and self-control. An analogy between robots and human groups enables us to modify arguments concerning collective responsibility for studying questions of robot responsibility. We employ Mele’s history-sensitive account of autonomy and responsibility to argue that even if robots were to have all the capacities required of moral agency, their history would deprive them from autonomy (...) in a responsibility-undermining way. We will also study whether humans and technological artifacts like robots can form hybrid collective agents that could be morally responsible for their actions and give an argument against such a possibility. (shrink)

The emergent use of service robots in more and more areas of social life raises a number of legal issues which have to be addressed in order to apply and adapt the existing legal framework to this new technology. The article provides an overview of law as a means to regulate and govern technology and discusses fundamental issues of the relationship between law and technology. It then goes on to address a number of relevant problems in the field of service (...) robotics. In particular, these issues include the organization of administrative control and the legal liability regime which applies to service robots. Also, the issue of autonomy of service robots is discussed, which cannot easily be answered under the existing, human-centered legal regime. (shrink)

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

The team has become a popular model to organize joint human–robot behavior. Robot teammates are designed with high-levels of autonomy and well-developed coordination skills to aid humans in unpredictable environments. In this paper, we challenge the assumption that robots will succeed as teammates alongside humans. Drawing from the literature on human teams, we evaluate robots’ potential to meet the requirements of successful teammates. We argue that lacking humanlike mental models and a sense of self, robots may prove (...) untrustworthy and will be rejected from human teams. Benchmarks for evaluating human–robot teams are included, as are guidelines for defining alternative structures for human–robot groups. (shrink)

In this paper a look is taken at the relatively new area of culturing neural tissue and embodying it in a mobile robot platform—essentially giving a robot a biological brain. Present technology and practice is discussed. New trends and the potential effects of and in this area are also indicated. This has a potential major impact with regard to society and ethical issues and hence some initial observations are made. Some initial issues are also considered with regard to (...) the potential consciousness of such a brain. (shrink)

It is argued that the notion of Umwelt is relevant for contemporary discussions within theoretical biology, biosemiotics, the study of Artificial Life, Autonomous Systems Research and philosophy of biology. Focus is put on the question of whether an artificial creature can have a phenomenal world in the sense of the Umwelt notion of Jakob von Uexküll, one of the founding figures of biosemiotics. Rather than vitalism, Uexküll's position can be interpreted as a version of qualitative organicism. A historical sketch of (...) Autonomous Systems Research (ASR) is presented to show its theoretical roots and fruitful opposition to traditional AI style robotics. It is argued that these artificial systems are only partly 'situated' because they do not in the full sense of the word experience an Umwelt. A deeper understanding of truly situated autonomous systems as being a kind of complex selforganizing semiotic agents with emergent qualitative properties must be gained, not only from the broad field of theoretical biology, but also from the perspective of biosemiotics in the Uexküll tradition. The paper is thus an investigation of a new notion of autonomy that includes a qualitative aspect of the organism. This indicates that the Umwelt concept is not reducible to purely functional notions. (shrink)

The purpose of this essay is to determine the domain of validity of the notions developed in Machine Ethics [ME]. To this aim, I analyse the epistemological and methodological presuppositions that lie at the root of such technological project. On this basis, I then try and develop the theoretical means to identify and deconstruct improper applications of these notions to objects that do not belong to the same epistemic context, focusing in particular on the extent to which ME is supposed (...) to feedback onto moral philosophy. By highlighting the inadequacy of many approaches to the supposed philosophical implications of ME, I wish to redirect attention to its actual scope and to stress its relevance for the social acceptance of autonomous technologies. The essay is structured as follows. After a brief introduction (§ 1), in § 2 I shed light upon the link between the current trend of robotic development toward greater degrees of autonomy and the corresponding need for artificial moral agents that fuels research in ME. I then present the epistemological profile of ME in § 3, focusing on its main component, i.e., the modelling of human moral agency in the language of robotics and computer science. In § 4 I deal with cases in which such model is brought to bear on human ethics and moral philosophy as well, whilst in § 5 I develop a criticism of this extension based on an account of the actual epistemological relations that obtain between philosophical and technological knowledge in the context of the ME project. In § 6 I discuss the role that the ordinary use of language plays in the process of extending machinerelated notions to other domains of knowledge and, finally, I clarify what the appropriate scope of machine ethics is notwithstanding its many utopian or dystopian misinterpretations. (shrink)

This book provides cross-cultural ethical exploration of sex robots and their social impact. What are the implications of sex robots and related technological innovations for society and culture? How should we evaluate the significance of sexual relations with robots that look like women, men or children? Critics argue that sex robots present a clear risk to real persons and a social degradation that will increase sexual violence, objectify women, encourage pedophilia, reinforce negative body images, increase forms of sexual dysfunction, and (...) pass on sexually transmitted disease. Proponents judge robotic sexual companionship as just another step in the exploration of human desire. They see sex robots, and similar technology, such as virtual reality pornography, as providing autonomy affirming companionship for the lonely and a relatively harmless outlet for sexual fantasies that avoids the use of human prostitutes and thus reduces sexual victimization. Some appreciate sex robots as a social evil, others as a positive good, and still others as a harmless pastime. How we come to terms with such conceptual and moral concerns will have significant implications for society and the future of human relations. This book is of great interest to researchers in bioethics, human sexual behavior, AI ethics, and philosophy of sex. (shrink)