Abstract

Service and personal care robots are starting to cross the threshold into the wilderness of everyday life, where they are supposed to interact with inexperienced lay users in a changing environment. In order to function as intended, robots must become independent entities that monitor themselves and improve their own behaviours based on learning outcomes in practice. This poses a great challenge to robotics, which we are calling the “autonomy-safety-paradox” (ASP). The integration of robot applications into society requires the reconciliation of two conflicting aspects: increasing machine autonomy and ensuring safety in end-use. As the level of robot autonomy grows, the risk of accidents will increase, and it will become more and more difficult to identify who is responsible for any damage incurred. However, emphasizing safety impairs the autonomous functioning of the robot. This problem implies the need for a broadened concept of product safety. Our comparative study shows that the institutional framing of the ASP as well as concrete solutions to this problem differs between Europe and Japan in two respects: (1) the understanding of robot agency and (2) the concept of “appropriate” user–robot interaction.