We can observe self-organization properties in various systems. However, modern networked dynamical sociotechnical systems have some features that allow for realizing the benefits of self-organization in a wide range of systems in economic and social areas. The review examines the general principles of self-organized systems, as well as the features of the implementation of self-organization in sociotechnical systems. We also delve into the production systems, in which the technical component is decisive, and (...) social networks, in which the social component dominates; we analyze models used for modeling self-organizing networked dynamical systems. It is shown that discrete models prevail at the micro level. Furthermore, the review deals with the features of using continuous models for modeling at the macro level. (shrink)

It has been argued that ethical frameworks for data science often fail to foster ethical behavior, and they can be difficult to implement due to their vague and ambiguous nature. In order to overcome these limitations of current ethical frameworks, we propose to integrate the analysis of the connections between technical choices and sociocultural factors into the data science process, and show how these connections have consequences for what data subjects can do, accomplish, and be. Using healthcare as an example, (...) attention to sociocultural conversion factors relevant to health can help in navigating technical choices that require broader considerations of the sociotechnical system, such as metric tradeoffs in model validation, resulting in better ethical and technical choices. This approach promotes awareness of the ethical dimension of technical choices by data scientists and others, and that can foster the cultivation of 'ethical skills' as integral to data science. (shrink)

Introducing the perspective of science and technology studies (STS) to the analysis of the design and adoption of environmentally friendly technologies may help develop more effective and diversified strategies for an environmentally oriented technology policy. A case study of the organizational context and sociotechnical network of modern domestic bio-mass heating systems in Austria demonstrates the usefulness of such an approach. Mapping out the sociotechnical system and the guiding visions surrounding the domestic use of biomass and the dynamics (...) of its development may help find effective levers for a technology policy focusing on regional and interactive strategies to influence the organizational context of a technology. In the case of biomass, the target of technology policy shifts from technological research and development to information programs and vocational training for installers, organizational infrastructures for the supply of wood chips, or the elaboration of innovative energy services. (shrink)

Reflection on the natural/artificial, real/imaginary, subjective/objective dicotomies is increasingly the subject of debate on systems of communication, which make more and more widespread use of expert and/or intelligent advanced technologies.This paper analyses different forms of communication operating in a socio-technical system. The analysis is concerned with changes in creativity and participation of the human being in the decision and production processes within various contexts of social life. It is thus important to verify the possibility of an interpolation between vital (...) world, social system, and information technologies in order to understand a possible interrelation between therational and therelational components in the presentsocio-technical system. (shrink)

There has been a surge of recent interest in sociocultural diversity in machine learning research. Currently, however, there is a gap between discussions of measures and benefits of diversity in machine learning, on the one hand, and the broader research on the underlying concepts of diversity and the precise mechanisms of its functional benefits, on the other. This gap is problematic because diversity is not a monolithic concept. Rather, different concepts of diversity are based on distinct rationales that should inform (...) how we measure diversity in a given context. Similarly, the lack of specificity about the precise mechanisms underpinning diversity’s potential benefits can result in uninformative generalities, invalid experimental designs, and illicit interpretations of findings. In this work, we draw on research in philosophy, psychology, and social and organizational sciences to make three contributions: First, we introduce a taxonomy of different diversity concepts from philosophy of science, and explicate the distinct epistemic and political rationales underlying these concepts. Second, we provide an overview of mechanisms by which diversity can benefit group performance. Third, we situate these taxonomies of concepts and mechanisms in the lifecycle of sociotechnical machine learning systems and make a case for their usefulness in fair and accountable machine learning. We do so by illustrating how they clarify the discourse around diversity in the context of machine learning systems, promote the formulation of more precise research questions about diversity’s impact, and provide conceptual tools to further advance research and practice. (shrink)

Scholarship on embedding values in AI is growing. In what follows, we distinguish two concepts of AI and argue that neither is amenable to values being ‘embedded’. If we think of AI as computational artifacts, then values and AI cannot be added together because they are ontologically distinct. If we think of AI as sociotechnical systems, then components of values and AI are in the same ontologic category—they are both social. However, even here thinking about the relationship as (...) one of ‘embedding’ is a mischaracterization. The relationship between values and AI is best understood as a dimension of the relationship between technology and society, a relationship that can be theorized in multiple ways. The literature in this area is consistent in showing that technology and society are co-productive. Within the co-production framework, the relationship between values and AI is shown to be generative of new meaning. This stands in stark contrast to the framework of ‘embedding’ values which frames values as fixed things that can be inserted into technological artifacts. (shrink)

What were the impacts of the Covid‐19 pandemic on trust in public health information, and what can be done to rebuild trust in public health authorities? This essay synthesizes insights from science and technology studies, information studies, and bioethics to explore sociotechnical factors that may have contributed to the breakdown of trust in public health information during the Covid‐19 pandemic. The field of science and technology studies lays out the dynamic nature of facts, helping to explain rapid shifts in (...) public health messaging during Covid‐19 and reasons they produced a lack of trust in public health authorities. The information field looks at how facts are sociotechnically constructed through systems of classification, illustrating how extrascientific factors influence public health authorities. Putting these perspectives alongside bioethics principles raises additional factors to consider. The goal of this essay is to learn from past failures to point toward a brighter future where trust in public health authorities can be rebuilt, not on faith, but rather through striving for calibrated trust within which, through a virtuous circle, trust is validated. (shrink)

This paper provides an empirical and conceptual account on seeing machine learning models as part of a sociotechnical system to identify relevant vulnerabilities emerging in the context of use. As ML is increasingly adopted in socially sensitive and safety-critical domains, many ML applications end up not delivering on their promises, and contributing to new forms of algorithmic harm. There is still a lack of empirical insights as well as conceptual tools and frameworks to properly understand and design for the (...) impact of ML models in their sociotechnical context. In this paper, we follow a design science research approach to work towards such insights and tools. We center our study in the financial industry, where we first empirically map recently emerging MLOps practices to govern ML applications, and corroborate our insights with recent literature. We then perform an integrative literature research to identify a long list of vulnerabilities that emerge in the sociotechnical context of ML applications, and we theorize these along eight dimensions. We then perform semi-structured interviews in two real-world use cases and across a broad set of relevant actors and organizations, to validate the conceptual dimensions and identify challenges to address sociotechnical vulnerabilities in the design and governance of ML-based systems. The paper proposes a set of guidelines to proactively and integrally address both the dimensions of sociotechnical vulnerability, as well as the challenges identified in the empirical use case research, in the organization of MLOps practices. (shrink)

Explicitly dismantling or decommissioning existing sociotechnical systems seems to be unimaginable both within dominant public imaginaries and in academic thought. Indeed, ‘gee whiz’ journalistic narratives regarding emerging technoscience abound as many members of the public appear to eagerly await any new innovation coming out of Silicon Valley. At the same time, most science and technology studies (STS) research focuses on the creation of new technoscience, not its destruction or temporary decommissioning. Yet, lay citizens clearly engage in forms of (...) Luddism: schoolchildren and overworked professionals take digital ‘detoxes’, a number of cities have dismantled their urban highways, and a growing movement of parents have opted their children out of their state’s standardized testing requirements. While all such efforts are rooted in the rejection of a technology, they vary in terms of their resemblance to 19th century English Luddism as well as with respect to Langdon Winner’s concept of epistemological Luddism. How might STS scholars better make sense of 21st century Luddism? This article conceptualizes a number of contemporary examples of technological dismantling with regard to their epistemological and political characteristics. We end with a call for research to better understand lay technological refusal, especially in comparison to elite-driven forms of disruption. (shrink)

Different people have different perceptions about artificial intelligence (AI). It is extremely important to bring together all the alternative frames of thinking—from the various communities of developers, researchers, business leaders, policymakers, and citizens—to properly start acknowledging AI. This article highlights the ‘fruitful collaboration’ that sociology and AI could develop in both social and technical terms. We discuss how biases and unfairness are among the major challenges to be addressed in such a sociotechnical perspective. First, as intelligent machines reveal their (...) nature of ‘magnifying glasses’ in the automation of existing inequalities, we show how the AI technical community is calling for transparency and explainability, accountability and contestability. Not to be considered as panaceas, they all contribute to ensuring human control in novel practices that include requirement, design and development methodologies for a fairer AI. Second, we elaborate on the mounting attention for technological narratives as technology is recognized as a social practice within a specific institutional context. Not only do narratives reflect organizing visions for society, but they also are a tangible sign of the traditional lines of social, economic, and political inequalities. We conclude with a call for a diverse approach within the AI community and a richer knowledge about narratives as they help in better addressing future technical developments, public debate, and policy. AI practice is interdisciplinary by nature and it will benefit from a socio-technical perspective. (shrink)

Discussions of ethics within in-service teacher education tend to focus on microethical concerns (e.g., discipline) that deal with decision making at interpersonal levels. Issues concerning educational technology are no exception. Yet, as teachers choose and are expected to integrate technological devices (e.g., laptops) and sociotechnical systems (e.g., learning management systems) into pedagogical practices, their classrooms and schools may become implicated in macroethical issues (e.g., electronic waste) that reach beyond the local consequences of their direct actions. Necessitated by (...) tight couplings of technology and education, this article presents the concept of macroethics for teacher educators by grounding it in three areas of concern: obsolescence, automation, and big data. These three areas offer opportunities to make economic and environmental issues more central to case studies on technology in teacher education. At the same time, teacher educators will need to put emphasis on critical reflection and collective action in units on macroethics since the limited impact of individual decision-making on these issues may put teachers in double binds (i.e., dilemmas with contradictory demands). (shrink)

This study concerns the sociotechnical bases of human autonomy. Drawing on recent literature on AI ethics, philosophical literature on dimensions of autonomy, and on independent philosophical scrutiny, we first propose a multi-dimensional model of human autonomy and then discuss how AI systems can support or hinder human autonomy. What emerges is a philosophically motivated picture of autonomy and of the normative requirements personal autonomy poses in the context of algorithmic systems. Ranging from consent to data collection and (...) processing, to computational tasks and interface design, to institutional and societal considerations, various aspects related to sociotechnical systems must be accounted for in order to get the full picture of potential effects of AI systems on human autonomy. It is clear how human agents can, for example, via coercion or manipulation, hinder each other’s autonomy, or how they can respect each other’s autonomy. AI systems can promote or hinder human autonomy, but can they literally respect or disrespect a person’s autonomy? We argue for a philosophical view according to which AI systems—while not moral agents or bearers of duties, and unable to literally respect or disrespect—are governed by so-called “ought-to-be norms.” This explains the normativity at stake with AI systems. The responsible people (designers, users, etc.) have duties and ought-to-do norms, which correspond to these ought-to-be norms. (shrink)

In We Have Always Been Cyborgs (2021), Stefan L. Sorgner argues that, given the growing economic burden of desirable welfare programs, in order for Western democratic societies to continue to flourish it will be necessary that they establish some form of algocracy (i.e., governance by algorithm). This is argued to be necessary both in order to maintain the sustainability and efficiency of these programs, but also due to the fact that further integration of humans into technical systems provides the (...) only effective means to bridge gaps in functionality and governance. However, Sorgner’s position is entirely insensitive to the design turn in applied ethics, which argues against the neutrality of technology, instead maintaining that technology and society co-construct each other with persistent feedback loops. This, I argue, is a problem for his account inasmuch as technologies, as they become more ubiquitous, likewise become pervasive and inextricable from our sociotechnical infrastructures. As such, less-than-beneficent forces, as current trends illustrate, can appropriate these seemingly banal infrastructures to gear them towards oppressive ends, thereby ultimately threatening the social democracies that Sorgner’s position aims to buttress. (shrink)

Artificial Intelligence (AI) technologies offer new ways of conducting decision-making tasks that influence the daily lives of citizens, such as coordinating traffic, energy distributions, and crowd flows. They can sort, rank, and prioritize the distribution of fines or public funds and resources. Many of the changes that AI technologies promise to bring to such tasks pertain to decisions that are collectively binding. When these technologies become part of critical infrastructures, such as energy networks, citizens are affected by these decisions whether (...) they like it or not, and they usually do not have much say in them. The democratic challenge for those working on AI technologies with collectively binding effects is both to _develop_ and _deploy_ technologies in such a way that the democratic legitimacy of the relevant decisions is safeguarded. In this paper, we develop a conceptual framework to help policymakers, project managers, innovators, and technologists to assess and develop approaches to democratize AI. This framework embraces a broad sociotechnical perspective that highlights the interactions between technology and the complexities and contingencies of the context in which these technologies are embedded. We start from the problem-based and practice-oriented approach to democracy theory as developed by political theorist Mark Warren. We build on this approach to describe practices that can enhance or challenge democracy in political systems and extend it to integrate a sociotechnical perspective and make the role of technology explicit. We then examine how AI technologies can play a role in these practices to improve or inhibit the democratic nature of political systems. We focus in particular on AI-supported political systems in the energy domain. (shrink)

Constructivist research in Science and Technology Studies is committed to revealing the heterogeneity of technological change and the fluid boundaries between the elements involved. Its major theories, the Social Construction of Technology and Actor Network Theory, have however both been criticized for limiting themselves to the micro-level of cases, impeding a structural analysis of technological systems. This article seeks to bridge any such divides. We research the recent changes in the viticulture of Mendoza, Argentina, which underwent radical changes over (...) the past decades: once governed by low-cost yield maximization, grape production now revolves around “quality.” To show how the particular quality definition developed, we depart from a social-constructivist framework, following the sociotechnical shaping of problem-solution relationships across the wine production system. To include relevant social groups from different settings around the world, we gradually incorporate the ANT concepts of obligatory passage points, enrollment, convergence, delegation, and codes into the analysis. Combined into the concept of “sociotechnical alliance,” our analysis follows the dual process of creating agreement while establishing heterogeneous practices across settings at different levels. It shows that functioning involves alliance building and highlights the hybridity and continuous dynamics of systems at large. (shrink)

The sociotechnical domain is the realm of scientists, the communities and institutions they form, and the tools and instruments they use to create, disseminate, and preserve knowledge. This paper reviews current scientonomic theory concerning this domain. A core scientonomic concept is that of an epistemic agent. Generally, an agent is an entity capable of intentional action—action that has content or meaning due to its purposeful direction towards a goal. An epistemic agent is one whose actions are the taking of (...) epistemic stances, such as acceptance or rejection, towards epistemic elements, like theories or questions. An epistemic agent must semantically understand the propositions in question, and their alternatives, and choose among them with reason, with the motive of acquiring knowledge. The most obvious example of an epistemic agent is an individual human being. Rejecting the network of practitioners view, current scientonomic theory argues that appropriately organized communities of scientists can also function as epistemic agents. Communal epistemic agents are of particular scientonomic importance. Whereas the methods of theory assessment of individual scientists can be idiosyncratic, scientonomic theory contends that the taking of epistemic stances by scientific communities is a lawful, rule governed process. A second concept of central importance is that of an epistemic tool. A physical object or system is an epistemic tool for some epistemic agent if there is a procedure by which the tool can provide an acceptable source of knowledge under the method employed by that agent. (shrink)

The purpose of cultural competence education for medical professionals is to ensure respectful care and reduce health disparities. Yet as Berger and Miller (2021) show, the cultural competence framework is dated, confused, and self-defeating. They argue that the framework ignores the primary driver of health disparities—systemic racism—and is apt to exacerbate rather than mitigate bias and ethnocentrism. They propose replacing cultural competence with a framework that attends to two social aspects of structural inequality: health and social policy, and institutional-system activity; (...) and two psychological aspects of structural inequality: the clinical encounter, and the epistemic. -/- We agree with the structural approach. To that end, we think it would be fruitful to include attention to physical contributors to structural inequality, namely the material artifacts used in medicine. Devices, tools, and technologies can materialize biases, perpetuate oppression, and contribute to health disparities. Granted, not everything that interests philosophers can be squeezed into medical education. Nevertheless, there are compelling reasons for including the study of material artifacts in education designed to reduce health disparities. First, devices and tools often carry forward biases from the past, and keep biases hidden from plain sight. Second, by studying these artifacts, future clinicians can begin to see themselves as part of a larger sociotechnical system. Finally, as medicine becomes increasingly tech-laden, it’s important for clinicians to see how material artifacts (including algorithms) connect individuals to structures. This will help to undermine oversimplified narratives according to which objective tools and technologies can correct for the bias and subjectivity of flawed human beings. (shrink)

Organizations such as the EU High-Level Expert Group on AI and the IEEE have recently formulated ethical principles and (moral) values that should be adhered to in the design and deployment of artificial intelligence (AI). These include respect for autonomy, non-maleficence, fairness, transparency, explainability, and accountability. But how can we ensure and verify that an AI system actually respects these values? To help answer this question, I propose an account for determining when an AI system can be said to embody (...) certain values. This account understands embodied values as the result of design activities intended to embed those values in such systems. AI systems are here understood as a special kind of sociotechnical system that, like traditional sociotechnical systems, are composed of technical artifacts, human agents, and institutions but—in addition—contain artificial agents and certain technical norms that regulate interactions between artificial agents and other elements of the system. The specific challenges and opportunities of embedding values in AI systems are discussed, and some lessons for better embedding values in AI systems are drawn. (shrink)

This paper explores the important role of critical science, and in particular of post-colonial and decolonial theories, in understanding and shaping the ongoing advances in artificial intelligence. Artificial intelligence is viewed as amongst the technological advances that will reshape modern societies and their relations. While the design and deployment of systems that continually adapt holds the promise of far-reaching positive change, they simultaneously pose significant risks, especially to already vulnerable peoples. Values and power are central to this discussion. Decolonial (...) theories use historical hindsight to explain patterns of power that shape our intellectual, political, economic, and social world. By embedding a decolonial critical approach within its technical practice, AI communities can develop foresight and tactics that can better align research and technology development with established ethical principles, centring vulnerable peoples who continue to bear the brunt of negative impacts of innovation and scientific progress. We highlight problematic applications that are instances of coloniality, and using a decolonial lens, submit three tactics that can form a decolonial field of artificial intelligence: creating a critical technical practice of AI, seeking reverse tutelage and reverse pedagogies, and the renewal of affective and political communities. The years ahead will usher in a wave of new scientific breakthroughs and technologies driven by AI research, making it incumbent upon AI communities to strengthen the social contract through ethical foresight and the multiplicity of intellectual perspectives available to us, ultimately supporting future technologies that enable greater well-being, with the goal of beneficence and justice for all. (shrink)

Digital technologies have opened up new perspectives in thinking about the future of food and farming. Not only do these new technologies promise to revolutionise our way of meeting global food demand, they do so by boldly claiming that they can reduce their environmental impacts. However, they also have the potential to transform the organisation of agri-food systems more fundamentally. Drawing on assemblage theory, we propose a conceptual model of digitalisation organised around three facets: digitalisation as a project; “everyday (...) digitalisation”; and reflexive digitalisation. These facets reflect different relations between concrete practices and representations, imaginaries, and narratives, while representing different modes of agency: the collective, the distributed, and the individual, which, we argue, highlight contrasting ways for human and non-human actors to engage with digitalisation. With this model anchored in assemblage theory, we offer a tool for critically and comprehensively engaging with the complexity and multiplicity of digitalisation as a sociotechnical process. We then apply our theoretical framework to two ethnographic studies, one explores the growth of digital technologies in Switzerland as a way to govern and monitor national agriculture, the other focuses on Indonesia, where small digital startups have begun to dot the landscape. By identifying the material and semiotic processes occurring in each case, we notice similar issues being raised in terms of how digitalisation is co-constructed in society. (shrink)

This article responds to recent debates in critical algorithm studies about the significance of the term “algorithm.” Where some have suggested that critical scholars should align their use of the term with its common definition in professional computer science, I argue that we should instead approach algorithms as “multiples”—unstable objects that are enacted through the varied practices that people use to engage with them, including the practices of “outsider” researchers. This approach builds on the work of Laura Devendorf, Elizabeth Goodman, (...) and Annemarie Mol. Different ways of enacting algorithms foreground certain issues while occluding others: computer scientists enact algorithms as conceptual objects indifferent to implementation details, while calls for accountability enact algorithms as closed boxes to be opened. I propose that critical researchers might seek to enact algorithms ethnographically, seeing them as heterogeneous and diffuse sociotechnical systems, rather than rigidly constrained and procedural formulas. To do so, I suggest thinking of algorithms not “in” culture, as the event occasioning this essay was titled, but “as” culture: part of broad patterns of meaning and practice that can be engaged with empirically. I offer a set of practical tactics for the ethnographic enactment of algorithmic systems, which do not depend on pinning down a singular “algorithm” or achieving “access,” but which rather work from the partial and mobile position of an outsider. (shrink)

The paper explores how the framework of systemic risks can help govern the risks imposed through solar climate engineering research. The central argument is that a systemic perspective of risk is a useful tool for analysing and assessing the risks imposed through Stratospheric Aerosol Injection (SAI) research. SAI is a form of climate engineering that could cool the planet by enhancing its albedo through the injection of aerosols into the stratosphere. Researching such a technology creates systemic risks with a strong (...) sociotechnical component. This component consists of the potential societal harm that a developing or new technology might cause to existing norms, values, institutions, and politics. The systemic risk framework is a valuable heuristic for this case, given the complex interdependencies of societal systems, infrastructures, markets, etc. At the same time, the systemic risk framework can be enhanced through the inclusion of a more robust and reflected ethical considerations on technological risks. Consequently, this article seeks to supplement the systemic risk governance framework with insights from technology ethics. Specifically, the paper offers an ethically reflective conception of societal value dynamism and stakeholder engagement and participation, tying it to existing systemic risk governance approaches. (shrink)

This article examines Russian engineers’ social imagination about the future through the professional discussions held at the electrotechnical congresses in the nineteenth century. Formulating the prospective future of the industry, the state and society was a collective endeavor, a process in which the identity and mission of engineers were crystallized. Through envisioning the future of technology and its role in the society, engineers revealed their cultural role as mediators between technological innovation, and both the wider public and the state. In (...) order to better understand the manifestations of the shared cultural understandings of a desirable future and social order, the article resorts to Sheila Jasanoff’s concept of sociotechnical imaginaries. The engineering community’s sociotechnical imagination about electricity was shaped around the transformative possibilities of this technology. It was believed that electrical engineering was able not only to accelerate industrial production, but also to solve social, medical and cultural problems, thereby uniting the Russian Empire. Descriptions of the rational, comfortable and beautiful world of the electrified future overlapped in engineering discussions, journalism and science fiction. Positive scenarios emphasized the advantages of electrical engineering and bypassed the problems associated with electrification, constructing an idea of its inevitability. The electrical engineer became a kind of a new cultural hero, who knew how to make a working device or system, and also filled the task of linking the development of technology to the development of society. (shrink)

This article argues for engaging with the smart city as a sociotechnical imaginary. By conducting a close reading of primary source material produced by the companies IBM and Cisco over a decade of work on smart urbanism, we argue that the smart city imaginary is premised in a particular narrative about urban crises and technological salvation. This narrative serves three main purposes: it fits different ideas and initiatives into a coherent view of smart urbanism, it sells and disseminates this (...) version of smartness, and it crowds out alternative visions and corresponding arrangements of smart urbanism. Furthermore, we argue that IBM and Cisco construct smart urbanism as both a reactionary and visionary force, plotting a model of the near future, but one that largely reflects and reinforces existing sociopolitical systems. We conclude by suggesting that breaking IBM’s and Cisco’s discursive dominance over the smart city imaginary requires us to reimagine what smart urbanism means and create counter-narratives that open up space for alternative values, designs, and models. (shrink)

The last decade has witnessed the mass distribution and adoption of smart home systems and devices powered by artificial intelligence systems ranging from household appliances like fridges and toasters to more background systems such as air and water quality controllers. The pervasiveness of these sociotechnical systems makes analyzing their ethical implications necessary during the design phases of these devices to ensure not only sociotechnical resilience, but to design them for human values in mind and (...) thus preserve meaningful human control over them. This paper engages in a conceptual investigations of how meaningful human control over smart home devices can be attained through design. The value sensitive design (VSD) approach is proposed as a way of attaining this level of control. In the proposed framework, values are identified and defined, stakeholder groups are investigated and brought into the design process and the technical constraints of the technologies in question are considered. The paper concludes with some initial examples that illustrate a more adoptable way forward for both ethicists and engineers of smart home devices. (shrink)

For the Critical Theory tradition of the Frankfurt School, rationalisation is a central concept that refers to the socio-cultural closure of capitalist modernity due to the proliferation of technical, ‘instrumental’ rationality at the expense of some form of political reason. This picture of rationalisation, however, hinges on a separation of technology and politics that is both empirically and philosophically problematic. This article aims to re-conceptualise the rationalisation thesis through a survey of research from science and technology studies and the conceptual (...) framework of Niklas Luhmann's systems theory. It argues that rationalisation indeed exhibits a logic of closure, namely the ‘operational closure’ of sociotechnical systems of measurement, but that this closure in fact produces the historical logics of technical reason and, paradoxically, also generates spaces of critical-political openness. This opens up the theoretical and practical opportunity of connecting the politically just to the technically efficient. (shrink)

Several competing narratives drive the contemporary AI ethics discourse. At the two extremes are sociotechnical dogmatism, which holds that society is full of inefficiencies and imperfections that can only be solved by better technology; and sociotechnical skepticism, which highlights the unacceptable risks AI systems pose. While both narratives have their merits, they are ultimately reductive and limiting. As a constructive synthesis, we introduce and defend sociotechnical pragmatism—a narrative that emphasizes the central role of context and human (...) agency in designing and evaluating emerging technologies. In doing so, we offer two novel contributions. First, we demonstrate how ethical and epistemological considerations are intertwined in the AI ethics discourse by tracing the dialectical interplay between dogmatic and skeptical narratives across disciplines. Second, we show through examples how sociotechnical pragmatism does more to promote fair and transparent AI than dogmatic or skeptical alternatives. By spelling out the assumptions that underpin sociotechnical pragmatism, we articulate a robust stance for policymakers and scholars who seek to enable societies to reap the benefits of AI while managing the associated risks through feasible, effective, and proportionate governance. (shrink)

Organisations increasingly use automated decision-making systems (ADMS) to inform decisions that affect humans and their environment. While the use of ADMS can improve the accuracy and efficiency of decision-making processes, it is also coupled with ethical challenges. Unfortunately, the governance mechanisms currently used to oversee human decision-making often fail when applied to ADMS. In previous work, we proposed that ethics-based auditing (EBA)—that is, a structured process by which ADMS are assessed for consistency with relevant principles or norms—can (a) help (...) organisations verify claims about their ADMS and (b) provide decision-subjects with justifications for the outputs produced by ADMS. In this article, we outline the conditions under which EBA procedures can be feasible and effective in practice. First, we argue that EBA is best understood as a ‘soft’ yet ‘formal’ governance mechanism. This implies that the main responsibility of auditors should be to spark ethical deliberation at key intervention points throughout the software development process and ensure that there is sufficient documentation to respond to potential inquiries. Second, we frame AMDS as parts of larger sociotechnical systems to demonstrate that to be feasible and effective, EBA procedures must link to intervention points that span all levels of organisational governance and all phases of the software lifecycle. The main function of EBA should, therefore, be to inform, formalise, assess, and interlink existing governance structures. Finally, we discuss the policy implications of our findings. To support the emergence of feasible and effective EBA procedures, policymakers and regulators could provide standardised reporting formats, facilitate knowledge exchange, provide guidance on how to resolve normative tensions, and create an independent body to oversee EBA of ADMS. (shrink)

This study examines an important aspect of energy history and policy: the intertwinement of energy technologies with ideals. Ideals play an important role in energy visions and innovation pathways. Aspirations to realize technical, social, and political ideals indicate a long-term commitment in the design of energy systems, distinguishable from commitment to other abstract goals, such as values. This study offers an analytical scheme that could help to conceptualize these differences and their impact on energy policy. In the proposed model, (...) two spheres of interaction are highlighted: a material sphere in which values and technologies co-evolve, and an imaginary sphere in which ideals interact with idealized technologies. Furthermore, the relation between these two spheres can be understood in different ways. This study examines three cases that are illustrative of the different roles of ideals in the development of energy technologies and visions: (1) the evolution of safety in nuclear reactor design; (2) visions of atomic power in France; (3) the political idealization of a tidal power scheme in the Severn Estuary. Finally, the developed model implies more general insights for the development of sociotechnical systems. Amongst others, it shows why certain projects and technologies remain a political, but not a techno–economic option. (shrink)

Focused on city-scale automation, and using self-driving cars (SDCs) as a case study, this article reflects on the role of AI—and in particular, computer vision systems used for mapping and navigation—as a catalyst for urban transformation. Urban research commonly presents AI and cities as having a one-way cause-and-effect relationship, giving undue weight to AI’s impact on cities and overlooking the role of cities in shaping AI. Working at the intersection of data science and social research, this paper aims to (...) counter this trend by exploring the reverse perspective: how do cities affect the development, and expose the present limits, of SDCs? The contribution of this paper is threefold. First, by comparing urban and nonurban environments and thoroughly examining the relationship between computer vision and city-specific sociality and form, it defines machine autonomy/automation as a function of the sociotechnical milieu in which an AI system operates. Second, and related, the paper problematizes the notion of SDCs as autonomous technologies and the role it plays in envisioning contending policy arrangements and technical solutions for achieving full driving automation. Finally, the article offers insight into a materialist and spatialized understanding of AI—namely, not as an abstract quality susceptible to replication within discrete machines, but rather as a distributed property emerging through embodied interactions among a multiplicity of agents (human, non-human, and technological) within/with their environments. (shrink)

Transitioning to food systems that are equitable, resilient, healthy and environmentally sustainable will require the cultivation and diffusion of transformational sociotechnical innovations—and grassroots movements are an essential source of such innovations. Within the literature on strategic niche management, government-provided ‘protected spaces’ where niche innovations can develop without facing the pressures of the market is an essential part of sustainability transitions. However, because of their desire to _transform_ rather than _transition_ food systems, grassroots movements often struggle to acquire (...) such protected spaces and so must determine how and where to generate change whilst being marginalised and exposed to unprotected spaces. The aim of this research is to gain a precise view of the multiple touchpoints of marginalisation that exist across the grassroots-government interface and to apply a new framework for conceptual analysis of these touchpoints that can help to identify where and how grassroots movements might be able to push against this marginalisation. The study finds that, by applying a ‘who, what, where’ framework of analysis to policies across this interface, it is possible to find pathways forward for achieving small wins towards food systems transformation. (shrink)

After reviewing portions of the 21st Century Nanotechnology Research and Development Act that call for examination of societal and ethical issues, this essay seeks to understand how nanoethics can play a role in nanotechnology development. What can and should nanoethics aim to achieve? The focus of the essay is on the challenges of examining ethical issues with regard to a technology that is still emerging, still ‘in the making.’ The literature of science and technology studies (STS) is used to understand (...) the nanotechnology endeavor in a way that makes room for influence by nanoethics. The analysis emphasizes: the contingency of technology and the many actors involved in its development; a conception of technology as sociotechnical systems; and, the values infused (in a variety of ways) in technology. Nanoethicists can be among the many actors who shape the meaning and materiality of an emerging technology. Nevertheless, there are dangers that nanoethicists should try to avoid. The possibility of being co-opted from working along side nanotechnology engineers and scientists is one danger that is inseparable from trying to influence. Related but somewhat different is the danger of not asking about the worthiness of the nanotechnology enterprise as a social investment in the future. (shrink)

In this study, we explore the future of work by examining differences in productivity when teams are composed of only humans or both humans and machine agents. Our objective was to characterize the similarities and differences between human and human–machine teams as they work to coordinate across their specialized roles. This form of research is increasingly important given that machine agents are becoming commonplace in sociotechnical systems and playing a more active role in collaborative work. One particular class (...) of machine agents, bots, is being introduced to these systems to facilitate both taskwork and teamwork. We investigated the association between bots and productivity outcomes in open source software development through an analysis of hundreds of project teams. The presence of bots in teams was associated with higher levels of productivity and higher work centralization in addition to greater amounts of observed communication. The adoption of bots in software teams may have tradeoffs, in that doing so may increase productivity, but could also increase workload. We discuss the theoretical and practical implications of these findings for advancing human–machine teaming research. (shrink)

Work injury compensation and pensions are often determined according to medical disability rating scales attributing a percentage to each impaired body part or function. Incorporated into central medical–administrative networks of committees and examinations, these produce disability as a calculable space. This article examines the specific case of the Israeli National Insurance regulations regarding work injuries of 1956 and analyzes the shifted order they set. Looking at this system in the specific historical context of transition from the British Mandate workmen’s compensation (...) system to the “disability percentages” system, provides insight into the process of structuring and stabilizing durable numerical forms and the production of centralized government. Drawing on conceptualizations regarding the sociotechnical role of classification systems, I contend that through encoding and calculating classifications of disability, heterogeneity is eliminated and an ordering based on physiology is “black boxed,” illustrating the importance of technoscientific formations in structuring the “medical model of disability.”. (shrink)

As artificial intelligence (AI) becomes progressively more engaged with society, its shift from technical tool to participating in society raises questions about AI personhood. Drawing upon developmental psychology and systems theory, a mediating structure for AI proto-personhood is defined analogous to an early stage of human development. The proposed AI bridges technical, psychological, and theological perspectives on near-future AI and is structured by its hardware, software, computational, and sociotechnical systems through which it experiences its world as embodied (...) (even for putatively disembodied AI). Further social and moral construction can occur building upon a simple “self” for AI synthesized from symbolic and statistical approaches to AI. (shrink)

Most engineers Fwork within social structures governing and governed by a set of values that primarily emphasise economic concerns. The majority of innovations derive from these loci. Given the effects of these innovations on various communities, it is imperative that the values they embody are aligned with those societies. Like other transformative technologies, artificial intelligence systems can be designed by a single organisation but be diffused globally, demonstrating impacts over time. This paper argues that in order to design for (...) this broad stakeholder group, engineers must adopt a systems thinking approach that allows them to understand the sociotechnicity of artificial intelligence systems across sociocultural domains. It claims that value sensitive design, and envisioning cards in particular, provides a solid first step towards helping designers harmonise human values, understood across spatiotemporal boundaries, with economic values, rather than the former coming at the opportunity cost of the latter. (shrink)

The thesis introduces and criticizes the discourse on technology, with a specific reference to the concept of AI. The discourse on AI is particularly saturated with reified metaphors which drive connotations and delimit understandings of technology in society. To better analyse the discourse on AI, the thesis proposes the concept of “Expected AI”, a composite signifier filled with historical and sociocultural connotations, and numerous referent objects. Relying on cultural semiotics, science and technology studies, and a diverse selection of heuristic concepts, (...) the thesis delves beneath the surface of AI discourse and demonstrates the hidden political, social, cultural, and ecological dangers of AI. The entanglement of the discourse(s) with (science) fiction, folklore, myth, and religion impacts how AI is perceived and received, as well as the expectations to AI-enabled technologies now and in the future. The thesis also proposes a more ethical and comprehensive ontological model for AI systems. The model describes AI systems as complex figurations, considering their socio-material organisation, global economic-material becoming, and impact on the environment, social institutions, and the semiosphere. The dissertation argues that AI should be understood not just as an object or sociotechnical system, but as its entire product chain encompassing people and cultures, as well as the used resources and impact (both material-ecological and semiotic) on a planetary scale. (shrink)

This chapter contains sections titled: Background Concepts for Examining LTS Dynamics Societal Implications of LTS References and Further Reading.

Large technical systems are integral to modern lifestyles but arduous to analyze. In this paper, we advance a conceptualization of LTS using the notion of mature “phases,” drawing from insights into innovation studies, science and technology studies, political science, the sociology of infrastructure, history of technology, and governance. We begin by defining LTS as a unit of analysis and explaining its conceptual utility and novelty, situating it among other prominent sociotechnical theories. Next, we argue that after LTS have (...) moved through the phases proposed by Thomas Hughes of invention, expansion, growth, momentum, and style, mature LTS undergo the additional phases of reconfiguration, contestation, and eventually stagnation and decline. We illustrate these analytical phases with historical case studies and the conceptual literature, and close by suggesting future research to refine and develop the LTS framework, particularly related to more refined typologies, temporal dimensions, and a broadening of system users. We aim to contribute to theoretical debates about the coevolution of LTS as well as empirical discussions about system-related use, sociotechnical change, and policy-making. (shrink)

Large language models (LLMs) such as ChatGPT present immense opportunities, but without proper training for users (and potentially oversight), they carry risks of misuse as well. We argue that current approaches focusing predominantly on transparency and explainability fall short in addressing the diverse needs and concerns of various user groups. We highlight the limitations of existing methodologies and propose a framework anchored on user-centric guidelines. In particular, we argue that LLM users should be given guidelines on what tasks LLMs can (...) do well and which they cannot, which tasks require further guidance or refinement by the user, and context-specific heuristics. We further argue that (some) users should be taught to refine and elaborate adequate prompts, be provided with good procedures for prompt iteration, and be taught efficient ways to verify outputs. We suggest that for users, shifting away from looking at the technology itself, but rather looking at the usage of it within contextualized sociotechnical systems, can help solve many issues related to LLMs. We further emphasize the role of real-world case studies in shaping these guidelines, ensuring they are grounded in practical, applicable strategies. Like any technology, risks of misuse can be managed through education, regulation, and responsible development. (shrink)

Users of sociotechnical systems often have no way to independently verify whether the system output which they use to make decisions is correct; they are epistemically dependent on the system. We argue that this leads to problems when the system is wrong, namely to bad decisions and violations of the norm of practical reasoning. To prevent this from occurring we suggest the implementation of defeaters: information that a system is unreliable in a specific case (undercutting defeat) or independent (...) information that the output is wrong (rebutting defeat). Practically, we suggest to design defeaters based on the different ways in which a system might produce erroneous outputs, and analyse this suggestion with a case study of the risk classification algorithm used by the Dutch tax agency. (shrink)

Given the very large numbers of documents involved in e-discovery investigations, lawyers face a considerable challenge of collaborative sensemaking. We report findings from three workplace studies which looked at different aspects of how this challenge was met. From a sociotechnical perspective, the studies aimed to understand how investigators collectively and individually worked with information to support sensemaking and decision making. Here, we focus on discovery-led refinement; specifically, how engaging with the materials of the investigations led to discoveries that supported (...) refinement of the problems and new strategies for addressing them. These refinements were essential for tractability. We begin with observations which show how new lines of enquiry were recursively embedded. We then analyse the conceptual structure of a line of enquiry and consider how reflecting this in e-discovery support systems might support scalability and group collaboration. We then focus on the individual activity of manual document review where refinement corresponded with the inductive identification of classes of irrelevant and relevant documents within a collection. Our observations point to the effects of priming on dealing with these efficiently and to issues of cognitive ergonomics at the human–computer interface. We use these observations to introduce visualisations that might enable reviewers to deal with such refinements more efficiently. (shrink)

The COVID-19 pandemic has been accompanied by an “infodemic” of misinformation and conspiracy theory. This article points to three explanatory factors: the challenge of forming accurate beliefs when overwhelmed with information, an implausibly individualistic conception of epistemic virtue, and an adversarial information environment that suborns epistemic dependence. Normally we cope with the problems of informational excess by relying on other people, including sociotechnical systems that mediate testimony and evidence. But when we attempt to engage in epistemic “superheroics” - (...) withholding trust from others and trying to figure it all out for ourselves – these can malfunction in ways that make us vulnerable to forming irrational beliefs. Some epistemic systems are prone to coalescing audiences around false conspiracy theories. This analysis affords a new perspective on philosophical efforts to understand conspiracy theories and other epistemic projects prone to collective irrationality. (shrink)