-
Algorithms as Social-Ecological-Technological Systems: an Environmental Justice Lens on Algorithmic Audits
Authors:
Bogdana Rakova,
Roel Dobbe
Abstract:
This paper reframes algorithmic systems as intimately connected to and part of social and ecological systems, and proposes a first-of-its-kind methodology for environmental justice-oriented algorithmic audits. How do we consider environmental and climate justice dimensions of the way algorithmic systems are designed, developed, and deployed? These impacts are inherently emergent and can only be un…
▽ More
This paper reframes algorithmic systems as intimately connected to and part of social and ecological systems, and proposes a first-of-its-kind methodology for environmental justice-oriented algorithmic audits. How do we consider environmental and climate justice dimensions of the way algorithmic systems are designed, developed, and deployed? These impacts are inherently emergent and can only be understood and addressed at the level of relations between an algorithmic system and the social (including institutional) and ecological components of the broader ecosystem it operates in. As a result, we claim that in absence of an integral ontology for algorithmic systems, we cannot do justice to the emergent nature of broader environmental impacts of algorithmic systems and their underlying computational infrastructure. We propose to define algorithmic systems as ontologically indistinct from Social-Ecological-Technological Systems (SETS), framing emergent implications as couplings between social, ecological, and technical components of the broader fabric in which algorithms are integrated and operate. We draw upon prior work on SETS analysis as well as emerging themes in the literature and practices of Environmental Justice (EJ) to conceptualize and assess algorithmic impact. We then offer three policy recommendations to help establish a SETS-based EJ approach to algorithmic audits: (1) broaden the inputs and open-up the outputs of an audit, (2) enable meaningful access to redress, and (3) guarantee a place-based and relational approach to the process of evaluating impact. We operationalize these as a qualitative framework of questions for a spectrum of stakeholders. Doing so, this article aims to inspire stronger and more frequent interactions across policymakers, researchers, practitioners, civil society, and grassroots communities.
△ Less
Submitted 23 May, 2023; v1 submitted 9 May, 2023;
originally announced May 2023.
-
Terms-we-Serve-with: a feminist-inspired social imaginary for improved transparency and engagement in AI
Authors:
Bogdana Rakova,
Megan Ma,
Renee Shelby
Abstract:
Power and information asymmetries between people and digital technology companies have predominantly been legitimized through contractual agreements that have failed to provide diverse people with meaningful consent and contestability. We offer an interdisciplinary multidimensional perspective on the future of regulatory frameworks - the Terms-we-Serve-with (TwSw) social, computational, and legal…
▽ More
Power and information asymmetries between people and digital technology companies have predominantly been legitimized through contractual agreements that have failed to provide diverse people with meaningful consent and contestability. We offer an interdisciplinary multidimensional perspective on the future of regulatory frameworks - the Terms-we-Serve-with (TwSw) social, computational, and legal contract for restructuring power asymmetries and center-periphery dynamics to enable improved human agency in individual and collective experiences of algorithmic harms.
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
-
Enhanced well-being assessment as basis for the practical implementation of ethical and rights-based normative principles for AI
Authors:
Marek Havrda,
Bogdana Rakova
Abstract:
Artificial Intelligence (AI) has an increasing impact on all areas of people's livelihoods. A detailed look at existing interdisciplinary and transdisciplinary metrics frameworks could bring new insights and enable practitioners to navigate the challenge of understanding and assessing the impact of Autonomous and Intelligent Systems (A/IS). There has been emerging consensus on fundamental ethical…
▽ More
Artificial Intelligence (AI) has an increasing impact on all areas of people's livelihoods. A detailed look at existing interdisciplinary and transdisciplinary metrics frameworks could bring new insights and enable practitioners to navigate the challenge of understanding and assessing the impact of Autonomous and Intelligent Systems (A/IS). There has been emerging consensus on fundamental ethical and rights-based AI principles proposed by scholars, governments, civil rights organizations, and technology companies. In order to move from principles to real-world implementation, we adopt a lens motivated by regulatory impact assessments and the well-being movement in public policy. Similar to public policy interventions, outcomes of AI systems implementation may have far-reaching complex impacts. In public policy, indicators are only part of a broader toolbox, as metrics inherently lead to gaming and dissolution of incentives and objectives. Similarly, in the case of A/IS, there's a need for a larger toolbox that allows for the iterative assessment of identified impacts, inclusion of new impacts in the analysis, and identification of emerging trade-offs. In this paper, we propose the practical application of an enhanced well-being impact assessment framework for A/IS that could be employed to address ethical and rights-based normative principles in AI. This process could enable a human-centered algorithmically-supported approach to the understanding of the impacts of AI systems. Finally, we propose a new testing infrastructure which would allow for governments, civil rights organizations, and others, to engage in cooperating with A/IS developers towards implementation of enhanced well-being impact assessments.
△ Less
Submitted 15 September, 2020; v1 submitted 29 July, 2020;
originally announced July 2020.
-
Leveraging traditional ecological knowledge in ecosystem restoration projects utilizing machine learning
Authors:
Bogdana Rakova,
Alexander Winter
Abstract:
Ecosystem restoration has been recognized to be critical to achieving accelerating progress on all of the United Nations' Sustainable Development Goals. Decision makers, policymakers, data scientists, earth scientists, and other scholars working on these projects could positively benefit from the explicit consideration and inclusion of diverse perspectives. Community engagement throughout the stag…
▽ More
Ecosystem restoration has been recognized to be critical to achieving accelerating progress on all of the United Nations' Sustainable Development Goals. Decision makers, policymakers, data scientists, earth scientists, and other scholars working on these projects could positively benefit from the explicit consideration and inclusion of diverse perspectives. Community engagement throughout the stages of ecosystem restoration projects could contribute to improved community well-being, the conservation of biodiversity, ecosystem functions, and the resilience of socio-ecological systems. Conceptual frameworks are needed for the meaningful integration of traditional ecological knowledge of indigenous peoples and local communities with data science and machine learning work practices. Adaptive frameworks would consider and address the needs and challenges of local communities and geographic locations by improving community and inter-agent communication around restoration and conservation projects and by making relevant real-time data accessible. In this paper, we provide a brief analysis of existing Machine Learning (ML) applications for forest ecosystem restoration projects. We go on to question if their inherent limitations may prevent them from being able to adequately address socio-cultural aspects of the well-being of all involved stakeholders. Bias and unintended consequences pose significant risks of downstream negative implications of ML-based solutions. We suggest that adaptive and scalable practices could incentivize interdisciplinary collaboration during all stages of ecosystemic ML restoration projects and align incentives between human and algorithmic actors. Furthermore, framing ML projects as open and reiterative processes can facilitate access on various levels and create incentives that lead to catalytic cooperation in the scaling of restoration efforts.
△ Less
Submitted 15 September, 2020; v1 submitted 22 June, 2020;
originally announced June 2020.
-
Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices
Authors:
Bogdana Rakova,
**gying Yang,
Henriette Cramer,
Rumman Chowdhury
Abstract:
Large and ever-evolving technology companies continue to invest more time and resources to incorporate responsible Artificial Intelligence (AI) into production-ready systems to increase algorithmic accountability. This paper examines and seeks to offer a framework for analyzing how organizational culture and structure impact the effectiveness of responsible AI initiatives in practice. We present t…
▽ More
Large and ever-evolving technology companies continue to invest more time and resources to incorporate responsible Artificial Intelligence (AI) into production-ready systems to increase algorithmic accountability. This paper examines and seeks to offer a framework for analyzing how organizational culture and structure impact the effectiveness of responsible AI initiatives in practice. We present the results of semi-structured qualitative interviews with practitioners working in industry, investigating common challenges, ethical tensions, and effective enablers for responsible AI initiatives. Focusing on major companies develo** or utilizing AI, we have mapped what organizational structures currently support or hinder responsible AI initiatives, what aspirational future processes and structures would best enable effective initiatives, and what key elements comprise the transition from current work practices to the aspirational future.
△ Less
Submitted 2 March, 2021; v1 submitted 22 June, 2020;
originally announced June 2020.
-
Principles to Practices for Responsible AI: Closing the Gap
Authors:
Daniel Schiff,
Bogdana Rakova,
Aladdin Ayesh,
Anat Fanti,
Michael Lennon
Abstract:
Companies have considered adoption of various high-level artificial intelligence (AI) principles for responsible AI, but there is less clarity on how to implement these principles as organizational practices. This paper reviews the principles-to-practices gap. We outline five explanations for this gap ranging from a disciplinary divide to an overabundance of tools. In turn, we argue that an impact…
▽ More
Companies have considered adoption of various high-level artificial intelligence (AI) principles for responsible AI, but there is less clarity on how to implement these principles as organizational practices. This paper reviews the principles-to-practices gap. We outline five explanations for this gap ranging from a disciplinary divide to an overabundance of tools. In turn, we argue that an impact assessment framework which is broad, operationalizable, flexible, iterative, guided, and participatory is a promising approach to close the principles-to-practices gap. Finally, to help practitioners with applying these recommendations, we review a case study of AI's use in forest ecosystem restoration, demonstrating how an impact assessment framework can translate into effective and responsible AI practices.
△ Less
Submitted 8 June, 2020;
originally announced June 2020.
-
Minority report detection in refugee-authored community-driven journalism using RBMs
Authors:
Bogdana Rakova,
Nick DePalma
Abstract:
Our work seeks to gather and distribute sensitive information from refugee settlements to stakeholders to help shape policy and help guide action networks. In this paper, we propose the following 1) a method of data collection through stakeholder organizations experienced in working with displaced and refugee communities, 2) a method of topic modeling based on Deep Boltzmann Machines that identifi…
▽ More
Our work seeks to gather and distribute sensitive information from refugee settlements to stakeholders to help shape policy and help guide action networks. In this paper, we propose the following 1) a method of data collection through stakeholder organizations experienced in working with displaced and refugee communities, 2) a method of topic modeling based on Deep Boltzmann Machines that identifies topics and issues of interest within the population, to help enable map** of human rights violations, and 3) a secondary analysis component that will use the probability of fit to isolate minority reports within these stories using anomaly detection techniques.
△ Less
Submitted 10 December, 2019;
originally announced December 2019.
-
Dynamic Algorithmic Service Agreements Perspective
Authors:
Bogdana Rakova,
Laura Kahn
Abstract:
A multi-disciplinary understanding of the concepts of identity, agency, relationships, interactions, and information could help us develop mitigation strategies for responsible human-algorithmic systems in the field of AI. It is imperative for us to question the use of the Terms of Service (ToS) agreements model in the context of algorithmic systems, specifically AI systems that make decisions whi…
▽ More
A multi-disciplinary understanding of the concepts of identity, agency, relationships, interactions, and information could help us develop mitigation strategies for responsible human-algorithmic systems in the field of AI. It is imperative for us to question the use of the Terms of Service (ToS) agreements model in the context of algorithmic systems, specifically AI systems that make decisions which affect people and their livelihoods. In this position paper, we identify five areas of concern in traditional ToS agreements by drawing on studies of sociotechnical systems in Science and Technology Studies - accommodating and enabling change, co-constitution, reflective directionality, friction, and generativity. We aim to address these ToS shortcomings and propose components of a novel Dynamic Algorithmic Service Agreements (DASA) framework. The DASA could be employed as a self-regulation framework while also enabling additional feedback loops between people and algorithmic systems. Rich interaction frameworks could enable us to better negotiate and cooperate with AI systems towards accomplishing the real-world goals we use them for. We illustrate the DASA framework in the context of a Recommender System used in the curation of real and synthetic data. We do not intend for the DASA framework to replace the ToS model, but instead think it will provide practitioners with an alternative point of view for the design of dynamic interaction interfaces for AI systems that account for human identity and agency.
△ Less
Submitted 7 January, 2020; v1 submitted 10 December, 2019;
originally announced December 2019.
-
Human self-determination within algorithmic sociotechnical systems
Authors:
Bogdana Rakova,
Rumman Chowdhury
Abstract:
In order to investigate the protection of human self-determination within algorithmic sociotechnical systems, we study the relationships between the concepts of mutability, bias, feedback loops, and power dynamics. We focus on the interactions between people and algorithmic systems in the case of Recommender Systems (RS) and provide novel theoretical analysis informed by human-in-the-loop system d…
▽ More
In order to investigate the protection of human self-determination within algorithmic sociotechnical systems, we study the relationships between the concepts of mutability, bias, feedback loops, and power dynamics. We focus on the interactions between people and algorithmic systems in the case of Recommender Systems (RS) and provide novel theoretical analysis informed by human-in-the-loop system design and Supervisory Control, in order to question the dynamics in our interactions with RSs. We explore what meaningful reliability monitoring means in the context of RSs and elaborate on the need for metrics that encompass human-algorithmic interaction. We derive a metric we call a barrier-to-exit which is a proxy to the amount of effort a user needs to expend in order for the system to recognize their change in preference. Our goal is to highlight the assumptions and limitations of RSs and introduce a human-centered method of combating deterministic design.
△ Less
Submitted 14 September, 2019;
originally announced September 2019.
