How Different Tools Affect Trust in Algorithmic Systems

Written by mediabias | Published 2025/05/21
Tech Story Tags: algorithmic-transparency | differential-privacy | disclosure-avoidance-system | sociotechnical-systems | handoff-model | government-data-privacy | ai-governance | algorithmic-data-protection

TLDRMulligan & Nissenbaum’s handoff model and Star’s boundary objects help uncover how seemingly technical changes—like shifting from SDL to DP—reshape organizational roles, stakeholder relationships, and embedded values. These lenses expose the political and participatory consequences of tech transitions.via the TL;DR App

Table of Links

Abstract and 1. Introduction

2. Related Work

3. Theoretical Lenses

3.1. Handoff Model

3.2. Boundary objects

4. Applying the Theoretical Lenses and 4.1 Handoff Triggers: New tech, new threats, new hype

4.2. Handoff Components: Shifting experts, techniques, and data

4.3. Handoff Modes: Abstraction and constrained expertise

4.4 Handoff Function: Interrogating the how and 4.5. Transparency artifacts at the boundaries: Spaghetti at the wall

5. Uncovering the Stakes of the Handoff

5.1. Confidentiality is the tip of the iceberg

5.2. Data Utility

5.3. Formalism

5.4. Transparency

5.5. Participation

6. Beyond the Census: Lessons for Transparency and Participation and 6.1 Lesson 1: The handoff lens is a critical tool for surfacing values

6.2 Lesson 2: Beware objects without experts

6.3 Lesson 3: Transparency and participation should center values and policy

7. Conclusion

8. Research Ethics and Social Impact

8.1. Ethical concerns

8.2. Positionality

8.3. Adverse impact statement

Acknowledgments and References

3 THEORETICAL LENSES

3.1 Handoff Model

Mulligan & Nissenbaum’s handoff model illuminates the values embedded in seemingly technical changes within a sociotechnical system, in particular when one part of a system is replaced with another [91]. By surfacing often overlooked reconfigurations of political and social relationships between technologies and people, the handoff model challenges narratives of linear technological progress.

The handoff model defines five elements of a system to interrogate in order to expose the changing values that it embodies: the functions of a system and sub-functions of its components (what does it do?); the components that are involved, be they technical or human (what are its pieces?); the ways in which components engage with or act on one another (where do its pieces connect?); the modes of action by which one component acts on or engages another (in what ways do its pieces connect?); and finally the trigger that spurs the handoff (why did it change?).

The handoff model has previously been adopted to understand shifting values in a variety of sociotechnical systems, including the adoption of design practices within organizations [135] and shifts in technology design. For instance, Mulligan and Nissenbuam use the model to reveal how changes in access control for mobile phones (introducing passcodes and, later, biometric verification) shifted the roles of developers and users as well as the space of privacy threats [91].

In this paper, we apply the handoff model to examine the shift from SDL to DP. The function is ostensibly the same (confidentiality) but the handoff reveals the implicitly value-laden rearrangements of organizations and design decisions.

3.2 Boundary objects

Star and Griesemer introduce the concept of boundary objects as arrangements that allow groups to work together without consensus [116]. Star theorizes boundary objects as having three important characteristics: (1) interpretive flexibility, (2) arising from information needs that are (3) weakly structured in common use but strongly structured in local contexts [115]. Past work on boundary objects in organizations has, for instance, shown that these intermediate arrangements can serve as important tools for learning and communication across diverse stakeholders for difficult or heterogeneous domains.

Past work demonstrates that the benefit of boundary objects also depends on their design, which can highlight gaps in understanding and values across groups or failures to serve different stakeholder needs [23]. Further, the role of expertise is crucial: the design and use of boundary objects unintentionally (and intentionally) shapes stakeholder engagement [72, 105]. Within the handoff model, boundary objects can help us to understand the changing relationships between different actants in a handoff. In particular, we examine how the Bureau shaped participation through the artifacts that it introduced to structure negotiations. By attending to these sites of negotiation within the Census Bureau’s adoption of DP, our goal is to illuminate how differences in values and expertise affect sociotechnical handoffs with consequences for participation, trust and accountability.

Authors:

(1) AMINA A. ABDU, University of Michigan, USA;

(2) LAUREN M. CHAMBERS, University of California, Berkeley, USA;

(3) DEIRDRE K. MULLIGAN, University of California, Berkeley, USA;

(4) ABIGAIL Z. JACOBS, University of Michigan, USA.


This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license.


Written by mediabias | We publish deeply researched (and often vastly underread) academic papers about our collective omnipresent media bias.
Published by HackerNoon on 2025/05/21