Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers

Nena Schuitemaker; Martijn van Vliet; Sjaak Brinkkemper; Inge van de Weerd; Sergio España

doi:10.1007/978-3-031-61007-3_24

Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers

Nena Schuitemaker^*
, Martijn van Vliet
, Sjaak Brinkkemper
, Inge van de Weerd
, Sergio España

^*Corresponding author for this work

Utrecht University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Abstract

The government of The Netherlands has mandated public organizations to disclose an algorithm register in the future. This aligns with the upcoming AI Act of the European Union, as a directive that aims to enhance transparency in algorithmic decision-making and use. This research highlights that the practices are rarely mature and not fully understood, which is characterized by their variability. The novelty of the practices in the industry and the limited research to date, currently make this a chaotic domain. In this research, we explore this domain through a method engineering approach. We conduct six case studies to elicit the process that each organization applies or envisions to manage their algorithm register. We model their processes using Process-Deliverable Diagrams, a meta-modeling technique that integrates dynamic and static perspectives. By applying a systematic method comparison approach, we compare and combine the processes into a single reference method for algorithm register management (RM4AR). This paper documents the process and outcomes of developing such a reference method, demonstrating how method engineering techniques aid in bringing structure into an emerging field.

Original language	English
Title of host publication	Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings
Editors	Han van der Aa, Dominik Bork, Rainer Schmidt, Arnon Sturm
Publisher	Springer
Pages	325-340
Number of pages	16
ISBN (Print)	9783031610066
DOIs	https://doi.org/10.1007/978-3-031-61007-3_24
Publication status	Published - 31 May 2024
Event	25th International Working Conference on Business Process Modeling, Development, and Support, BPMDS 2024 and 29th International Working Conference on Exploring Modeling Methods for Systems Analysis and Development, EMMSAD 2024 - Limassol, Cyprus Duration: 3 Jun 2024 → 4 Jun 2024

Publication series

Name	Lecture Notes in Business Information Processing
Volume	511 LNBIP
ISSN (Print)	1865-1348
ISSN (Electronic)	1865-1356

Conference

Conference	25th International Working Conference on Business Process Modeling, Development, and Support, BPMDS 2024 and 29th International Working Conference on Exploring Modeling Methods for Systems Analysis and Development, EMMSAD 2024
Country/Territory	Cyprus
City	Limassol
Period	3/06/24 → 4/06/24

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Keywords

AI accountability
Algorithm register
Method engineering
Public sector
Reference method

Access to Document

10.1007/978-3-031-61007-3_24

978-3-031-61007-3_24Final published version, 1.7 MBLicence: Taverne

Cite this

Schuitemaker, N., van Vliet, M., Brinkkemper, S., van de Weerd, I., & España, S. (2024). Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers. In H. van der Aa, D. Bork, R. Schmidt, & A. Sturm (Eds.), Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings (pp. 325-340). (Lecture Notes in Business Information Processing; Vol. 511 LNBIP). Springer. https://doi.org/10.1007/978-3-031-61007-3_24

Schuitemaker, Nena ; van Vliet, Martijn ; Brinkkemper, Sjaak et al. / Realizing the Accountability of Algorithms in the Public Sector : A Reference Method for Managing Algorithm Registers. Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings. editor / Han van der Aa ; Dominik Bork ; Rainer Schmidt ; Arnon Sturm. Springer, 2024. pp. 325-340 (Lecture Notes in Business Information Processing).

@inproceedings{180727b580ff49f0975ab52093796503,

title = "Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers",

abstract = "The government of The Netherlands has mandated public organizations to disclose an algorithm register in the future. This aligns with the upcoming AI Act of the European Union, as a directive that aims to enhance transparency in algorithmic decision-making and use. This research highlights that the practices are rarely mature and not fully understood, which is characterized by their variability. The novelty of the practices in the industry and the limited research to date, currently make this a chaotic domain. In this research, we explore this domain through a method engineering approach. We conduct six case studies to elicit the process that each organization applies or envisions to manage their algorithm register. We model their processes using Process-Deliverable Diagrams, a meta-modeling technique that integrates dynamic and static perspectives. By applying a systematic method comparison approach, we compare and combine the processes into a single reference method for algorithm register management (RM4AR). This paper documents the process and outcomes of developing such a reference method, demonstrating how method engineering techniques aid in bringing structure into an emerging field.",

keywords = "AI accountability, Algorithm register, Method engineering, Public sector, Reference method",

author = "Nena Schuitemaker and \{van Vliet\}, Martijn and Sjaak Brinkkemper and \{van de Weerd\}, Inge and Sergio Espa{\~n}a",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 25th International Working Conference on Business Process Modeling, Development, and Support, BPMDS 2024 and 29th International Working Conference on Exploring Modeling Methods for Systems Analysis and Development, EMMSAD 2024 ; Conference date: 03-06-2024 Through 04-06-2024",

year = "2024",

month = may,

day = "31",

doi = "10.1007/978-3-031-61007-3\_24",

language = "English",

isbn = "9783031610066",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "325--340",

editor = "\{van der Aa\}, Han and Dominik Bork and Rainer Schmidt and Arnon Sturm",

booktitle = "Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings",

}

Schuitemaker, N, van Vliet, M , Brinkkemper, S , van de Weerd, I & España, S 2024, Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers. in H van der Aa, D Bork, R Schmidt & A Sturm (eds), Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings. Lecture Notes in Business Information Processing, vol. 511 LNBIP, Springer, pp. 325-340, 25th International Working Conference on Business Process Modeling, Development, and Support, BPMDS 2024 and 29th International Working Conference on Exploring Modeling Methods for Systems Analysis and Development, EMMSAD 2024, Limassol, Cyprus, 3/06/24. https://doi.org/10.1007/978-3-031-61007-3_24

Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers. / Schuitemaker, Nena; van Vliet, Martijn ; Brinkkemper, Sjaak et al.
Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings. ed. / Han van der Aa; Dominik Bork; Rainer Schmidt; Arnon Sturm. Springer, 2024. p. 325-340 (Lecture Notes in Business Information Processing; Vol. 511 LNBIP).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Realizing the Accountability of Algorithms in the Public Sector

T2 - 25th International Working Conference on Business Process Modeling, Development, and Support, BPMDS 2024 and 29th International Working Conference on Exploring Modeling Methods for Systems Analysis and Development, EMMSAD 2024

AU - Schuitemaker, Nena

AU - van Vliet, Martijn

AU - Brinkkemper, Sjaak

AU - van de Weerd, Inge

AU - España, Sergio

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

PY - 2024/5/31

Y1 - 2024/5/31

N2 - The government of The Netherlands has mandated public organizations to disclose an algorithm register in the future. This aligns with the upcoming AI Act of the European Union, as a directive that aims to enhance transparency in algorithmic decision-making and use. This research highlights that the practices are rarely mature and not fully understood, which is characterized by their variability. The novelty of the practices in the industry and the limited research to date, currently make this a chaotic domain. In this research, we explore this domain through a method engineering approach. We conduct six case studies to elicit the process that each organization applies or envisions to manage their algorithm register. We model their processes using Process-Deliverable Diagrams, a meta-modeling technique that integrates dynamic and static perspectives. By applying a systematic method comparison approach, we compare and combine the processes into a single reference method for algorithm register management (RM4AR). This paper documents the process and outcomes of developing such a reference method, demonstrating how method engineering techniques aid in bringing structure into an emerging field.

AB - The government of The Netherlands has mandated public organizations to disclose an algorithm register in the future. This aligns with the upcoming AI Act of the European Union, as a directive that aims to enhance transparency in algorithmic decision-making and use. This research highlights that the practices are rarely mature and not fully understood, which is characterized by their variability. The novelty of the practices in the industry and the limited research to date, currently make this a chaotic domain. In this research, we explore this domain through a method engineering approach. We conduct six case studies to elicit the process that each organization applies or envisions to manage their algorithm register. We model their processes using Process-Deliverable Diagrams, a meta-modeling technique that integrates dynamic and static perspectives. By applying a systematic method comparison approach, we compare and combine the processes into a single reference method for algorithm register management (RM4AR). This paper documents the process and outcomes of developing such a reference method, demonstrating how method engineering techniques aid in bringing structure into an emerging field.

KW - AI accountability

KW - Algorithm register

KW - Method engineering

KW - Public sector

KW - Reference method

UR - https://www.scopus.com/pages/publications/85197185862

U2 - 10.1007/978-3-031-61007-3_24

DO - 10.1007/978-3-031-61007-3_24

M3 - Conference contribution

AN - SCOPUS:85197185862

SN - 9783031610066

T3 - Lecture Notes in Business Information Processing

SP - 325

EP - 340

BT - Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings

A2 - van der Aa, Han

A2 - Bork, Dominik

A2 - Schmidt, Rainer

A2 - Sturm, Arnon

PB - Springer

Y2 - 3 June 2024 through 4 June 2024

ER -

Schuitemaker N, van Vliet M , Brinkkemper S , van de Weerd I , España S. Realizing the Accountability of Algorithms in the Public Sector: A Reference Method for Managing Algorithm Registers. In van der Aa H, Bork D, Schmidt R, Sturm A, editors, Enterprise, Business-Process and Information Systems Modeling - 25th International Conference, BPMDS 2024, and 29th International Conference, EMMSAD 2024, Proceedings. Springer. 2024. p. 325-340. (Lecture Notes in Business Information Processing). doi: 10.1007/978-3-031-61007-3_24