Decoding Peer Assessment: An Algorithm to Navigate Group Problems Detection

Alyssa Olthof; Isabella Saccardi; Judith Masthoff

doi:10.1007/978-3-031-98459-4_31

Decoding Peer Assessment: An Algorithm to Navigate Group Problems Detection

Alyssa Olthof
, Isabella Saccardi^*
, Judith Masthoff

^*Corresponding author for this work

Sub Human-Centered Computing

Utrecht University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Universities often use group work to develop teamwork skills, but it may cause stress due to group issues. Peer assessments can provide an overview of groups’ performances and well-being, but effective interpretation is challenging and the burden is left to the teachers. This study addresses these challenges through a focus groups and a field study. It proposes a rule-based algorithm to automatically interpret peer assessments, identifies key contextual variables, and evaluates the algorithm’s effectiveness and usability in a real classroom setting.

Original language	English
Title of host publication	Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings
Editors	Alexandra I. Cristea, Erin Walker, Yu Lu, Olga C. Santos, Seiji Isotani
Publisher	Springer
Pages	433-440
Number of pages	8
ISBN (Electronic)	978-3-031-98459-4
ISBN (Print)	978-3-031-98458-7
DOIs	https://doi.org/10.1007/978-3-031-98459-4_31
Publication status	Published - 20 Jul 2025
Event	26th International Conference on Artificial Intelligence in Education, AIED 2025 - Palermo, Italy Duration: 22 Jul 2025 → 26 Jul 2025

Publication series

Name	Lecture Notes in Computer Science
Volume	15880 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	26th International Conference on Artificial Intelligence in Education, AIED 2025
Country/Territory	Italy
City	Palermo
Period	22/07/25 → 26/07/25

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

Keywords

collaborative learning
group issues
human-centred design
peer assessment
teaching support

Access to Document

10.1007/978-3-031-98459-4_31

Decoding Peer Assessment: An Algorithm to Navigate Group Problems DetectionFinal published version, 350 KBLicence: Taverne

Cite this

Olthof, A., Saccardi, I., & Masthoff, J. (2025). Decoding Peer Assessment: An Algorithm to Navigate Group Problems Detection. In A. I. Cristea, E. Walker, Y. Lu, O. C. Santos, & S. Isotani (Eds.), Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings (pp. 433-440). (Lecture Notes in Computer Science; Vol. 15880 LNAI). Springer. https://doi.org/10.1007/978-3-031-98459-4_31

Olthof, Alyssa ; Saccardi, Isabella ; Masthoff, Judith. / Decoding Peer Assessment : An Algorithm to Navigate Group Problems Detection. Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings. editor / Alexandra I. Cristea ; Erin Walker ; Yu Lu ; Olga C. Santos ; Seiji Isotani. Springer, 2025. pp. 433-440 (Lecture Notes in Computer Science).

@inproceedings{4ab0d63db36d49839e9cc22e184498d3,

title = "Decoding Peer Assessment: An Algorithm to Navigate Group Problems Detection",

abstract = "Universities often use group work to develop teamwork skills, but it may cause stress due to group issues. Peer assessments can provide an overview of groups{\textquoteright} performances and well-being, but effective interpretation is challenging and the burden is left to the teachers. This study addresses these challenges through a focus groups and a field study. It proposes a rule-based algorithm to automatically interpret peer assessments, identifies key contextual variables, and evaluates the algorithm{\textquoteright}s effectiveness and usability in a real classroom setting.",

keywords = "collaborative learning, group issues, human-centred design, peer assessment, teaching support",

author = "Alyssa Olthof and Isabella Saccardi and Judith Masthoff",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.; 26th International Conference on Artificial Intelligence in Education, AIED 2025 ; Conference date: 22-07-2025 Through 26-07-2025",

year = "2025",

month = jul,

day = "20",

doi = "10.1007/978-3-031-98459-4\_31",

language = "English",

isbn = "978-3-031-98458-7",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "433--440",

editor = "Cristea, \{Alexandra I.\} and Erin Walker and Yu Lu and Santos, \{Olga C.\} and Seiji Isotani",

booktitle = "Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings",

}

Olthof, A, Saccardi, I & Masthoff, J 2025, Decoding Peer Assessment: An Algorithm to Navigate Group Problems Detection. in AI Cristea, E Walker, Y Lu, OC Santos & S Isotani (eds), Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings. Lecture Notes in Computer Science, vol. 15880 LNAI, Springer, pp. 433-440, 26th International Conference on Artificial Intelligence in Education, AIED 2025, Palermo, Italy, 22/07/25. https://doi.org/10.1007/978-3-031-98459-4_31

Decoding Peer Assessment: An Algorithm to Navigate Group Problems Detection. / Olthof, Alyssa; Saccardi, Isabella ; Masthoff, Judith.
Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings. ed. / Alexandra I. Cristea; Erin Walker; Yu Lu; Olga C. Santos; Seiji Isotani. Springer, 2025. p. 433-440 (Lecture Notes in Computer Science; Vol. 15880 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Decoding Peer Assessment

T2 - 26th International Conference on Artificial Intelligence in Education, AIED 2025

AU - Olthof, Alyssa

AU - Saccardi, Isabella

AU - Masthoff, Judith

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

PY - 2025/7/20

Y1 - 2025/7/20

N2 - Universities often use group work to develop teamwork skills, but it may cause stress due to group issues. Peer assessments can provide an overview of groups’ performances and well-being, but effective interpretation is challenging and the burden is left to the teachers. This study addresses these challenges through a focus groups and a field study. It proposes a rule-based algorithm to automatically interpret peer assessments, identifies key contextual variables, and evaluates the algorithm’s effectiveness and usability in a real classroom setting.

AB - Universities often use group work to develop teamwork skills, but it may cause stress due to group issues. Peer assessments can provide an overview of groups’ performances and well-being, but effective interpretation is challenging and the burden is left to the teachers. This study addresses these challenges through a focus groups and a field study. It proposes a rule-based algorithm to automatically interpret peer assessments, identifies key contextual variables, and evaluates the algorithm’s effectiveness and usability in a real classroom setting.

KW - collaborative learning

KW - group issues

KW - human-centred design

KW - peer assessment

KW - teaching support

UR - https://www.scopus.com/pages/publications/105012030853

U2 - 10.1007/978-3-031-98459-4_31

DO - 10.1007/978-3-031-98459-4_31

M3 - Conference contribution

AN - SCOPUS:105012030853

SN - 978-3-031-98458-7

T3 - Lecture Notes in Computer Science

SP - 433

EP - 440

BT - Artificial Intelligence in Education - 26th International Conference, AIED 2025, Proceedings

A2 - Cristea, Alexandra I.

A2 - Walker, Erin

A2 - Lu, Yu

A2 - Santos, Olga C.

A2 - Isotani, Seiji

PB - Springer

Y2 - 22 July 2025 through 26 July 2025

ER -