Explaining Recommendations in E-Learning: Effects on Adolescents' Trust

Jeroen Ooge, Shotallo Kato, Katrien Verbert

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

In the scope of explainable artificial intelligence, explanation techniques are heavily studied to increase trust in recommender systems. However, studies on explaining recommendations typically target adults in e-commerce or media contexts; e-learning has received less research attention. To address these limits, we investigated how explanations affect adolescents' initial trust in an e-learning platform that recommends mathematics exercises with collaborative filtering. In a randomized controlled experiment with 37 adolescents, we compared real explanations with placebo and no explanations. Our results show that real explanations significantly increased initial trust when trust was measured as a multidimensional construct of competence, benevolence, integrity, intention to return, and perceived transparency. Yet, this result did not hold when trust was measured one-dimensionally. Furthermore, not all adolescents attached equal importance to explanations and trust scores were high overall. These findings underline the need to tailor explanations and suggest that dynamically learned factors may be more important than explanations for building initial trust. To conclude, we thus reflect upon the need for explanations and recommendations in e-learning in low-stakes and high-stakes situations.

Original languageEnglish
Title of host publication27th International Conference on Intelligent User Interfaces, IUI 2022
PublisherAssociation for Computing Machinery
Pages93-105
Number of pages13
ISBN (Electronic)9781450391443
DOIs
Publication statusPublished - 22 Mar 2022
Externally publishedYes
Event27th International Conference on Intelligent User Interfaces, IUI 2022 - Virtual, Online, Finland
Duration: 22 Mar 202225 Mar 2022

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI

Conference

Conference27th International Conference on Intelligent User Interfaces, IUI 2022
Country/TerritoryFinland
CityVirtual, Online
Period22/03/2225/03/22

Bibliographical note

Publisher Copyright:
© 2022 ACM.

Funding

We are very grateful to all involved adolescents for participating in our studies, their parents for giving parental consent, and their mathematics teachers for inviting us into their (virtual) classroom. This work was supported by the Research Foundation–Flanders (FWO, grant G0A3319N) and the imec.icon project AIDA financed by Flanders Innovation & Entrepreneurship (grant HB.2020.2373). This work was supported by the Research Foundation-Flanders (FWO, grant G0A3319N) and the imec.icon project AIDA financed by Flanders Innovation and Entrepreneurship (grant HB.2020.2373)

FundersFunder number
Research Foundation Flanders
Research Foundation Flanders
Agentschap Innoveren en OndernemenHB.2020.2373
Fonds Wetenschappelijk OnderzoekG0A3319N

    Keywords

    • education
    • explainability
    • interpretability
    • teenagers
    • XAI

    Fingerprint

    Dive into the research topics of 'Explaining Recommendations in E-Learning: Effects on Adolescents' Trust'. Together they form a unique fingerprint.

    Cite this