Skip to main navigation Skip to search Skip to main content

ASReview LAB v.2: Open-source text screening with multiple agents and a crowd of experts

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

ASReview LAB v.2 introduces an advancement in AI-assisted systematic reviewing by enabling collaborative screening with multiple experts (“a crowd of oracles”) using a shared AI model. The platform supports multiple AI agents within the same project, allowing users to switch between fast general-purpose models and domain-specific, semantic, or multilingual transformer models. Leveraging the SYNERGY benchmark dataset, performance has improved significantly, showing a 24.1% reduction in loss compared to version 1 through model improvements and hyperparameter tuning. ASReview LAB v.2 follows user-centric design principles and offers reproducible, transparent workflows. It logs key configuration and annotation data while balancing full model traceability with efficient storage. Future developments include automated model switching based on performance metrics, noise-robust learning, and ensemble-based decision-making.

Original languageEnglish
Article number101318
Number of pages17
JournalPatterns
Volume6
Issue number7
DOIs
Publication statusPublished - 11 Jul 2025

Bibliographical note

Publisher Copyright:
© 2025 The Author(s)

Keywords

  • active learning
  • crowdsourcing
  • data-driven screening
  • hyperparameter optimization
  • machine learning
  • multiagent systems
  • open-source software
  • reproducibility
  • systematic reviews
  • transparency

Fingerprint

Dive into the research topics of 'ASReview LAB v.2: Open-source text screening with multiple agents and a crowd of experts'. Together they form a unique fingerprint.

Cite this