Abstract
ASReview LAB v.2 introduces an advancement in AI-assisted systematic reviewing by enabling collaborative screening with multiple experts (“a crowd of oracles”) using a shared AI model. The platform supports multiple AI agents within the same project, allowing users to switch between fast general-purpose models and domain-specific, semantic, or multilingual transformer models. Leveraging the SYNERGY benchmark dataset, performance has improved significantly, showing a 24.1% reduction in loss compared to version 1 through model improvements and hyperparameter tuning. ASReview LAB v.2 follows user-centric design principles and offers reproducible, transparent workflows. It logs key configuration and annotation data while balancing full model traceability with efficient storage. Future developments include automated model switching based on performance metrics, noise-robust learning, and ensemble-based decision-making.
| Original language | English |
|---|---|
| Article number | 101318 |
| Number of pages | 17 |
| Journal | Patterns |
| Volume | 6 |
| Issue number | 7 |
| DOIs | |
| Publication status | Published - 11 Jul 2025 |
Bibliographical note
Publisher Copyright:© 2025 The Author(s)
Keywords
- active learning
- crowdsourcing
- data-driven screening
- hyperparameter optimization
- machine learning
- multiagent systems
- open-source software
- reproducibility
- systematic reviews
- transparency
Fingerprint
Dive into the research topics of 'ASReview LAB v.2: Open-source text screening with multiple agents and a crowd of experts'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver