An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game

Fernando Pastor Ricós; Beatriz Marín; I. S.W.B. Prasetya; Tanja E.J. Vos; Joseph Davidson; Karel Hovorka

doi:10.1007/978-3-031-59465-6_24

An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game

Fernando Pastor Ricós^*, Beatriz Marín, I. S.W.B. Prasetya, Tanja E.J. Vos, Joseph Davidson, Karel Hovorka

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers’ work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.

Original language	English
Title of host publication	Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings
Editors	João Araújo, Jose Luis de la Vara, Maribel Yasmina Santos, Saïd Assar
Publisher	Springer
Pages	393-409
Number of pages	17
ISBN (Electronic)	978-3-031-59465-6
ISBN (Print)	978-3-031-59464-9
DOIs	https://doi.org/10.1007/978-3-031-59465-6_24
Publication status	Published - 2 May 2024
Event	18th International Conference on Research Challenges in Information Science, RCIS 2024 - Guimarães, Portugal Duration: 14 May 2024 → 17 May 2024

Publication series

Name	Lecture Notes in Business Information Processing
Volume	513
ISSN (Print)	1865-1348
ISSN (Electronic)	1865-1356

Conference

Conference	18th International Conference on Research Challenges in Information Science, RCIS 2024
Country/Territory	Portugal
City	Guimarães
Period	14/05/24 → 17/05/24

Keywords

Autonomous agents
BDD testing
Industrial game testing

Access to Document

10.1007/978-3-031-59465-6_24

Cite this

Pastor Ricós, F., Marín, B., Prasetya, I. S. W. B., Vos, T. E. J., Davidson, J., & Hovorka, K. (2024). An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. In J. Araújo, J. L. de la Vara, M. Y. Santos, & S. Assar (Eds.), Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings (pp. 393-409). (Lecture Notes in Business Information Processing; Vol. 513). Springer. https://doi.org/10.1007/978-3-031-59465-6_24

Pastor Ricós, Fernando ; Marín, Beatriz ; Prasetya, I. S.W.B. et al. / An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. editor / João Araújo ; Jose Luis de la Vara ; Maribel Yasmina Santos ; Saïd Assar. Springer, 2024. pp. 393-409 (Lecture Notes in Business Information Processing).

@inproceedings{774f309e5dab4239b9adc3dca3ebe4ef,

title = "An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game",

abstract = "Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers{\textquoteright} work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.",

keywords = "Autonomous agents, BDD testing, Industrial game testing",

author = "{Pastor Ric{\'o}s}, Fernando and Beatriz Mar{\'i}n and Prasetya, {I. S.W.B.} and Vos, {Tanja E.J.} and Joseph Davidson and Karel Hovorka",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 18th International Conference on Research Challenges in Information Science, RCIS 2024 ; Conference date: 14-05-2024 Through 17-05-2024",

year = "2024",

month = may,

day = "2",

doi = "10.1007/978-3-031-59465-6_24",

language = "English",

isbn = "978-3-031-59464-9",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "393--409",

editor = "Jo{\~a}o Ara{\'u}jo and {de la Vara}, {Jose Luis} and Santos, {Maribel Yasmina} and Sa{\"i}d Assar",

booktitle = "Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings",

address = "Germany",

}

Pastor Ricós, F, Marín, B, Prasetya, ISWB, Vos, TEJ, Davidson, J & Hovorka, K 2024, An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. in J Araújo, JL de la Vara, MY Santos & S Assar (eds), Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. Lecture Notes in Business Information Processing, vol. 513, Springer, pp. 393-409, 18th International Conference on Research Challenges in Information Science, RCIS 2024, Guimarães, Portugal, 14/05/24. https://doi.org/10.1007/978-3-031-59465-6_24

An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. / Pastor Ricós, Fernando; Marín, Beatriz; Prasetya, I. S.W.B. et al.
Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. ed. / João Araújo; Jose Luis de la Vara; Maribel Yasmina Santos; Saïd Assar. Springer, 2024. p. 393-409 (Lecture Notes in Business Information Processing; Vol. 513).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game

AU - Pastor Ricós, Fernando

AU - Marín, Beatriz

AU - Prasetya, I. S.W.B.

AU - Vos, Tanja E.J.

AU - Davidson, Joseph

AU - Hovorka, Karel

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

PY - 2024/5/2

Y1 - 2024/5/2

N2 - Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers’ work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.

AB - Industrial-grade games, like Space Engineers, must adopt swift development and testing processes to conform to rigorous quality standards. Nevertheless, the testing phase of these extensive and complex games heavily relies on manual effort from play-testers, leading to productivity constraints during development cycles. This experience paper reports a Behavior-Driven-Development (BDD) software development process for automated regression test scenarios that allows complement testers’ work during development cycles. To enable BDD test scripts for the Space Engineers game, we have extended the iv4XR framework into a game plugin to connect and execute game actions. Additionally, we have integrated the Cucumber software to describe game test scenarios using natural language. This approach allows testers to create, maintain, and execute a subset of regression test scenarios by relying on a BDD agent that can autonomously verify Space Engineers game features, enabling seamless integration into the development cycle.

KW - Autonomous agents

KW - BDD testing

KW - Industrial game testing

UR - http://www.scopus.com/inward/record.url?scp=85193640837&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-59465-6_24

DO - 10.1007/978-3-031-59465-6_24

M3 - Conference contribution

AN - SCOPUS:85193640837

SN - 978-3-031-59464-9

T3 - Lecture Notes in Business Information Processing

SP - 393

EP - 409

BT - Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings

A2 - Araújo, João

A2 - de la Vara, Jose Luis

A2 - Santos, Maribel Yasmina

A2 - Assar, Saïd

PB - Springer

T2 - 18th International Conference on Research Challenges in Information Science, RCIS 2024

Y2 - 14 May 2024 through 17 May 2024

ER -

Pastor Ricós F, Marín B, Prasetya ISWB, Vos TEJ, Davidson J, Hovorka K. An Industrial Experience Leveraging the iv4XR Framework for BDD Testing of a 3D Sandbox Game. In Araújo J, de la Vara JL, Santos MY, Assar S, editors, Research Challenges in Information Science - 18th International Conference, RCIS 2024, Proceedings. Springer. 2024. p. 393-409. (Lecture Notes in Business Information Processing). doi: 10.1007/978-3-031-59465-6_24