Budget-aware random testing with T3: benchmarking at the SBST2016 testing tool contest

S.W.B. Prasetya

doi:10.1145/2897010.2897019

Budget-aware random testing with T3: benchmarking at the SBST2016 testing tool contest

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

Abstract

Random testing has the advantage that it is usually fast. An interesting use case is to use it for bulk smoke testing, e.g. to smoke test a whole project. However, on a large project, even with random testing it may still take hours to complete. To optimize this, we have adapted an automated random testing tool called T3 so that it becomes aware of the time budget we set for a given target class. Test suites are now generated incrementally, and their refinements are adaptively scheduled towards maximizing the coverage, given the remaining time. This paper presents an evaluation of the performance of this adaptation, using the benchmark provided by the SBST 2016 Java Unit Testing Tool Contest.

Original language	English
Title of host publication	SBST '16: Proceedings of the 9th International Workshop on Search-Based Software Testing
Subtitle of host publication	Austin, Texas — May 14 - 22, 2016
Publisher	Association for Computing Machinery
Pages	29-32
ISBN (Print)	978-1-4503-4166-0
DOIs	https://doi.org/10.1145/2897010.2897019
Publication status	Published - 2016

Access to Document

10.1145/2897010.2897019

prasetyaFinal published version, 354 KB

http://dl.acm.org/citation.cfm?id=2897019

Cite this

@inproceedings{ad79a0de0c614fef9e1290697d7f9750,

title = "Budget-aware random testing with T3: benchmarking at the SBST2016 testing tool contest",

abstract = "Random testing has the advantage that it is usually fast. An interesting use case is to use it for bulk smoke testing, e.g. to smoke test a whole project. However, on a large project, even with random testing it may still take hours to complete. To optimize this, we have adapted an automated random testing tool called T3 so that it becomes aware of the time budget we set for a given target class. Test suites are now generated incrementally, and their refinements are adaptively scheduled towards maximizing the coverage, given the remaining time. This paper presents an evaluation of the performance of this adaptation, using the benchmark provided by the SBST 2016 Java Unit Testing Tool Contest.",

author = "S.W.B. Prasetya",

year = "2016",

doi = "10.1145/2897010.2897019",

language = "English",

isbn = "978-1-4503-4166-0",

pages = "29--32 ",

booktitle = "SBST '16: Proceedings of the 9th International Workshop on Search-Based Software Testing",

publisher = "Association for Computing Machinery",

}

Budget-aware random testing with T3: benchmarking at the SBST2016 testing tool contest. / Prasetya, S.W.B.
SBST '16: Proceedings of the 9th International Workshop on Search-Based Software Testing: Austin, Texas — May 14 - 22, 2016 . Association for Computing Machinery, 2016. p. 29-32 .

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Budget-aware random testing with T3: benchmarking at the SBST2016 testing tool contest

AU - Prasetya, S.W.B.

PY - 2016

Y1 - 2016

N2 - Random testing has the advantage that it is usually fast. An interesting use case is to use it for bulk smoke testing, e.g. to smoke test a whole project. However, on a large project, even with random testing it may still take hours to complete. To optimize this, we have adapted an automated random testing tool called T3 so that it becomes aware of the time budget we set for a given target class. Test suites are now generated incrementally, and their refinements are adaptively scheduled towards maximizing the coverage, given the remaining time. This paper presents an evaluation of the performance of this adaptation, using the benchmark provided by the SBST 2016 Java Unit Testing Tool Contest.

AB - Random testing has the advantage that it is usually fast. An interesting use case is to use it for bulk smoke testing, e.g. to smoke test a whole project. However, on a large project, even with random testing it may still take hours to complete. To optimize this, we have adapted an automated random testing tool called T3 so that it becomes aware of the time budget we set for a given target class. Test suites are now generated incrementally, and their refinements are adaptively scheduled towards maximizing the coverage, given the remaining time. This paper presents an evaluation of the performance of this adaptation, using the benchmark provided by the SBST 2016 Java Unit Testing Tool Contest.

U2 - 10.1145/2897010.2897019

DO - 10.1145/2897010.2897019

M3 - Conference contribution

SN - 978-1-4503-4166-0

SP - 29

EP - 32

BT - SBST '16: Proceedings of the 9th International Workshop on Search-Based Software Testing

PB - Association for Computing Machinery

ER -

Budget-aware random testing with T3: benchmarking at the SBST2016 testing tool contest

Abstract

Access to Document

Fingerprint

Cite this