Test Prioritization based on Change Sensitivity: an Industrial Case Study

Cu Nguyen; Paolo Tonella; Tanja Vos; Nelly Condori; Bilha Mendelson; Daniel Citron; Onn Shehory

Test Prioritization based on Change Sensitivity: an Industrial Case Study

Cu Nguyen, Paolo Tonella, Tanja Vos, Nelly Condori, Bilha Mendelson, Daniel Citron, Onn Shehory

Research output: Book/Report › Report › Academic

Abstract

In the context of service-based systems, applications access software services,
either home-built or third-party, to orchestrate their functionality. Since such services evolve independently from the applications, the latter need to be tested to make sure that they work properly with the updated or new services. In a previous work we have proposed a test prioritization approach that ranks test cases based on their sensitivity to external service changes. The idea is to give priority to the tests that detect the highest number of artificial
changes (mutations), because they have a higher chance of detecting real changes in external services. In this paper, we apply change-sensitivity based test prioritization to an industrial system from IBM within the FITTEST European project. Results indicate that the ranked test cases achieve automatically comparable performance as manual prioritization made by an experienced team.

Original language	English
Place of Publication	Utrecht
Publisher	UU BETA ICS Departement Informatica
Number of pages	13
Publication status	Published - 2014
Externally published	Yes

Publication series

Name	Technical Report Series / Department of Information and Computing Sciences Utrecht University
Publisher	UU Beta ICS Departement Informatica
No.	UU-CS-2014-012
ISSN (Print)	0924-3275

Keywords

Test Prioritization
Change Sensitivity

Access to Document

2014-012Final published version, 2.1 MB

Cite this

@book{42e2007468044016a22966b524c2f623,

title = "Test Prioritization based on Change Sensitivity: an Industrial Case Study",

abstract = "In the context of service-based systems, applications access software services,either home-built or third-party, to orchestrate their functionality. Since such services evolve independently from the applications, the latter need to be tested to make sure that they work properly with the updated or new services. In a previous work we have proposed a test prioritization approach that ranks test cases based on their sensitivity to external service changes. The idea is to give priority to the tests that detect the highest number of artificialchanges (mutations), because they have a higher chance of detecting real changes in external services. In this paper, we apply change-sensitivity based test prioritization to an industrial system from IBM within the FITTEST European project. Results indicate that the ranked test cases achieve automatically comparable performance as manual prioritization made by an experienced team.",

keywords = "Test Prioritization, Change Sensitivity",

author = "Cu Nguyen and Paolo Tonella and Tanja Vos and Nelly Condori and Bilha Mendelson and Daniel Citron and Onn Shehory",

year = "2014",

language = "English",

series = "Technical Report Series / Department of Information and Computing Sciences Utrecht University",

publisher = "UU BETA ICS Departement Informatica",

number = "UU-CS-2014-012",

}

TY - BOOK

T1 - Test Prioritization based on Change Sensitivity: an Industrial Case Study

AU - Nguyen, Cu

AU - Tonella, Paolo

AU - Vos, Tanja

AU - Condori, Nelly

AU - Mendelson, Bilha

AU - Citron, Daniel

AU - Shehory, Onn

PY - 2014

Y1 - 2014

N2 - In the context of service-based systems, applications access software services,either home-built or third-party, to orchestrate their functionality. Since such services evolve independently from the applications, the latter need to be tested to make sure that they work properly with the updated or new services. In a previous work we have proposed a test prioritization approach that ranks test cases based on their sensitivity to external service changes. The idea is to give priority to the tests that detect the highest number of artificialchanges (mutations), because they have a higher chance of detecting real changes in external services. In this paper, we apply change-sensitivity based test prioritization to an industrial system from IBM within the FITTEST European project. Results indicate that the ranked test cases achieve automatically comparable performance as manual prioritization made by an experienced team.

AB - In the context of service-based systems, applications access software services,either home-built or third-party, to orchestrate their functionality. Since such services evolve independently from the applications, the latter need to be tested to make sure that they work properly with the updated or new services. In a previous work we have proposed a test prioritization approach that ranks test cases based on their sensitivity to external service changes. The idea is to give priority to the tests that detect the highest number of artificialchanges (mutations), because they have a higher chance of detecting real changes in external services. In this paper, we apply change-sensitivity based test prioritization to an industrial system from IBM within the FITTEST European project. Results indicate that the ranked test cases achieve automatically comparable performance as manual prioritization made by an experienced team.

KW - Test Prioritization

KW - Change Sensitivity

M3 - Report

T3 - Technical Report Series / Department of Information and Computing Sciences Utrecht University

BT - Test Prioritization based on Change Sensitivity: an Industrial Case Study

PB - UU BETA ICS Departement Informatica

CY - Utrecht

ER -

Test Prioritization based on Change Sensitivity: an Industrial Case Study

Abstract

Publication series

Keywords

Access to Document

Fingerprint

Cite this