Proceedings of the 9th International Conference on Quality Software (QSIC '09),
IEEE Computer Society Press, Los Alamitos, CA, pp. 21-30 (2009)

Tag-Based Techniques for
Black-Box Test Case Prioritization for Service Testing

Lijun Mei 2 , W.K. Chan 3 , T.H. Tse 2 , and Robert G. Merkel 4

[paper from IEEE Xplore | paper from IEEE digital library | technical report TR-2009-16]


A web service may evolve autonomously, making peer web services in the same service composition uncertain as to whether the evolved behaviors may still be compatible to its originally collaborative agreement. Although the peer services may wish to conduct regression testing to verify the original collaboration, the source code of the former service can be inaccessible to them. Traditional code-based regression testing strategies are inapplicable. The rich interface specifications of a web service, however, provide peer services with a means to formulate black-box testing strategies. In this paper, we formulate new test case prioritization strategies using tags embedded in XML messages to reorder regression test cases, and reveal how the test cases use the interface specifications of services. We evaluate experimentally their effectiveness on revealing regression faults in modified WS-BPEL programs. The results show that the new techniques can match the fault-detection rates of their white-box counterparts.

Keywords: test case prioritization, black-box regression testing, WS-BPEL, service testing, encapsulation testing

1. This work is supported in part by the General Research Fund of the Research Grant Council of Hong Kong (project nos. 111107, 717308, and 717506) and a discovery grant of the Australian Research Council (project no. DP0984760).
2. Department of Computer Science, The University of Hong Kong, Pokfulam, Hong Kong.
3. (Corresponding author.)
Department of Computer Science, City University of Hong Kong, Tat Chee Avenue, Hong Kong.
4. Centre for Software Analysis and Testing, Swinburne University of Technology, Hawthorn 3122, Australia.


  Cumulative visitor count