Software Testing, Verification and Reliability 20 (2): 89-120 (2010) |
W.K. Chan 2 , Jeffrey C.F. Ho 3 , and T.H. Tse 4
[paper from Wiley InterScience | technical report TR-2009-03]
ABSTRACT |
Mesh simplification programs create three-dimensional polygonal
models similar to an original polygonal model, and yet use fewer polygons.
They produce different graphics even though they are based on the
same original polygonal model.
This results in a test oracle problem.
To address the problem, our previous work has developed a technique
that uses a reference model of the program under test to train a classifier.
Using such an approach may mistakenly mark a failure-causing test
case as passed.
It lowers the testing effectiveness of revealing failures.
This paper suggests piping the test cases marked as passed by a
statistical pattern classification module to an analytical metamorphic
testing module.
We evaluate our approach empirically using three subject programs
with over 2700 program mutants.
The result shows that, using a resembling reference model to train
a classifier, the integrated approach can significantly improve the
failure detection effectiveness of the pattern classification approach.
We also explain how metamorphic testing in our design trades
specificity for sensitivity.
Keywords: test oracle problem, mesh simplification, non-testable software, metamorphic testing, classification, testing methodology. |
|
EVERY VISITOR COUNTS: |