A Comparison on Similarity Distances and Prioritization Techniques for Early Fault Detection Rate


  • Safwan Abd Razak Faculty of Computing, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia.
  • Mohd Adham Isa Faculty of Computing, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia.
  • Dayang Norhayati Abang Jawawi Faculty of Computing, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia.


Product-Line Testing, Prioritization, Software Product Lines,


Nowadays, the Software Product Line (SPL) had replaced the conventional product development system. Many researches have been carried out to ensure the SPL usage prune the benefits toward the recent technologies. However, there are still some problems exist within the concept itself, such as variability and commonality. Due to its variability, exhaustive testing is not possible. Various solutions have been proposed to lessen this problem. One of them is prioritization technique, in which it is used to arrange back the test cases to achieve a specific performance goal. In this paper, the early fault detection is selected as the performance goal. Similarity function is used within our prioritization approach. Five different types of prioritization techniques are used in the experiment. The experiment results indicate that the greed-aided-clustering ordered sequence (GOS) shows the highest rate of early fault detection.


P. Clements, and L. Northrop, Software product lines: Practices and Patterns. USA: Addison-Wesley, 2002, pp. 5-6.

D. M. Weiss, “The Product Line Hall of Fame,” in Proceedings of the International Software Product Line Conference (SPLC), San Francisco, 2008, pp. 395-395.

G. Perrouin, S. Oster, S. Sen, J. Klein, B. Budry, and Y. le Traon, “Pairwise testing for software product lines: comparison of two approaches,” Software Quality Journal, vol. 20, no. 3-4, pp. 605-643, Sep. 2012.

C. Catal and D. Mishra, “Test case prioritization: a systematic mapping study,” Software Quality Journal, vol. 21, no. 3, pp. 445-478, Sep. 2013.

G. Rothermel, R. Untch, C. Chu, and M. Harrold, “Test case prioritization: An empirical study,” in Proceedings IEEE International Conference on Software Maintenance, Oxford, 1999, pp. 179-188.

H. Hemmati, and L. Briand, “An industrial investigation of similarity measures for model-based test case selection,” in Symposium IEEE 21st International on Software Reliability Engineering (ISSRE), San Jose, 2010, pp. 141-150.

M. Al-Hajjaji, T. Thüm, M. Lochau, J. Meinicke, and G. Saake, “Effective product-line testing using similarity-based product prioritization,” Software & Systems Modeling, vol. 16, pp. 1-23, Dec. 2016.

A. B. Sánchez, S. Segura, and A. Ruiz-Cortés, “A comparison of test case prioritization criteria for software product lines,” in Conference IEEE Seventh International Conference on Software Testing, Verification and Validation (ICST), Cleveland, 2014, pp. 41-50.

C. Fang, Z. Chen, K. Wu, and Z. Zhao, “Similarity-based test case prioritization using ordered sequences of program entities,” Software Quality Journal, vol. 22, no. 2, pp. 335-361, Jun 2014.

C. Henard, M. Papadakis, G. Perrouin, J. Klein, P. Heymans, and Y. Le Traon, “Bypassing the combinatorial explosion: Using similarity to generate and prioritize t-wise test configurations for software product lines,” IEEE Transactions on Software Engineering, vol. 40, no. 7, pp. 650-670, Jul 2014.

S. Elbaum, A. G. Malishevsky, and G. Rothermel, “Test case prioritization: A family of empirical studies,” IEEE transactions on software engineering, vol. 28, no. 2, pp. 159-182, Feb 2002.

C. Dietrich, R. Tartler, W. Schröder-Preikshat, and D. Lohmann, “Understanding linux feature distribution,” in Proceedings of the 2012 workshop on Modularity in Systems Software, Potsdam, 2012, pp. 15- 20.

X. Qu, M. B. Cohen, and K. M. Woolf, “Combinatorial interaction regression testing: A study of test case generation and prioritization,” in Conference IEEE International Conference on Software Maintenance (ICSM), Maison Internationale, 2007, pp. 255-264.

G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold, “Prioritizing test cases for regression testing,” IEEE Transactions on software engineering, vol. 27, no. 10, pp. 929-948, Oct 2001.

L. Zhang, D. Hao, L. Zhang, G. Rothermel, and H. Mei, “Bridging the gap between the total and additional test-case prioritization strategies,” in Proceedings of the 2013 International Conference on Software Engineering, San Francisco, 2013, pp. 192-201.

K. C. Kang, S. G. Cohen, J. A. Hess, W. E. Novak, and A. S. Peterson, Feature-oriented domain analysis (FODA) feasibility study. Pittsburgh, PA: Carnegie-Mellon University, 1990.

M. F. Johansen, Ø. Haugen, and F. Fleurey, “An algorithm for generating t-wise covering arrays from large feature models,” in Proceedings of the 16th International Software Product Line Conference, Salvador, 2012, pp. 46-55.

B. Jiang, Z. Zhang, W. K. Chan, and T. H. Tse, “Adaptive random test case prioritization,” in Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering, Auckland, 2009, pp. 233-244.




How to Cite

Abd Razak, S., Isa, M. A., & Abang Jawawi, D. N. (2017). A Comparison on Similarity Distances and Prioritization Techniques for Early Fault Detection Rate. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-3), 89–94. Retrieved from https://jtec.utem.edu.my/jtec/article/view/2883