1. What are the contributions in this paper?
In this paper, the authors not only propose a new family of coverage-based ART techniques, but also show empirically that they are statistically superior to the RT-based technique in detecting faults.. Furthermore, one of the ART prioritization techniques is consistently comparable to some of the best coverage-based prioritization techniques ( namely, the “ additional ” techniques ) and yet involves much less time cost.
read more
2. What are the future works in this paper?
The authors plan to study the “ reset ” concept on top of the ART techniques and explore their effectiveness in future work.. The authors further use hypothesis testing to compare their means and confirm that ART-brmaxmin is comparable to the total statement and total branch techniques and better than the total function technique for Siemens programs, as shown in Figure 8, and that ART-br-maxmin performs significantly better than any total technique on UNIX programs, as shown in Figure 9.. Pr og ra m sc he du le sc he du le 2 tc as to t-i nf o re pl ac e pr in t_ to ke ns pr in t_ to ke ns 2 gz ip se d fle x gr ep random 0. 01 0. 01 0. 01 0. 01 0. 01 0. 01 0. 01 0. 01 0. 01 0. 01 0. 01 addtl-br 0. 17 3. 95 2. 55 3. 44 7. 79 10. 98 12. 38 13. 91 1. 39 6. 71 7. 54 addtl-fn 0. 28 4. 70 3. 94 4. 85 8. 91 20. 52 17. 61 19. 79 1. 78 6. 49 6. 97 addtl-st 0. 45 7. 04 5. 27 8. 87 15. 61 22. 44 25. 97 43. 28 2. 79 22. 87 21. 72 total-br 0. 01 0. 08 0. 05 0. 05 0. 12 0. 24 0. 24 0. 71 0. 12 0. 48 0. 69 total-fn 0. 01 0. 03 0. 02 0. 03 0. 05 0. 07 0. 09 0. 03 0. 00 0. 03 0. 03 total-st 0. 02 0. 16 0. 14 0. 18 0. 49 0. 43 0. 59 2. 44 0. 31 1. 88 1. 84 ART-brmaxmin 0. 08 0. 58 0. 48 0. 47 1. 18 2. 40 2. 83 1. 15 0. 12 0. 61 0. 89 ART-brmaxavg 0. 07 0. 55 0. 50 0. 50 1. 24 2. 68 3. 10 1. 50 0. 15 0. 77 1. 11 ART-brmaxmax 0. 07 0. 60 0. 44 0. 49 1. 11 2. 32 2. 72 1. 15 0. 12 0. 59 0. 88 ART-fnmaxmin 0. 03 0. 27 0. 19 0. 25 0. 65 0. 75 1. 07 0. 48 0. 01 0. 12 0. 21 ART-fnmaxavg 0. 04 0. 33 0. 20 0. 31 0. 69 0. 83 1. 14 0. 49 0. 01 0. 13 0. 22 ART-fnmaxmax 0. 04 0. 31 0. 19 0. 31 0. 69 0. 83 1. 08 0. 48 0. 01 0. 13 0. 21 ART-stmaxmin 0. 11 1. 25 0. 87 1. 30 2. 61 4. 26 5. 77 2. 78 0. 31 1. 88 2. 02 ART-stmaxavg 0. 10 1. 33 1. 01 1. 35 2. 94 4. 32 7. 30 3. 94 0. 36 2. 46 2. 61 ART-stmaxmin 0. 11 1. 23 0. 80 1. 24 2. 59 3. 86 5. 44 2. 84 0. 31 1. 86 2. 04 Mean 0. 10 1. 40 1. 04 1. 48 2. 92 4. 81 5. 46 5. 94 0. 49 2. 94 3. 06 One may further observer from Figure 5 and Figure 6 that ART-br-maxmin does not seem to perform as good as the additional techniques on both Siemens and UNIX programs.. In this section, the authors further analyze the time cost of ART prioritization techniques and compare them with coverage-based techniques to help guide practical use.
read more





