Experiment 3: Benchmark

Detector: Tikanga

Project Version Result # of Findings Runtime Misuse Violation Types Decision Reviews Your Review Your Comment Tags

aclang

587

success

0

34.6

s

1

  • missing/condition/null_check
view

2

  • missing/condition/null_check
view

acmath

998

success

17

55.9

s

1

  • missing/condition/null_check
view

2

  • missing/condition/null_check
view

adempiere

1312

success

0

89.6

s

1

  • missing/call
  • superfluous/call
view

2

  • missing/call
  • superfluous/call
view

alibaba-druid

e10f28

success

5

41.6

s

1

  • missing/call
view

2

  • missing/exception handling
view

closure

114

success

24

42.7

s

1

  • superfluous/condition/null_check
view

319

success

45

42.5

s

2

  • missing/exception handling
view

dmmc-1023

  • missing/condition/value_or_state
view

dmmc-13

  • missing/condition/value_or_state
view

tikanga-2

  • missing/condition/value_or_state
view

tikanga-6

  • missing/condition/value_or_state
view

884

success

33

67.2

s

3

  • missing/condition/null_check
view

httpclient

302

success

0

12.3

s

1

  • missing/call
view

444

success

0

12.0

s

2

  • missing/call
view

3

  • missing/call
view

452

success

0

11.6

s

4

  • missing/call
  • superfluous/call
view

itext

5091

success

55

78.8

s

1

  • missing/exception handling
view

dmmc-15

  • missing/condition/value_or_state
view

dmmc-16

  • missing/condition/value_or_state
view

dmmc-18

  • missing/condition/value_or_state
view

dmmc-357

  • missing/condition/value_or_state
view

dmmc-61

  • missing/condition/value_or_state
view

dmmc-937

  • missing/condition/value_or_state
view

jadet-5

  • missing/condition/value_or_state
view

jadet-9

  • missing/condition/value_or_state
view

jackrabbit

1601

success

22

36.1

s

1

  • missing/condition/null_check
view

1678

success

0

8.3

s

2

  • missing/condition/null_check
view

1694

success

22

34.2

s

3a

  • missing/call
view

3b

  • missing/call
view

1750

success

8

21.1

s

5

  • missing/call
view

jfreechart

1025

success

93

38.0

s

1

  • missing/call
view

103

success

88

32.7

s

2

  • missing/condition/null_check
view

164

success

90

34.1

s

3a

  • missing/condition/null_check
view

3b

  • missing/condition/null_check
view

4a

  • missing/condition/null_check
view

4b

  • missing/condition/null_check
view

2183

success

100

37.4

s

5

  • missing/condition/null_check
view

2266

success

102

40.1

s

6

  • missing/condition/null_check
  • superfluous/condition/null_check
view

881

success

93

34.0

s

7a

  • missing/condition/null_check
view

7b

  • missing/condition/null_check
view

jmrtd

51

success

0

4.8

s

1

  • missing/call
view

67

success

0

5.5

s

2

  • missing/condition/value_or_state
view

jodatime

1231

success

0

1.5

s

1

  • missing/condition/null_check
view

lucene

1251

success

0

19.8

s

1

  • missing/exception handling
view

1918

success

4

26.3

s

2

  • missing/exception handling
view

tikanga-0

  • missing/condition/value_or_state
view

tikanga-1

  • missing/condition/value_or_state
view

207

success

0

11.5

s

3

  • missing/condition/value_or_state
view

754

success

0

14.8

s

5

  • missing/condition/value_or_state
view

rhino

286251

error

0

316.9

s

1

  • superfluous/call/duplicate
view