A | P | Q | R | S | T | U | V | W | X | Y | Z | AA | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
3 | Agreements | Disagreements | Kappa Score | |||||||||||
4 | Ex.RUB | Yes | No | Total | Yes/No | No/Yes | Total | p0 | pYes | pNo | pe | Score | ||
5 | DMMC | 28 | 69 | 97 | 4 | 1 | 5 | 0.95 | 0.09 | 0.49 | 0.58 | 0.88 | ||
6 | GrouMiner | 84 | 41 | 125 | 3 | 6 | 9 | 0.93 | 0.44 | 0.12 | 0.55 | 0.85 | ||
7 | Jadet | 26 | 12 | 38 | 3 | 1 | 4 | 0.90 | 0.44 | 0.11 | 0.55 | 0.79 | ||
8 | Tikanga | 14 | 19 | 33 | 1 | 4 | 5 | 0.87 | 0.19 | 0.32 | 0.51 | 0.73 | ||
9 | MUDetect | 118 | 26 | 144 | 1 | 4 | 5 | 0.97 | 0.65 | 0.04 | 0.69 | 0.89 | ||
10 | ||||||||||||||
11 | Ex.P | |||||||||||||
12 | DMMC | 10 | 144 | 154 | 2 | 5 | 7 | 0.96 | 0.01 | 0.84 | 0.85 | 0.72 | ||
13 | GrouMiner | 2 | 150 | 152 | 2 | 2 | 4 | 0.97 | 0.00 | 0.95 | 0.95 | 0.49 | ||
14 | Jadet | 5 | 82 | 87 | 3 | 2 | 5 | 0.95 | 0.01 | 0.84 | 0.85 | 0.64 | ||
15 | Tikanga | 6 | 70 | 76 | 0 | 9 | 9 | 0.89 | 0.01 | 0.77 | 0.78 | 0.52 | ||
16 | MUDetect | 29 | 112 | 141 | 2 | 3 | 5 | 0.97 | 0.05 | 0.62 | 0.66 | 0.90 | ||
17 | MUDetectXP | 30 | 56 | 86 | 0 | 5 | 5 | 0.95 | 0.13 | 0.41 | 0.54 | 0.88 | ||
18 | ||||||||||||||
19 | Ex.R | |||||||||||||
20 | DMMC | 24 | 40 | 64 | 0 | 3 | 3 | 0.96 | 0.14 | 0.38 | 0.53 | 0.91 | ||
21 | GrouMiner | 7 | 11 | 18 | 0 | 0 | 0 | 1.00 | 0.15 | 0.37 | 0.52 | 1.00 | ||
22 | Jadet | 14 | 1 | 15 | 1 | 0 | 1 | 0.94 | 0.82 | 0.01 | 0.83 | 0.64 | ||
23 | Tikanga | 15 | 3 | 18 | 2 | 0 | 2 | 0.90 | 0.64 | 0.04 | 0.68 | 0.69 | ||
24 | MUDetect | 44 | 26 | 70 | 0 | 0 | 0 | 1.00 | 0.40 | 0.14 | 0.53 | 1.00 | ||
25 | MUDetectXP | 92 | 55 | 147 | 2 | 3 | 5 | 0.97 | 0.39 | 0.14 | 0.53 | 0.93 |