Artifact Page

"A Systematic Evaluation of API-Misuse Detectors"

Survey of Existing API-Misuse Detectors

Statistics about the evaluations done in previous work on API-misuse detection
Detector # of Evaluated Projects # of Reviewed Findings True-Positive Rate
PRMiner 3 Top 60 (overall) 10-27%
Colibri 5 - -
Jadet 5 Top 10 (per project) 0-13%
Chronicler 1 Example-based -
GrouMiner 9 Top 10 (per project) up to 12%
Acharya 3 - -
CARMiner 5 Top 10 (per project) 41-82%
Alattin 6 Top 10 (per project) 12-52%
Tikanga 6 Top 25% up to 6%
DMMC 1 19 84%
DroidAssist - - -

Experiments

Results of the review of the top-5% of 2854 threads about ConcurrentModificationException on StackOverflow:

Details about the MuBench dataset and the MuBenchPipe benchmarking infrastructure:

Full details and statistics about the experiments in this paper:


These files are made available for academic purposes only. Do not redistribute these files. Do not distribute direct links to these files, link to this page instead.

(this page was last updated at July 1, 2017)