Skip to content

Open-science repo for our experimental results of automatic software repair on the Defects4J benchmark of Java bugs

Notifications You must be signed in to change notification settings

Spirals-Team/defects4j-repair

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Defects4j-Repair: open-science data for automatic repair on Defects4J

This repository contains the raw experimental results of the experiments done at INRIA Lille on the automatic repair of the bugs of the Defects4J dataset. They are discussed in Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset (Matias Martinez, Thomas Durieux, Romain Sommerard, Jifeng Xuan and Martin Monperrus), In Springer Empirical Software Engineering, 2016.

@article{martinez2016,
 title = {{Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset}},
 author = {Matias Martinez and Thomas Durieux and Romain Sommerard and Jifeng Xuan and Martin Monperrus},
 journal = {Springer Empirical Software Engineering},
 year = {2016},
 url = {https://hal.archives-ouvertes.fr/hal-01387556/document},
 doi = {10.1007/s10664-016-9470-4},
}

Warning: this repo contains more than 8GB of data.

Content of the repository

Repair results

Results of March 2017 on 395 bugs of Defects4j version 1.1.0 (all projects considered). See The Patches of the Nopol Automatic Repair System on the Bugs of Defects4J version 1.1.0

  • Nopol-SMT: 103 bugs repaired with one test-suite adequate patch
    • Chart: 9 bugs repaired with one test-suite adequate patch
    • Closure: 56 bugs repaired with one test-suite adequate patch
    • Lang: 4 bugs repaired with one test-suite adequate patch
    • Math: 24 bugs repaired with one test-suite adequate patch
    • Mockito: 2 bugs repaired with one test-suite adequate patch
    • Time: 8 bugs repaired with one test-suite adequate patch

Results of August 2015 on 224 bugs of Defects4j version 0.1.0 (minus the Clojure bugs, discarded), used for Automatic Repair of Real Bugs in Java: A Large-Scale Experiment on the Defects4J Dataset

  • Nopol: 35 bugs with one test-suite adequate patch
  • jGenprog/Astor: 27 bugs with one test-suite adequate patch
  • jKali: 22 bugs with one test-suite adequate patch
  • Total: 47/224 bugs (20%) with at least one test-suite adequate patch

Results of May 2015, used for for Automatic Repair of Real Bugs: An Experience Report on the Defects4J Dataset, Technical report 1505.07002, Arxiv, 2015.

Branches for each Defects4j bug

The master branch contains the repair results. There is also one branch per buggy version of Defects4j, for instance https://github.com/Spirals-Team/defects4j-repair/tree/Time9 contains the buggy version of Time 9.

See https://github.com/Spirals-Team/defects4j-repair/branches for all branches

Scripts

https://github.com/Spirals-Team/defects4j-repair/tree/master/src contains scripts we use to run the repair tools on all bugs.

About

Open-science repo for our experimental results of automatic software repair on the Defects4J benchmark of Java bugs

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published