Get certified in a few clicks: submit a pdf version of your research article (published article or working paper) as well as the numerical resources (data and/or code) needed to replicate your results. Indicate if these resources may be publicly disclosed, and choose the level of confidentiality that you want for the certification results. Requesting a certification only takes a few minutes.
The first step of our certification process consists in checking the conformity of your code/and data to our reproducibility guidelines. These recommendations aim to promote the reproducibility and dissemination of scientific results. They cover the presentation of data, the code structure, the version management, etc. (see to do list for certification). In case of non-conformity, we will take contact with you to ask for some changes in your code/and data.
If your code and data comply with our guidelines, they enter in a referee process. This process aims to ensure that the numerical results (tables and figures) reported in your scientific publication match the numerical results generated by your computer code and data. In case of perfect correspondence, your result is said to be reproducible.
Our certification involves a rigorous evaluation process made by a referee under the supervision of an editor. The referee may not be a specialist of your research field but he or she is a specialists of the software used to generate your numerical results.
The referee is in charge of running the code, comparing the numerical results in the article with those resulting from the code, and identifying potential discrepancies. These potential differences may have different sources, for instance: errors when reporting the results or constructing figures, rounding problems, issued of numerical convergence, use of different versions of the same software, difference in system environment, etc. Depending on the nature of these differences, the referee suggests a rating, from RRR (perfect: all tables and figures can be replicated precisely) to DD (serious discrepancies) and provides the editor with an execution report.