Below we’ve listed all sorts of rigor- and reproducibility-related tools along with a link to a relevant tutorial, a note as to whether the tool is free or commercial, and the specific part of the research process you might find them most useful for — be sure to check them out and spread the word! (version 0.1)
Tool | Tutorial | Description | Application | Open Source | Price |
---|---|---|---|---|---|
GPower | YouTube | Facilitates power analysis to calculate appropriate sample size for given study. | Study Design, Sample Sizes | ✘ | Free |
PubPeer | YouTube | Facilitates discussion of rigor, reproducibility, and any other potential issues of any given published paper. | Literature review | ✘ | Free |
Scite.ai | YouTube | AI-driven citation, literature review, and reference checking tool. | Literature review | ✘ | Paid |
SciScore | Automated methods review tool for scientific articles. | Literature review | ✘ | Paid | |
Limitation Recognizer | Automatically recognizes self-acknowledged limitation sentences in biomedical articles | Literature review | ✓ | Free | |
AMSTAR 2 | YouTube | Critical appraisal tool for systematic reviews. | Literature review | ✘ | Free |
DMPTool | YouTube | Tool to create data management plans, also offers resources and services available at participating institutions to help fulfill data management requirements. | Study Design | ✘ | Free |
LabArchives | YouTube | Commercial line of electronic laboratory notebooks. | Study Design, Data analysis, Reproducibility | ✘ | Paid |
StatXFinder | — | Decision support tool for appropriate statistical test selection. | Study Design, Data Analysis | ✘ | Free |
DAGitty | RPubs, YouTube | Browser-based environment for creating, editing, and analyzing causal diagrams. | ✓ | Free | |
Fiddle | — | Match-making tool that aids in publishing of data/information that is difficult to publish in traditional journals. | Open Science | ✓ | Free |
Git | YouTube | Distributed version control system that tracks changes in any set of computer files. | Version Control | ✓ | Free |
Github | YouTube | Hosting service for software development and version control using Git. | Version Control, Open Science | ✘ | Free |
JupyterLab | YouTube | Web-based interactive development environment for notebooks, code, and data. | Open Science, Reproducibility | ✓ | Free |
Jupyter Notebook | YouTube | Web application for creating and sharing computational documents. | Open Science, Reproducibility | ✓ | Free |
JupyterHub | YouTube | Multi-user version of Jupyter Notebook designed for companies, classrooms and research labs | Open Science, Reproducibility | ✓ | Free |
Voilà | Converts Jupyter Notebooks into interactive dashboards for data sharing purposes. | Open Science, Reproducibility | ✓ | Free | |
Stan | TDS, YouTube | Platform for statistical modeling and high-performance statistical computation. | Data Analysis | ✓ | Free |
ARRIVE | Checklist of information to include in publications describing animal research. | Open Science, Reproducibility | — | Free | |
rtransparent | Generates statements on conflicts of interest, funding, or protocol registration. | Open Science | ✓ | Free | |
ODDPub | Screens papers for Open Data practices. | Open Science | ✓ | Free | |
JetFighter | Screens preprints to improve data representation and color-blind accessibility. | Accessibility | ✓ | Free | |
Barzooka | Checks for bar graphs of continuous data. | ✓ | Free | ||
Seek & Blastn | Correct identification of nucleotide sequences. | Reproducibility, Open Science | ✘ | Free | |
TRNScreener | Automatically checks clinical trial registration numbers from ClinicalTrials.gov. | Literature review, Reproducibility | ✓ | Free | |
Open Research Cal | Public calendar of open science events and meetings. | Open Science | ✓ | Free |