29  Testing the paper

After examining the hypothesis, design, materials and analysis, you are ready to test your understanding of the paper and assess its likelihood of replication. This review may inform whether you proceed with the replication or whether design changes are required. Checklists can help structure that process.

29.1 REAPPRAISED checklist

The “REAPPRAISED” checklist developed by (Grey et al., 2020) focuses on indicators of potential misconduct. Depending on the pedigree of the paper, not all questions will be relevant, but it provides a structured set of prompts.

• Download the REAPPRAISED checklist

29.2 TIDieR checklist

(Hoffmann and Others, 2014) created the Template for Intervention Description and Replication (TIDieR) checklist and guide. Although developed for medical contexts, the questions translate well across experimental domains and help ensure that your own replication is described clearly.

• Download the TIDieR checklist

29.3 Quality of Survey Studies in Psychology (QSSP)

(Protogerou and Hagger, 2020) provide a checklist for assessing survey studies. The template is available on OSF and is useful when the original work relies on survey methods.

Use these tools as needed—they are aids rather than requirements.

Grey, A., Bolland, M., Dalbeth, N., Gamble, G., and Sadler, L. (2020). Check for publication integrity before misconduct. Nature, 577, 167–169. https://doi.org/10.1038/d41586-019-03959-6

Hoffmann, T. C., and Others. (2014). Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ, 348, g1687. https://doi.org/10.1136/bmj.g1687

Protogerou, C., and Hagger, M. S. (2020). A checklist to assess the quality of survey studies in psychology. Methods in Psychology, 3, 100031. https://doi.org/10.1016/j.metip.2020.100031