Training for assessing replicability

View the Project on GitHub labordynamicsinstitute/replicability-training

TRAINING For Reproducibility Verification

GitHub issues GitHub last commit

If you are looking for the Summer 2024 intership with the AEA Data Editor, please have a look here. This page is for Cornell-based students applying to work with the AEA Data Editor.

Training will occur mostly virtually, through a combination of required self-study and live Zoom meetings.

  • The live part of the training will take place on Day 1 in person (no exceptions). Additional meetings will happen on the following days using Zoom.
  • If your application to the LDI Replication Lab was accepted, you will be receiving information soon.
  • Training is open to anybody, for free, but employment is only based on invitation after application.
  • All the remaining information here is open to anybody.
  • Content is License: CC BY-NC 4.0.

General Training Schedule

Training happens three times a year:

Day 1 is always a full day of training, and may occur on a weekend.

No training in April - next training will be in August 2024.


Applications are open approximately 4-6 weeks prior to the training day, and close approximately 10 days prior to the training day. For more information, see

Prior to Training

Please have a look at the list of tasks that should be accomplished before the first meeting.

Tentative Agenda

The training will start with an intensive (in person) day of lectures/discussions, followed by exercises that you will do on your own, with daily touch-base meetings over Zoom.

Items that are bolded are live meetings. Items that are italicized are in informal groups with peers, but live (in person or on Zoom). Other items are on your own time, but the time slot is the suggested time you should be doing them.

If you have not received an invitation and you think you should have, contact LDI (

Time August, 2024 (Location: TBD)
8:00 Breakfast
9:00 Introduction
10:00 Reproducible Practices, Template README
11:00 Data provenance, Data Citations
12:00 Lunch Break
13:00 What will you be doing in the Lab
14:00 Command Line/Git
15:00 A prototypical replication report
16:00 A walkthrough of the Workflow
17:00 How to run Stata
18:00 End

Test cases and peer mentoring

Tentative Scheduled days:

Test cases

Test cases are worked through, and jointly handled, including with repeated peer mentoring by senior (experienced) RAs in the Lab. Three (non-consecutive) days are set aside for the peer-mentoring and walk-throughs, but work on these test cases can be done any time (adapted to individual class and exam schedules). We strongly suggest doing these immediately after the in-person training, however, as experience has shown that those who delay too long will ultimately struggle later in their work.

Live Peer group mentoring with existing replicators


Time Day 1 (Zoom) Day 2 (Zoom) Day 3 (Zoom) Day 4
8:00-9:00 Start on first article (Zoom) Follow-up on first test article, discuss second article Follow-up on second test article, third test article Follow-up on all test articles
Wrap-up of training, next steps (Zoom)
(self-paced) Work on first test article Work on second article Work on third article  
17:30- 18:30 Introduce second test article
(Peer mentoring)
Introduce third test article
(Peer mentoring)
General questions
(Peer mentoring)
  Finish first test article Finish second test article Finish third test article  

April trainees will join the regular Lab meeting once they start in May. Details will be posted closer to the dates.

Full Training Materials

Please go to for the full training materials.