replicability-training
Training for assessing replicability
View the Project on GitHub labordynamicsinstitute/replicability-training
TRAINING For Reproducibility Verification
❗If you are looking for the Summer 2024 intership with the AEA Data Editor, please have a look here. This page is for Cornell-based students applying to work with the AEA Data Editor.
Training will occur mostly virtually, through a combination of required self-study and live Zoom meetings.
- The live part of the training will take place on Day 1 in person (no exceptions). Additional meetings will happen on the following days using Zoom.
- If your application to the LDI Replication Lab was accepted, you will be receiving information soon.
- Training is open to anybody, for free, but employment is only based on invitation after application.
- All the remaining information here is open to anybody.
- Content is
.
General Training Schedule
Training happens three times a year:
- week prior to start of Fall classes (around Aug 16)
- week prior to start of Spring classes (around Jan 17)
- sometime prior to May exams (around April 22)
Day 1 is always a full day of training, and may occur on a weekend.
No training in April - next training will be in August 2024.
Applying
Applications are open approximately 4-6 weeks prior to the training day, and close approximately 10 days prior to the training day. For more information, see https://www.ilr.cornell.edu/labor-dynamics-institute/student-employment-opportunities.
Prior to Training
Please have a look at the list of tasks that should be accomplished before the first meeting.
Tentative Agenda
The training will start with an intensive (in person) day of lectures/discussions, followed by exercises that you will do on your own, with daily touch-base meetings over Zoom.
Items that are bolded are live meetings. Items that are italicized are in informal groups with peers, but live (in person or on Zoom). Other items are on your own time, but the time slot is the suggested time you should be doing them.
If you have not received an invitation and you think you should have, contact LDI (ldi@cornell.edu).
| Time | August, 2024 (Location: TBD) |
|---|---|
| 8:00 | Breakfast |
| 9:00 | Introduction |
| 10:00 | Reproducible Practices, Template README |
| 11:00 | Data provenance, Data Citations |
| 12:00 | Lunch Break |
| 13:00 | What will you be doing in the Lab |
| 14:00 | Command Line/Git |
| 15:00 | A prototypical replication report |
| 16:00 | A walkthrough of the Workflow |
| 17:00 | How to run Stata |
| 18:00 | End |
- as needed: Email questions
Test cases and peer mentoring
Tentative Scheduled days:
- Day 1:
- Day 2:
- Day 3:
- Day 4:
Test cases
Test cases are worked through, and jointly handled, including with repeated peer mentoring by senior (experienced) RAs in the Lab. Three (non-consecutive) days are set aside for the peer-mentoring and walk-throughs, but work on these test cases can be done any time (adapted to individual class and exam schedules). We strongly suggest doing these immediately after the in-person training, however, as experience has shown that those who delay too long will ultimately struggle later in their work.
- each test article should take you no more than 5 hours of work (decreasing as you progress)
- Test article 1: Data is available, Stata
- Test article 2: No data is available, only “dry” analysis
- Test article 3: Data is available, Matlab
Live Peer group mentoring with existing replicators
- Day 1, 17:30 (second test article) (Zoom) (TBD)
- Day 2, 17:30 (third test article) (Zoom) (TBD)
- Day 3, 17:30 (general Q&A) (Zoom) (TBD)
Schedule
| Time | Day 1 (Zoom) | Day 2 (Zoom) | Day 3 (Zoom) | Day 4 |
|---|---|---|---|---|
| 8:00-9:00 | Start on first article (Zoom) | Follow-up on first test article, discuss second article | Follow-up on second test article, third test article | Follow-up on all test articles Wrap-up of training, next steps (Zoom) |
| (self-paced) | Work on first test article | Work on second article | Work on third article | |
| 17:30- 18:30 | Introduce second test article (Peer mentoring) |
Introduce third test article (Peer mentoring) |
General questions (Peer mentoring) |
|
| Finish first test article | Finish second test article | Finish third test article |
April trainees will join the regular Lab meeting once they start in May. Details will be posted closer to the dates.
Full Training Materials
Please go to https://labordynamicsinstitute.github.io/ldilab-manual/ for the full training materials.