Pre-registration: A Tool for Improving Transparency and Replicability of our Science
University of Toronto Social Science Methods Week 2022
1 pm to 4 pm, April 26 (Tue), Zoom
Details and registration: https://sociology.utoronto.ca/events-2-2/university-of-toronto-social-science-methods-week/university-of-toronto-social-science-methods-week-2022/
The replication crisis and the subsequent meta-science movement suggest that the replicability of published findings is not ideal. One of the key causes to the replication crisis is related to questionable research practices. For example, p-hacking, cherry-picking, and data dredging refer to practices where researchers selectively report significant results after conducting many statistical tests. To address this, meta-scientists have proposed pre-registration – the pre-specification of data collection and analytical plan prior to implementing a study – as a potential solution. In this workshop, I will overview the advantages of pre-registration, address common criticisms of pre-registration, introduce the components in a pre-registration, outline the steps to pre-register a study on Open Science Framework, and discuss how to write up a pre-registered study. To reach a wider audience, I will also discuss the different considerations in studies using primary data (i.e., data that your research team collects) and secondary data (i.e., existing data). Researchers at all levels who conduct studies using quantitative methods are welcome to attend. To get the most out of this workshop, you are especially encouraged to prepare a soon-to-be-implemented and original study idea so we can try pre-registering your study together!
Doing Open and Replicable Science
Canadian Centre for Research Analysis and Methods Sessions 2022
Two-day course (June 23-24), in-person at the University of Calgary, downtown campus
Details and registration: https://www.ucalgary.ca/news/canadas-top-quantitative-methodologists-coming-calgary-offer-person-training-researchers
Transparency and replicability are cornerstones of science. In 2015, a landmark study showed that only 39% of published studies are replicable by independent teams of researchers. Since then, there have been major advances in doing more open and replicable science. Transparency in study planning, analytical codes, and research materials facilitate independent verifications of a study. Improving replicability of research means that we can have stronger confidence in making decisions based on empirical findings. This short course will cover how to do open and replicable science.