January 26, 2024

Episode 26: Vocans Ictus Tuos - Pars I

1 hour 1 minute

In this two part episode we discuss the fine art of preregistration. We go back into the history of preregistration, its evolution, and current use. Do we preregister to control the Type 1 error rate, or to show that we derived our prediction from theory a priori? Can and should we preregister exploratory or secondary data analysis? And how severe is the issue of severe testing?

Shownotes

ClinicalTrials.gov

You can preregister on AsPredicted and the OSF

Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44.

SPIRIT Checklist

Bishop, D. V. M. (2018). Fallibility in Science: Responding to Errors in the Work of Oneself and Others. Advances in Methods and Practices in Psychological Science, 1(3), 432–438. https://doi.org/10.1177/2515245918776632

FDA trials tracker: https://fdaaa.trialstracker.net

Ensinck, E., & Lakens, D. (2023). An Inception Cohort Study Quantifying How Many Registered Studies are Published. PsyArXiv. https://doi.org/10.31234/osf.io/5hkjz

van den Akker, O. R., van Assen, M. A. L. M., Enting, M., de Jonge, M., Ong, H. H., Rüffer, F., Schoenmakers, M., Stoevenbelt, A. H., Wicherts, J. M., & Bakker, M. (2023). Selective Hypothesis Reporting in Psychology: Comparing Preregistrations and Corresponding Publications. Advances in Methods and Practices in Psychological Science, 6(3), 25152459231187988. https://doi.org/10.1177/25152459231187988

Claesen, A., Gomes, S., Tuerlinckx, F., & Vanpaemel, W. (2021). Comparing dream to reality: An assessment of adherence of the first generation of preregistered studies. Royal Society Open Science, 8(10), 211037. https://doi.org/10.1098/rsos.211037

Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66(6), 423–437. https://doi.org/10.1037/h0020412

Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts.

Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44.

de Groot, A. D. (1969). Methodology. Mouton & Co.

Claesen, A., Lakens, D., Vanpaemel, W., & Dongen, N. van. (2022). Severity and Crises in Science: Are We Getting It Right When We’re Right and Wrong When We’re Wrong? PsyArXiv. https://doi.org/10.31234/osf.io/ekhc8

...more

View all episodes

By Smriti Mehta and Daniël Lakens

1010 ratings

January 26, 2024

Episode 26: Vocans Ictus Tuos - Pars I

1 hour 1 minute

Shownotes

ClinicalTrials.gov

You can preregister on AsPredicted and the OSF

Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44.

SPIRIT Checklist

FDA trials tracker: https://fdaaa.trialstracker.net

Ensinck, E., & Lakens, D. (2023). An Inception Cohort Study Quantifying How Many Registered Studies are Published. PsyArXiv. https://doi.org/10.31234/osf.io/5hkjz

Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66(6), 423–437. https://doi.org/10.1037/h0020412

Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts.

Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44.

de Groot, A. D. (1969). Methodology. Mouton & Co.

...more