ReproducibiliTea Podcast

Episode 19 - Katie Drax

Introducing Katie Drax! an upcoming force in open and reproducible research!

Katie is leading MAPS: Mapping the Analytical PathS of a crowdsourced data analysis. Katie also leads the Bristol branch of the ReproducibiliTea Journal Club - with much more success in cataloging the JC than we manage. Katie also has some great advice for ECRs on their open science journey. We hope you enjoy listening as much as we did.

Katie's twitter: @katiedrax

MAPS: https://osf.io/9qke2/

ALSPAC study: http://www.bristol.ac.uk/alspac/

Music credit: Be Jammin - Alexander Nakarada

freepd.com/world.php

Episode 18 - Hannah Hobson

Meet Dr. Hannah Hobson, a true Registered Reports pioneer! Hannah was one of the early adopters of the registered report format, and during her PhD no less. We had to speak to her and hear her unique perspective on this research publication format.

Highlights and links:

Hannah's Mu registered report (https://www.sciencedirect.com/science/article/pii/S0010945216300570) (Sam highly recommends looking at the power analysis section as a good detailed example of how it's done)

The registered reports page on Centre for Open Science (https://cos.io/rr/)

Sarah Peters blogpost on why she took part in the preregistration challenge (https://targ.blogs.bristol.ac.uk/2018/01/08/why-i-took-part-in-the-preregistration-challenge/)

A manifesto for reproducible science (https://www.nature.com/articles/s41562-016-0021)

Amy's Specification Curve Analysis paper (https://www.amyorben.com/pdf/2019_orbenprzybylski_nhb.pdf)

Music credit:

Kevin MacLeod - Funkeriffic

Episode 17 - Lisa Spitzer And Tobias Heycke

This week we have two special guests, two more awesome ECRs we want you to meet! Lisa Spitzer (@Lisa__Spitzer) and Tobias Heycke (@TobiasHeycke) discuss their project with us - using screen recordings of computerised experimental procedures to assist with reproducibility.

Check out Lisa and Tobias' preprint: https://psyarxiv.com/rbn8c/

In the interests of being doubly awesome, Lisa and Tobias have a separate tutorial on using Open Broadcaster Software (OBS) for the screen recording of your tasks: osf.io/3twe9

Music Credit: Be Jammin - Alexander Nakarada

freepd.com/world.php

Episode 16 - Leonid Tiokhin

In another SpecialiTEA we had the pleasure of chatting to Leo Tiokhin @LeonidTiokhin about his path to meta science and his current work.

We had a slight technical hiccup, but Sophia saved us with a back-up recording!

To find out more about Leo's recent Registered Report "An experimental test of the effects of competition forpriority on information sampling", check out the repository here https://osf.io/tn2vu/

Music Credit: Be Jammin - Alexander Nakarada

freepd.com/world.php

Episode 15 - Responding To The Fallibility Of Others

In this second part-er we revisit Dorothy Bishop's "Fallibility in Science: Responding to Errors in the Work of Oneself and Others". Last episode we discussed responding to one's own errors. We got so wrapped up that we didn't get onto responding to others errors. So, we're back;

Highlights:

How should we respond to other's errors

Oh my god this is complicated and has so many grey areas, including;

- Does career stage matter?

- Does the profile of the work matter?

- should we, and when should we, contact the authors to let them know of errors, and what are the complications with this?

We also dive into the idea of commenting on the research, rather than the researcher and discuss the value of this.

What do you think? hit our twitter, DMs, and email to continue the chat!

Music Credit:

Kevin MacLeod - Funkerrific

Episode 14 - Responding to fallibility in science

This week we discuss Professor Dorothy Bishop's "Responding to fallibility in science" https://journals.sagepub.com/doi/10.1177/2515245918776632

Its been a while since we discussed a paper on the podcast. We really got into this discussion, and only got as far as "How should we deal with our own errors?". A whole two pages into the paper. We will revisit this paper soon to discuss responding to other's errors and distinguishing between the research and the researcher.

How do you think we should respond to our own errors? let us know!

Music credit:

Kevin MacLeod - Funkerific

Episode 13 – Fighting the impostor (syndrome)

Hello 2019! Amy, Sophia, and Sam discuss impostor syndrome. While Sam was concerned this would leave him wanting to hide under the desk and cry-eat chocolate for the rest of the day, it turned into an unexpectedly uplifting talk.

Get in touch with your experiences; what helps? what makes it worse? how can we help each other?

Just a few links:

We should all feel a bit more like impostors – Julia Rohrer - http://www.the100.ci/2018/08/02/we-should-all-feel-a-bit-more-like-impostors/

Sam’s old, early blog post on what impostor syndrome feels like https://samdparsons.blogspot.com/2017/10/students-questions-4-what-is-imposter.html

Last time we chatted to Ivan about his Thesis, but there was just too much to cover. Luckily, Ivan is a dude and agreed to chat to us again. Hope you enjoy

Ivan’s Dissertation “Discipline through method: Recent history and philosophy of scientific psychology (1950-2018)”

https://www.dropbox.com/s/amjv3oyu8u09nw2/2018%20thesis%20Ivan%20Flis%20final%20version.pdf?dl=0

Hornstein, G. A. (1988). Quantifying Psychological Phenomena: Debates, Dilemmas, and Implications. In J. G. Morawski (Ed.), The Rise of Experimentation in American Psychology (pp. 1–34). New Haven, CT: Yale University Press. (this whole book is a classic on the history of experimental psychology, if a bit dated. This chapter is where Hornstein coins the term ignored oppositions)

Araujo, S. (2016). Wundt and the Philosophical Foundations of Psychology : A Reappraisal. Cham, Switzerland: Springer International Publishing. (the book on Wundt mentioned)

Smith, L. D. (1986). Behaviorism and Logical Positivism: A Reassessment of the Alliance. Stanford, CA: Stanford University Press. (the book where Smith used and elaborated the concept of indigenous epistemology.

The Stanford Encyclopedia of Philosophy entry on epistemology, as a crash course in it (very good source for all things philosophical, in general): https://plato.stanford.edu/entries/epistemology/

Also, an intro to a special section on crises in psychology: Sturm, T., &

Mülberger, A. (2012). Crisis discussions in psychology—New historical and philosophical perspectives. Studies in History and Philosophy of

Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences, 43(2), 425–433. https://doi.org/10.1016/j.shpsc.2011.11.001

Open Science Collaboration Paper: https://www.google.com/search?q=open+science+collaboration+paper&rlz=1C1CHBF_en-GBGB766GB766&oq=open+science+collaboration+paper&aqs=chrome..69i57.3286j1j9&sourceid=chrome&ie=UTF-8

Fiona Fidler on Black Goat Pod https://blackgoat.podbean.com/e/this-time-could-be-different-with-fiona-fidler/

Music credit: Kevin MacLeod - Funkeriffic

freepd.com/misc.php

Episode 11 - Ivan Flis

This week we had an awesome chat with the super-interdisciplinary Ivan Flis. Ivan is like a cake made from psychology, history, and philosophy of science. This cake was the perfect compliment to our Repro-Tea. There was so much to cover that we will have Ivan back next time too!

Just a few of the amazing resources Ivan mentioned:

Deborah Mayo’s book, Statistical Inference as Severe Testing: How to Get Beyond the Statistics Words, Amy still doesn’t understand what she is really reading though…. (Sam is doing no better) (https://www.cambridge.org/core/books/statistical-inference-as-severe-testing/D9DF409EF568090F3F60407FF2B973B2)

Loads of books Ivan mentions which we could not keep track of but he did recommend two after our conversation:

OPTIMIST: Optimisation Methods in Science and Technology: http://www.ruhr-uni-bochum.de/optimist-survey/

George Reisch How the Cold War Transformed Philosophy of Science (2005) https://www.amazon.co.uk/How-Cold-Transformed-Philosophy-Science/dp/0521546893

Ivan’s Dissertation “Discipline through method: Recent history and philosophy of scientific psychology (1950-2018)”

https://www.dropbox.com/s/amjv3oyu8u09nw2/2018%20thesis%20Ivan%20Flis%20final%20version.pdf?dl=0

Ivan’s paper about textbooks, Instructional Manual of Boundary-Work: Psychology Textbooks, Student Subjectivities and Disciplinary Historiographies (that's a mouthful!) https://onlinelibrary.wiley.com/doi/full/10.1002/jhbs.21791

The Descartes Centre in Utrecht: https://www.uu.nl/en/descartes-centre

Ivan highly recommends to “Read more books”, if you want a starting point he mentions Kurt Danzinger’s Constructing the Subject (1990) https://www.cambridge.org/core/books/constructing-the-subject/6B1C7891EC8C6670ECD341B3F3E08B65

Music credit: Kevin MacLeod - Funkeriffic

freepd.com/misc.php

In a previous episode we discussed leaving academia. Lots of people who had left academia responded to our survey and gave us some insight into why they left and what they are doing now. This time we dive into the advice they offered to ECRs given the likely event of leaving academia. Thank you to everyone that responded, and for your advice.

We will post to this list as we find more resources :)

Music credit: Be Jammin – Alexander Nakarada

freepd.com/world.php