Within & Between

What does it mean to have a lab, and who is part of it? In this episode, Jess and Sara describe their experiences with different lab setups and structures, and how they manage their meetings with students, projects, and collaborators. We discover that Sara has been using a lab management and productivity tool secretly for years! Our systems for working with our labs, projects, and students are always changing, and Sara might be a bit too addicted with trying to find the best combination.

Links from this episode:

Book about managing a lab that Jess mentions: At the Helm: Leading your Laboratory by Kathy Barker. The author also has “At the Bench”. 

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Season 2 Episode 5, it was recorded on December 13, 2020.

As the semester draws to a close, Jess wakes up in the middle of the night concerned not with completing her grading, but with measuring inter-rater reliability for coding schemes. Reliability can refer to the agreement among raters, or agreement among items. There’s a lot of online discourse right now around reliability, but most of it is focused around the former: agreement among items. Over here in the field of developmental science, we’re often coding human behavior through observations, including implementation fidelity. With scales like these, reliability is used to mean several different types of agreement among raters: Training coders to a reliability standard, “in-field” reliability between pairs of raters, “drift check” reliability as you continue to collect data over time, and then overall or average inter-rater reliability for all raters and observations. Only after assessing all of these can you begin to examine reliability designed to assess agreement among items.

Papers to read about establishing and measuring inter-rater reliability:

Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23.

Bruton, A., Conway, J. H., & Holgate, S. T. (2000). Reliability: what is it, and how is it measured?. Physiotherapy, 86(2), 94-99.

Also mentioned

McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412.

Raykov, T., & Marcoulides, G. A. (2019). Thanks coefficient alpha, we still need you!. Educational and Psychological Measurement, 79(1), 200-210.

Edwards, A., Joyner, K., & Schatschneider, C. (2019, June 27). A Simulation Study on the Performance of Different Reliability Estimation Methods. PsyArXiv. https://doi.org/10.31234/osf.io/xzc52.

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Season 2 Episode 4, it was recorded December 6th 2020.

It is a truth universally acknowledged that an academic in 2020 must be in want of an online presence. Jess and Sara describe why you need to be online, and their experiences with social media, professional networks, and creating websites (and that twitch isn’t just what happens to Jess’s eye after 6 straight hours on zoom calls). The episode ends with our top three suggestions for how to get involved online.

Links from this episode:

Jess’ tumblr blog

Introductory tutorial on how to use twitter as an academic by Dr. Mindy Bridges

Dr. Jenny Root’s Facebook is @DrJennyRoot

Dr. Kelly Farquharson’s CLASS Lab Instagram page

Sara playing Super Mario Bros and answering questions on Twitch

Dan Quintana’s Tutorial on designing a website in R

Diana Abarca’s List of professional websites

Sara’s lab website

Jess’ personal website 

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Season 2 Episode 3, it was recorded November 14, 2020.

To be or not to be (a parent!) that is the question. One of our listeners reached out with a question about timing of starting a family during an academic career. Jess and Sara both describe their respective experiences with having children, how quickly they got back to work, and the pros and cons of the academic work-life balance.

Resources: In case you don’t know what yeet means either.

Thanks to listener Emily Bibby for the episode idea!

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is S2 E2. It was recorded on November 1st, 2020.

In which we welcome you back to a new season of the podcast. Jess and Sara catch up on pandemic work and life. We describe the subtle and sometimes not so subtle feeling of being underwater that seems to accompany this particular time, describe how our online teaching is going, and discuss the different ways we’re translating and incorporating anti-racism into our courses.

Resources: Many analyst paper Jess mentioned. Paper Sara mentioned about how when you measure something can change your understanding of developmental change on that thing. Paper Sara mentioned that’s a great qualitative study on Black mothers' perception of their child’s experience in school. A theory paper you all should be assigning in your developmental science classes.

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is S2 E1. It was recorded on October 4th, 2020.

Did you miss us? Just a small teaser of Season 2! First full episode is out November 18!!

There’s a close link between the concepts of Perfection and Impostor Syndrome, perhaps mediated (or moderated?) by experiences of rejection. In this episode, we discuss that link, and personify it as Sara helps Jess try to cope with rejection and encourages her to get some rejected manuscripts back under review*.

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. *It was successful. Jess did get them back under review. This is Episode 11. It was recorded on August 15th.

In this episode we talk about rejections - paper rejections. Jess and Sara describe their emotional and not so emotional reactions to finding out whether a paper has been rejected, offered a revise and resubmit, or accepted. We also discuss how much we change a rejected manuscript before we send it elsewhere, how to craft a revision letter, and the urban legend of  papers accepted on the first submission.

Resources: The blog post mentioned which discusses a different way to revise and resubmit a paper. The rejection party.

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Episode 10. It was recorded on August 9th.

In this episode, we revisit how we’re working during COVID. Topics include excellent desk space (Sara) or lack thereof (Jess), and how we are and are not balancing parenting and working at the same time. We also talk about preparing to teach at a distance, and whether we’re even allowed back on campus.

Resources: Vijay Sathy - On who benefits from a flipped classroom and how to make your teaching more inclusive. And Flower Darby on how to make virtual teaching more inclusive and connecting with online students. Here is the tweet about COVID rates in Georgia -  Purposefully deceptive? Or the default of the statistical program?  The OpEd Sara cowrote with Drs. Emily Solari and Tiffany Hogan about potential impact of COVID on women’s careers, and the google form to crowd source YOUR ideas/needs/stories.

Connect with the podcast on twitter @within_between, or email us letters about developmental science at [email protected]. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This is Episode 9. It was recorded on July 23rd.