Dear readers and listeners!
WHOOPSIE!! We’re back, and we have more questions that we needed to talk about regarding Experiment 2. If you’re just tuning into our little circus here, we strongly recommend that you go back and listen to Episodes 1 and 2, and take a look at our blog, so that you know what the heck we’re talking about.
After recording Episode 2, Indigo realized that something was bothering them about how we had conducted Experiment 2. Indigo felt that our questions - Did you get up every 30 minutes? and Did you stay up for 5 minutes? perhaps OVERSIMPLIFIED what was actually going on. They seemed like they were straightforward questions, but in practice were not as straightforward to answer as we thought. When we reached the analysis stage that we’re in now, we started to realize that although we were focusing on breaks - we hadn’t clearly worked out what breaks meant to us, and that made the experiment complicated.
We just forged ahead - because we were excited about what we were doing, and because we wanted to make sure we were hitting the deadlines we had imposed on ourselves, but in hindsight we were setting ourselves up for some research hardship. We hadn’t clearly defined our OBJECT OF STUDY - what we were looking at - and we hadn’t really worked out an OPERATIONAL DEFINITION for what a break meant to us in the context of this experiment.
As you can hear in the supplementary discussion we have in this podcast - that led to some confusion and complications for our analysis. In the data, we talk about both BODY and BRAIN BREAKS, but hadn’t clearly defined what those were. We did our best to keep track of both, but our data collection wasn’t nuanced enough to capture the data we were hoping to - particularly about BRAIN BREAKS. This led to a flaw in the design of our data collection process.
Listen to our conversation, where we unpack where we think we went off the rails, why that might have happened, and how this kind of starting and stopping and readjusting is a very important part of the research process. For chunks of Experiment 2, we think that we were trying to impose a framework that didn’t quite fit our experience (research is often not quite accurate). We were also feeling a time pressure to make the deadlines (that we have imposed on ourselves) - THANKS, CAPITALISM.
We have decided to build in a checking mechanism into our experiments moving forwards - which is why you’ll start to see us talking about a PILOT period. We’ll try out the experiment, see how it’s working, and adjust things so that we can actually explore the questions we want to investigate and not rush through or barge through the experiment to meet a deadline. We think that this might help us to test out the experiment and help us to design experiments that really help us write and create more freely.
The episode is approximately 20 minutes long, and you can listen on Apple Podcasts, Google Play, TuneIn, Stitcher, or wherever else you get your podcasts.
Here is a transcript for the show.
As always, we welcome your feedback!
Love, Noah and Indigo.