Do you tend to say "no" automatically to an invitation to a small adventure because you feel like you'd be inconveniencing someone else? I can relate! Here's why we should stop.