When you lose your second factor, there are two things to be concerned about: getting into your own account -- for which you should be prepared -- and someone else having access to your second factor -- which isn't as scary as it sounds.