Don't be nervous about severing ties with people. Where you're going isn't for them.