It is when a person begins to "forget" Hashem that he subsequently has fears from what creatures in this world could do against him. If he was fully boteyach on Hashem, he would understand no one could do anything against him without Hashem's involvement.