When Jesus called people, He interrupted their goals, their plans, their life works and their consciences as well.  The more they know Him, the more they came to understand that following Jesus was not a part-time vocation but an absolute, all-encompassing commitment.  And that is why on more than one occasion, some turned away and ceased to follow him.