You don't dislike people, but you are scared of such people. Fear towards them causes disliking.