Not every beggar is asking to receive.

The holy tzaddikim, like the Rebbe of Ruzhin, saw some beggars as messengers sent not to take, but to give. What if the one holding out their hand is actually answering your prayer?