Personally, I have no problems giving something, but as he said he had no food, we offerecd, it was he who refused. Giving money to such a persons a waste.
It's not helping him,it only pushes him to go further downhill.
There are a lot of homeless people out there. Why not give them a place to stay and let them work. It can only be benificial for them as they will be able to help themselves.