Why do black beggars think I have money just because I am white? Is it racist?

I cant go anywhere without getting asked for change. I see what goes on, 5 or 6 other blacks can walk by and they dont ask and even if ask they do not act the same, but when they see me coming they get a twinkle in their eye and think its payday from good ol Mr. Whitey. Do black people really think all white people are rich?? Im struggling too..