I'm tired of being empathetic towards those who are less fortunate?

I'm one of those who are highly sensitive and everytime I encounter someone who's poor for example, I'm filled with sympathy. I get so overwhelmingly empathetic. I know its not my place to judge their quality of life, but everytime I think about and I try being myself I feel guilty. How do I get over this?