Is it okay to not want your brother in your life as an adult?

My brother and I used to be very close. He was like my best friend. As we grew older, he just "changed" especially when he met and married his wife. We grew apart not so amicably. My husband tried to have a sit down session to see if we all could mend our burned bridges (also to just have some kind of open communication), but I realized that I am and have been happier without him in my life. I tried to do this to please my elderly parents but I am sad that I could not do this one thing just for them. Am I wrong in feeling this way?