You'll never please everyone. Instead, focus on finding out who deserves your efforts.
When you start setting boundaries, you are going to make some people upset. Those are the people who do not deserve any influence over your emotions.
Set them free to free yourself.