Authentic individuals often irritate toxic people because they are genuine and true to themselves. When someone is real and honest about who they are, it can make toxic people feel uncomfortable or even threatened.
"If you commit a sin and take pleasure in it, the pleasure passes but the sin remains. But if you do something virtuous even though you are tired, the tiredness passes but the virtue remains." - St. Camillus de Lellis
The kinder and more rational a person is, the more he recognizes himself in others. A stupid, unkind person thinks that all other people are alien to him. A wise and kind person knows that the most valuable thing within him is also within every other person.
Unlearn shame. All kinds of shame: abuse, unemployment, sickness, vulnerability, longing, desire, mistakes, failures. You need not be ashamed of what you're feeling or living. Freedom and shame cannot coexist.