If you understand "Matthew 7:6" you won't feel bad anymore if you decide to choose your circle carefully. Whatever is valuable or precious to you ( it could be your time, or something else) don't share it with random people.
Jesus gave specific instructions in the Bible that people intentionally don't talk about (Maybe they fear being hated by people)
Don't feel bad if you intentionally snub certain people who don't serve your interests. You haven't sinned if you stop replying ungrateful people, or time wasters, or noise makers.
People who don't know your family lineage, those who don't have preview of your spiritual battle experiences, those who don't know your working formula against evil practices should not be the ones to dictate to you how to work with/for God.
If you have fought spiritual battles and overcome, don't take spiritual advise from people who have no spiritual battles experience.