This is the definition of a nightmare neighbor. I couldn't imagine dealing with this every day. I'd probably consider moving.
The neighbor constantly messes with your things and shouts at you, even touching your things. She calls the cops, and they can tell something is wrong with her. It could be mental illness. What would you do if your neighbor made your life hell? Would you move? I'm so glad I don't have to deal with this.