Thanks to the new contact shaders in vrchat and @poiyomi's nice little tutorial here, I made myself a ghost version of me.
Whenever someone gets close it dissolves me away, can't touch ghosts afterall.
Also using some vertex options to make me look like I am floating :)