Anyone who wants to hear you correctly will hear you. Those who want to misinterpret your words will do. Focus on what you can control — your intention and actions. These speak louder than any words you say.
Normalize saying "I don't think we have the kind of relationship that should make you comfortable enough to say that to me" when someone tries to get too familiar.