I get that silence is also a response but if you’re not about something (especially if I’m coming from a place of genuine care/concern) I’d rather you tell me that you’re not about it. (No explanations needed.)
The silence leaves too much room for assumptions. It irks me.