Privilege is when there's a pandemic but your life goes on without much change.
Or the only changes for you are mere inconveniences, not tragic consequences. The difference between missing an annual trip and losing an annual income.
In times of Covid, if someone says they are not comfortable in attending an event of a large gathering, you really should be understanding about it. That's it. No further explanation needed. If you're gonna be offended about it, that's on you.