Sure. In my mind the test is "am I deciding something for myself or for someone else?" And if it's for someone else, it's "am I being harmed by their choice?"
Harm is not annoyance (for example, one of my child's friends is trans, and I get the genders wrong sometimes and it's annoying)...