I don’t think it’s “quite a claim".

You’re right, you can’t disagree with experience. That should mean you’d believe the experience and accept it, using the terms the person uses for themselves.

If you’re a bigot, however, you deny this person respect by calling them something else, refusing to use their pronouns.