How is it more difficult? If someone’s name is Joe Smith, you would commonly expect to refer to them as Joe. But say they ask you to refer to them as Mr. Smith. Ok, no big deal, right?
Referring to someone by their preferred pronoun is no different. If Joe wants to be “they”, it’s no big deal.
The apparent issue is with gender and people’s personal hang ups with it. People change how they address others all the time, formally, informally, professionally, familiar, marriage name change, etc. So all I’m getting here is resistance to what…? LBGTQ people?