Removing categories in sports would result in podiums filled with men, which is a root of that problem.
It is fine if you don’t mind it.
I prefer categorization for men, women, trans men, trans women, paralympics, and I would even leave that amusing category of not-tall-man basketball because they in fact cannot compete with tall players but they still can compete among themselves.