Let’s be clear, it’s really low risk, especially for such a low strength one, but some types of components can get damaged by it, or you could end up dislodging badly soldered or already damaged ones while you move the board around.
In the worst case, if you dislodge them just enough to give you an intermittent problem, good luck debugging it.
I just feel that it’s not worth risking it.