If it’s large enough to impose disadvantage on a Dex save it’s large enough to cast a noticable enough shadow to grant advantage, therefore a flat roll.

This isn’t a physics sim. This is a roleplaying game. Physics are what I allow them to be and it’s funnier for falling creatures to have a drop shadow.