You lose a bit of it every time you recycle, turned into non-recyclable compounds.
You will lose half of it in half a dozen iterations or so. What wouldn’t be a big deal if so much of it wasn’t single-use, but it is.
Also, aluminum is more polluting to make than most plastics. It may compensate for that with the easiness of recycling or not, depends on lots of details.