Even if you don’t have a gun it’s a problem, if you are are stopped by police for a random check^1. You are asked for your license and registration papers. You move your hand 1 cm to get it, cop suddenly realizes you could theoretically have a gun, then decides to shoot you first because self defense.
The possibility that literally everyone can have a firearm makes living there so much more dangerous compared to not having the option of shooting back whenever it would be needed for actual self defense.
^1 probability for random police checks has an inverse proportionality to the whiteness of one’s skin color.