I believe in personal freedom with safety issues like this. the same with seat belts, motorcycle helmets, etc. If you choose not to wear them you are the one responsible for what happens to you. Even if it wasn't a law I would wear a seatbelt going down the highway.
I wouldn't wear blaze orange when big game hunting if it wasn't mandated, but bird hunting in crowded public areas with heavy cover I think it's a good idea.
How refreshing it would be to be allowed to make up your own mind when you feel safe or not, and how to dress yourself.