Most crew members don't expect to be fired upon while walking the corridors of the Enterprise, but occasionally it does happen. And Armor is uncomfortable to wear, I don't think most crew are going to want to wear it if they have reasonable expectations of safety.