Good point. They do take shore leave in shifts. And O'Brien being a non-comm is probably last to go.
Although, in Two Days And Two Nights Archer says that only half of his crew would get to go on shore leave. However, you have to remember that Archer is an idiot.