I think they figured out how to write the show in season 4.
Season 1 seemed more like a season of Voyager, only closer to Earth. The focus on character's gimmicks rather than interesting development, the trapped in a small space episodes, the alien of the week.
I agree with your assessment of both seasons 1 and 4.
With season 4 it really seemed the show found it's identity.