Voyager's original crew compliment was 141 according to Stadi. That either did or did not include Tom Paris at launch.
The first time they ever mentioned a total number of people aboard the ship after that was The 37's, with 152. Not sure whether Janeway included The Doctor in that number.
At least 5 people died on Voyager in Caretaker, Cavit, Stadi, Unnamed Doctor, Nurse and Chief Engineer, bringing the crew number down to 136. Between Caretaker and 37's, Durst died. So after the two crews merged, the number would be 153.
Chakotay's crew was at least 17, maybe more depending on other Voyager Casualties from being taken to the Delta Quadrant.