I got the impression that members of Starfleet were called...Starfleet.
This is what I've always done. It covers all the bases.
You see a group, at a table, in a bar, with officers, enlisted, male, female, Human, Vulcan, Andorian and whatever. You can still just say, "They're Starfleet."