In "Non Sequitur" it's like everyone in San Francisco is Starfleet, the way they pop up everywhere during the chase.
Which is still insignifigant, if you think about the population of the Federation. 150+ member worlds plus all their colonies. You are talking a population in the hWundreds of billions if not nearing a trillion.
Well... uh... I did say it could be well over a million.