Exactly, you would bypass millions and billions of stars as you zip along to the center of the Galaxy. Average distance between stars is 5 LYs IIRC. So it's more a matter of systematically fanning out in a series of small warp sprints along the web of star systems, probably organized by assigned Sectors, and building Starbases, supply depots, manufacturing and fabrication facilities, sub space buoys, arrays, colonies and other outposts along the way.