The problem is whats being perfected. The Borg drones or the Borg Collective. They are two different things.
The Collective is seeking perfection, and sends it drones out to pursue those goals.
Drones are simply parts of the collective. If the collective were destroyed, those parts are no longer Borg, because they never were.