There is just that pesky little thing known as the Prime Directive.
If it is wrong to relocate a group of people to save them, it is wrong to relocate a group of people to get at a resource. You can't have it both ways.
Most of us here who are for moving the Ba'ku aren't necessarily against saving other cultures in danger if feasible.
The issue is that Starfleets actions are in clear violation of the Prime Directive. Sometimes holding onto your ideals will place you in a worse position. But they are not called ideals for nothing. Either you truly believe in them or you don't. If you don't why bother having it in the first place.
Assumed pre-warp culture = stay clear
Internal affair of another culture = stay clear
If you want to apply eminant domain. The Government would compensate you. You could in theory oppose the claim of eminant domain through the courts. Most governments won't come in the middle of the night, bundle you into a transport and dump you in a new place.
Your argument seems to be that an inhabiated world if it falls within Federation space is it's do with as it pleases. So lets take a the Malcorains from TNG's "First Contact". The Federtion could go in transport it's inhabitants to another planet so they cold strip mine that planet. At what number does it becmoe wrong to move people who have evloved/settled there, 1000, 10 000, 100 000 a million?