Launching from Mars is the real problem which needs to be overcome. Getting off the moon when we went there was relatively easy, but Mars has a significant gravity well; and you know how complicated an Earth launch is.
What this means is that we need to get some infrastructure over there first, which means automated construction at least to a degree.
Do you really need an infrastructure to launch from Mars? Why not just refuel in Mars using the atmosphere to make the fuel and then go up,up,up,up,up.