he could have been off the island, somehow Widmore came and went off the Island, somehow Richard came and went off the island, so there IS a way for the others/hostiles to leave
Or his timetravel experiments prepared and protected him against it. I know, sounds very much like Trek time travel logic, but then again what was that little movie called Abrams is about to release into the theaters?