I like the idea too, but it's harder to rationalize the distances involved here!
The Kelvans made it to the Milky Way.
True. But if the Gorn had the tech, why didn't they show up before the Helios Device opened the Rip?
(Oh. Obvious answer: They didn't have the patience the Kelvans did. The peaceful schismatics who colonized our galaxy did.)