The gravity alone doesn't cut it. Wouldn't they look very differently if their heavy gravity genes started growing on lighter gravity worlds? If Vulcans looked normal for their species and Romulus had Earth-like gravity, wouldn't Romulans all be like 18 feet tall and look like they were suffering severe muscle atrophy?