Evolution is a reactive response to stimulus.
The Ocampa wanted for nothing.
A lack of stimulus and possible inbreeding left to retardation.
A physical attack by the Borg is not going to promote psychic abilities in the Ocampa.
Only if they are attacked by a race of telepaths who use telepathy as a weapon are they going to flex those long atrophied muscles.