Not operating from spoilers or anything of that nature, but I can see that happening to him at the hands of Maggie, Michonne, or Andrea. I think its almost a sure thing a woman will be the agent of his downfall.
It's going to have to be a princple that kiills of the Governor because we as the viewer just aren't emotionally invested in the townsfolk IMO. They are simply background noise to the main part of the story and the characters.
Disagree...the comics painted that picture for us nicely.