Coulson was defending Nazi's as the "School Teacher". Or, to be more accurate, he was trying to pretend that Hydra aren't Nazi's (he must have school books written by Nick Spencer). So, yeah, everyone was basically a Nazi. Just because only two were active and most of the rest were civilian Nazi's doesn't mean shit. Plus, Ward was always a Nazi, and the simulation version was not an actual person, so you can't count him.
Anyone who can defend a show turning even 1 character into a Nazi, well, lets just say either needs to take a long look in the mirror, or is already on that monstrous side. Either way, after this post I'm probably not going to interact with anyone who is even unintentionally defending that kind of thing. You can't argue with people like that.
Only Fitz and May were Nazis in the framework, although I'll give you Coulson. He was spreading Hydra propaganda to kids and did try to turn in Simmons for fear of his own life.
Mace, Ward and Trip were all part of the resistance with Framework Simmons executed by Hydra for refusing to join them and Framework Skye wanting to join the resistance but unsure how to go about it. And Mack was a loving father living under an oppressive fascist regime that he despised and feared...until he too joined said resistance to redeem himself (at the likely cost of his own life) for turning in Daisy. That's six characters not being Nazis, two characters that are Nazis and a third that you could argue is a Nazi collaborator. So two thirds of the characters were fucking fighting the Nazis!!!
As for Framework Ward not being real, I feel that's one of Season 4's only failings. It's made pretty damn clear that Aida's powerful CPU combined with the magic from The Darkhold that she used to create the Framework meant that all of the AI inhabitants of the Framework were 100% sentient beings, but then the show handwaved all of that away at the finish line with a shrug and a "Fuck 'em. They aren't real." mentality. Presumably because the showrunners couldn't think of how to realistically write Mack out of the "I'm staying in the Framework to die with my daughter" corner if Hope was in fact real without Yo-Yo coming across as a complete asshole. I get why they did it, but it's still a wet fart stain on what is otherwise an excellent season and one of the best seasons of superhero television ever produced.