This, even if we accept he did in no way directly coerce anyone it doesn't change the power imbalance he clearly repeatedly took advantage of.
If I have an affair and sleep with someone other than my wife, I'm a shitbag.
If I have an affair and sleep with a patient I'm a predatory shitbag, even if she sought the relationship out.
That's the fundamental difference, when someone is in such a position of power direct coercion is not needed, the very fact they abused that position to meet their own needs is sufficient.
I don't believe for a second he didn't grasp the concept that these young women would likely not have been interested or willing if he had been the janitor rather than the producer, that there was a fair chance they were sleeping with him because they already had a preconceived idea that was what they were supposed to do, an idea any decent person would have persuaded them against rather than indulging himself.