^ You're missing something that came across pretty obvious to me. Loki wasn't "in control" in the same way he was controlling Hawkeye, he was boosting their negative emotions. He was "broadcasting" anger, which he was directing primarily at Banner, but it was also affecting the others as well. The staff was like a broadcast antenna, they were all near it and they were all having a completely irrational argument. None of the things they were saying were things that they normally would have felt about each other, but due to the staff broadcasting emotions, it made them twist the "facts" into insults - something I picked up on because my ex-wife liked to do that too. 
