Yeah, so? He still believed in rules, just not their rules. Societies having rules is not "sacrificing freedom". Your freedom to swing your arms ends where the other person's nose begins.
What if the rules are arbitrary, unreasonable, unfair, unenforceable or weighted to benefit certain people (rich whites, for instance) over other people (poor blacks, for instance)? As to the arm swinging: if someone tries to hurt me or someone I care about, I'm going to try to not let them...if you know what I mean.