Since the government is ultimately what limits your freedom.
I think that sort of simplistic view can be a problem at the core of right wing thinking. Government can restrict or create freedom. Other forces can do too. We shouldn't fixate totally on one part of that mix.
(I don't have much to say on whatever's in the constitution, although they looked like very forward thinking guys for the time. But they didn't see the challenges of the modern world coming.)