HFR is indeed a strange experience. It takes some time to become used to, but then I didn't find it distracting or annoying at all.
The very first thing we see is Bilbo putting stuff in a chest, and I thought it was played twice as fast. But then I realized it's just a thing you need to get accustomed to. When you go into a cinema, you expect a film to look a certain way. HFR doesn't look like that at all, which is why your brain needs to learn how it is supposed to work.
Heh ... I'm jealous. I wanted
to not notice the speed issues. Never could quite get over it. Maybe I was overthinking it?