I don't know, I'm a huge fan of both franchises. Just because SW is more mainstream by and large, that has no bearing on my (lack of) interest to go see F&F. I know a lot of people in the same boat.
That said, sure. I can take the hit, especially where Iron Man is concerned. I do know a lot of people who skipped out on ST09 and STID but went to all three Iron Man flicks and look forward to more Star Wars.