Nope, science fiction isn't fantasy.
Of course it is - just like horror and alternate history. Just like superhero comics. Just like animated cartoons about talking toys.
Fantasy is fiction unconstrained by reality.
You think it's coincidence that fans of all these things tend to congregate together?