I think you might be the only one that really feels that way. While O'Niell was a big character, probably the biggest, there were growing more towards the other characters throughout the show. Plus Daniel was also very important. To me it was more a continuation of the movie, and as time went on we learned more of the supporting characters. Sam started having bigger roles on season two onwards.