Agreed. For me it was the interplay between Freeman and Cumberbatch that sold me on the series. Not sure I would have been interested if there were different actors involved.
Also, the casting in this series tends toward fantastic across the board. Their choices for Mycroft, Irene Adler and Moriarty have all been dead-on great.