I think the main point is the invasive rate of the cancer. It's true that some are much more rapid than others, and that the rate can change over time. But from all the information made available, it was not likely that surgery in 2003 would have made much of a difference. The cancer was very likely already in his liver, just starting to metastasize. And once there, it can easily spread throughout the body.
The upshot is to never take your health for granted and... if you've got the funds, get thorough detailed check-ups frequently, especially if there's family history of illness and/or you've been exposed to cancer promoting environments (e.g. industrial compounds, significant exposure to the sun during early years, etc).