Because it's a huge
error? The entirety of The Abominable Snowmen hinges on The Doctor's prior visit to the monastery hundreds of years ago. It's kinda impossible to overlook when watching either story.
We have an origin story for something that 2 appearances earlier is said to have been around for over a hundred years prior to said origin story. It's a really weird error.