I think Eleven is more mature than some of us are giving him credit for. However, when it comes to people like River, Rory, and Amy, he doesn't see clearly. This is the first time in a very long time that the Doctor has felt like a part of a family, and he understandably doesn't want that to end.