I read that as her saying "Hey, I like you, I wanna be your friend, and maybe we'll become really good friends." She doesn't want to be Wife #4, but that doesn't mean she's backing away.
But the point is, he didn't push her away. He was receptive to the possibility. So I don't think it's his fault if nothing happened.