And you don't think that battle would have been joined then and there, if that had been the case?The Hound was pretty clearly telling/reminding his brother that they have unfinished business that they will settle at a later date.
The Hound's words were:
"Remember me? Yeah ya do. You're even fucking uglier than I am now. What'd they do to you? Doesn't matter. It's not how it ends for you, brother. You know who's coming for you. You've always known."
That doesn't sound like he's talking about himself, to me.