Going from "I have my father to thank for that" to flat out telling his father "You should have been the one to die" is not quite that realistic a jump. Both "A Matter Of Honor" and "Times Square" would seem to paint Riker as a man who got along with his father just fine, which is not the case at all. That's what I don't really like. It's like if Picard said his family was so proud of him when he enlisted in Starfleet, yet all of a sudden change into a family that resented him joining Starfleet. Thankfully that's not how it went and we were able to get a hint of Picard's family before they fully fledged out. Riker doesn't have that appropriate set up.