Peter may sense something since he has travelled through timelines.
That I definitely would agree with, given both what you said and the bond that existed between him and Walter. Of all the characters, Peter maintained memories of all the timelines he experienced (save for the future which now has never happened).
Yeah. It makes your head hurt to think about this too much.