Huh, wonder why I thought that. Maybe I read a spoiler somewhere. Because as soon as I saw the initial scene of Walter at the cemetery I figured he was at Peter's old grave.I thought we knew that Peter was not the original Peter back since the episode when the Observer fought him...
No, we just knew that the Oserver saved Walter and Peter and somehow saved Peter.