Walter was briefly mentioned recently. I understand your point though. Finding him is the reason Felicity started and continues to work with Oliver. But that is easy to forget. The one should have the biggest affect on is his wife, Moria, but she barely mentions or shows it. Of course her feelings and motivations for everything are a complete mystery.