Edith is a helper. We know this. But was she a poor helping other poors, or was this what we saw her "Batman" persona, and Keeler retired to a stately manor every night after a hard day doling out soup?
It's reasonably more likely she lost most of her money in the stock market crash, and other issues like an idiot husband who killed himself because he couldn't cope with being such a failure after losing the family fortune... If I can trust her accent (which obviously I can't, Edith was raised in a castle with servants, and hunted the poor for sport) she had come down in the world, even if Edith still did own that building and was using it as a boarding house, and other services.
If her father was an earl, meeting Roosevelt in '36 wouldn't have been a big deal, and maybe even a bit of a yawn.