I think everybody is underestimating how badly Maggie and Glenn were terrorized. They were held captive, physically abused, humiliated, degraded, and constantly in fear of worse abuse and in fear of their lives. Glenn seems to feel like he failed Maggie and Maggie seems to be angry at Glenn because she cooperated to save him.
As for Daryl-- well, I still think they should just change the name of the show to The Adventures of Daryl
. He nearly singlehandedly saved those people on the bridge and then came back to the prison just in time to save Rick. And I love the subtle change in the dynamic between him and Merle-- now Merle is following him, and following his example. Daryl is the Dom now.