Exactly what did these people expect Daryl to do? They acted shocked that he went with Merle. No, they can't have Merle amongst them but seriously....talk about a rock and a hard place.
And they need Daryl now that Rick is taking the road to the hallucinatory funny farm and Glenn is in avenging mode. Herschel's very wise but the poor man being without a leg makes leadership a bit problematic in a post apocalyptic world. They don't know Tyrese well enough. If Andrea were there, she'd try to level things out. She was actually making sense. Merle would try to take over if he were there.
Who's going to step into the power vaccuum while poor Rick is going kuckoo for cocoa puffs? Those visions of Lori aren't helping anything. Even in death, Lori causes problems.
Daryl actually would have been the best candidate.