Believe me; it happens. I've heard someone say, "I went to one of my brothers' house this weekend ..." which, by the way, is equivalent to saying, "I went to my brother's house."
Some people say (and this is yet another wrong example), "One of my sisters' husband is a doctor," probably out of fear of giving the notion that such a sister was polyandrous by saying, "one of my sister's husbands." How many husbands does your sister have?
It would be a much more clear to say, "the husband of one of my sisters," or simply, "my brother-in-law."