It's almost always the thumbs sideways votes that do them in.
I still question your logic of a thumbs-sideways counting as a "thumbs down" (or at the very least not counting FOR the contestant.)
If that's the case why does the sideways even exist if it can't help the person? Why isn't a "thumbs down" worth 0 points, a side ways worth 1 point and an up worth 2 points?
Everyone who says something like "Cute, but nothing special: sideways" in "reality" is hurting the entrant more than "helping."
I call shenanigans on this whole process!