If you've ever thought about a woman "Damn she's hot.." then you've got no leg to stand on either.
You can be all protective and gentlemanlike you want but in the end it boils down to this.
Men like attractive women but the good ones know that this is just the outer layer of a person and there's more to every person than their body.
I'll turn my head after an attractive woman till the day i die and it is the same for women.. if you deny this then you are disingenious and at worst someone who idolizes women as some kind of fantasy creature to be worshipped.
Men and women do this and i see no fault in it.. the fault would be to stop at the outer layer and i'll have no further interest in any person who reduces a person to just their body.