Well, first off, it he gropes you again, you ought to knee him in the balls and call the cops.
Second, definitely follow through on your threat to tell his wife.
Third, a restraining order might be a good idea. Don't know how that works, but if he's laid hands on you, pile it on thick to the local police.
I'm divorced, but that is just unacceptable behavior, esp. if the guy is married.
Maybe we should have our New York meet-up at your place, so your male friends can go over and have a talk with this guy. You've seen my pic -- I can be pretty threatening.
To refresh your memory, I'll have a chat with him dressed like this: