Well, he did get to hit on 7 of 9 in "Relativity"... but since that was in the past, I guess it doesn't negate the "confined to quarters" argument.
That verson of seven of nine died and was replaced, and that timeline was replaced... "Sigh"
This is why I think Joe was a dog. He was playing the long game with Anika, despite his wife being in the same Solar System.
So, only if Seven was integrated with all her corpses, then after
Relativity she would have been obligated to take Joe out for some joe just like she promised she would.