But there's a difference between knowing and rumours. Clearly some people knew for sure, and they need to account for themselves, but for a lot of people they were just rumours.
I mean there are rumours that Jeremy Renner, Tom Cruise, Hugh Jackman and John Travolta are gay, but until somone steps forward with cast iron facts they remain just that, rumours.
I do find it curious that the media didn't go after him if there was a smidgen of a story there, it isn't like they haven't gone after high profile/ wealthy people before. Whether it's because his charity work somehow shielded him I don't know.