We don't have any indication that Fate (or this particular fate) is invisible. She just has the ability to freeze people and/or time and thereby move around unnoticed.
I'm curious how this discussion of fate fits into Death and the natural order of things. We had a whole episode recently in which Dean learned not to mess with such things, after all. You would think he would have mentioned it.