Stray cats are a weird thing. They basically run rampant in my town, so if I were ever to see a random cat outside, it would never occur to me that it might belong to someone. They just do their own thing, and we leave them be.
Of course, none of them ever try to come inside my house either. That would probably throw me off.