Because Star Trek is fiction, and any writer could potentially be hired by Star Trek rights owners to create stories (e.g., movies) for the canon, I feel perfectly able to say what is right and wrong, as is anyone else. With that in mind:
Picard was right. It is perfectly believable that even the benign, peaceful, benevolent - the curious - could be brutally attacked by ignorant bullies and the jealous simply for what they are. Or... What would you do if people starting magically showing up in your living room? They do nothing; just observe you for a while, say nothing, then leave. Over and over again. Especially, metaphorically speaking, living rooms in states like Florida or Texas. I can see "Stand Your Ground" laws extended by paranoid races to the utter prevention of such future visits even though no harm would ever have come to those in the living rooms.