For example it would be interesting to encounter a race that operates more like insect colonies. To them our concept of individual "human" rights would be meaningless and useless.
You are describing the Borg.
There really isn't a lot of uncharted thematic ground in Star Trek. I'm sure there is some, but it's hard to find.
Not really. the Borg are characterized by a hive mind and assimilation of technology and lifeforms into their collective.
I was proposing a means of throwing the issue of human rights on its head. The proposed alien species doesn't have to have a group consciousness. Instead it is the civilization that has the rights and individuals do not. Then having one of our intrepid crew try and and defend the rights of one of these aliens. But our hero gets a reality check when he realizes that human rights don't necessarily apply to all species.
I didn't say the concept of an insect like species was unique just that I would like to see scenarios where our heroes get taught a lesson for a change.
If it were a next generation episode you would have Picard telling Riker not to interfere with the natives. Then Riker would present some damning evidence in a court scene proving that the individuals do have rights. This would start a social change in the society to be more just and recognize individual rights. Bad, bad, alien society! You need to be more like us. Becasue humanziz 'r aw3s0me!