No, that's not correct. Even the Oxford English Dictionary notes that it is often considered offensive.
...by those looking for something to be offended by. It's rarely
ever used offensively and is nowhere even remotely close to words such as nigger or faggot which are